I would like to understand difference between Talend DI and Talend enterprise version.
Please share your knowledge in this respect.
Talend is constantly changing the naming of his products, so it is quite difficult to know what is behind the name of a version.
Here is a page on talend site :
https://www.talend.com/products/
Talend Data Integration is the 'core' product, with which you can work with talend components to integrate data. It is the equivalent of "Talend Open Studio for Data Integration" in the licensed ecosystem.
Talend Enterprise no longer appears : it is now rebranded as Talend Data Fabric , which is an aggregation of different Talend Apps.
You have to constantly watch for new products rebranding, so bookmark the link given above, as it is my main source of information on this subject.
With the enterprise addition you get additional components that aid mult-user development such as bitbucket(git), TAC - Talend Admin Console that assists scheduling of job amongst others including Big Data components etc. However having said that, you do get a lot in the free version which is a standalone dev tool and mostly there are workarounds for the above but can take significantly longer.
Related
It was originally free and I was using it for almost 3-4 months. It told me that I exceeded the quota so I deleted the project and created a new one. I went to Catalog then Watson Visual Recognition and the only plan avaialble is standard which means I have to pay but before I set it up for free and was using it fine since then. Am I doing something wrong or did IBM change something? I even tried this on a new account but it still says the same thing.
As per the Visual Recognition service release notes dated: 16-10-2020
Changes
The following new features and changes to the service are available.
16 October 2020
You can no longer create a Lite plan instance of the Visual Recognition service. However, existing Lite plan instances remain available. You can create new instances as billable Standard plans.
You can check the details in the documentation here
Yes,IBM has made visual recognition to paid..But lite version is still available on the cloud and you can use them for a while like 4-6 months and after the lite plan done you need to get a paid plan which gives you more abilities to do with IBM Watson services currently..And my suggestion if your trying to learn or want to learn or advance these topics see the docs of service.
From my understanding, Informatica Cloud, Boomi, Talend, JitterBit are all integration tools which have "Connectors" to connect to servers (and I believe these Connectors in turn call APIs to access the required data). I saw many others but none of them are free although some are open source.
Are there any tools that help you visualize the integration process for free? If not, why not?
Tools like Informatica, Boomi provide drag and drop which show the entire flow.
Talend Open Studio is one such tool. not completely visual but almost there.
There are not many free tools as data storage technologies are constantly changing. It would be expensive for developers to keep up with constantly changing technologies without a source of income.
Developing data integration tools are resource intensive. Why would anybody(any enterprise company) spend so much of their effort and give away for free. Also the provider of the tools have to provide support for enterprise level . P1 means 4 hour response which means building the capability of the support team on par with the developer. All of these cost money and time. The only way to recoup is to sell the finished product and provide services.
Am need of your suggestion for scenario below :
one of our clients has 8 postgres DB servers used as OLTP and now wants to generate MIS reports/dashboards integrating all the data in the servers.
- There are around 100 reports to be generated
- There would be around 50k rows added to each of these databases
- the reports are to be generated for once every month
- they are running all there setup in baremetals
- they don't want to use hadoop/spark , since they think the maintainabilty will be higher
- they want to use opensource tech to accomplish this task
with all said above, one approach would be to write scripts to bring aggregated data into one server
and then manually code the reports with frontend javascript.
is there any better approach using ETL tools like Talend,Pentaho etc.
which ETL tool would be best suited for this ?
community editions of any ETL tool would suffice the above requirement..?
I know for the fact that the commercial offering of any of the ETL tools will not be in the budget.
could you please let me know your views on this.
Thanks in Advance
Deepak
Sure Yes. I did similar things successfully a dozen time in my life.
My suggestion is to use Pentaho-Data-Integrator (or Talend) to collect the data in one place and then filter, aggregate and format the data. The data volume is not an issue as long as you have a decent server.
For the reports, I suggest to produce them with Pentaho-Report-Designer so that they can be send by mail (with Pentaho-DI) or distributed with a Pentaho-BI-server.
You can also make javascript front end with Pentaho-CDE.
All of these tools are mature, robust, easy to use, have a community edition and well supported by the community.
Based on search in internet web sites, Whenever I tried to find a sample or advanced Task Flow based ADF Application created purely using Oracle Enterprise Pack for Eclipse and Glassfish I only end up with a blog entry 5 year old.
When I try to read any ebook, I end up with JDeveloper and weblogic.
When I try to read the tutorial videos from the official oracle website and oracle official YouTube channels I end up with JDeveloper and weblogic.
Does this means that there will be no support provided by oracle for OEPE and ADF Essentials?
Also the basic tutorial for OEPE is too old. Few basic Unbounded Task flow techniques are not working with OEPE and ADF Essentials.
Unfortunately the state of things is exactly as you described.
It looks like there's some sort of development occasionally going on the OEPE repository with the last change being made on 2016-12-19.
I think that some level of support will probably be provided, and frankly it's pretty much the same level of support that has been available for years - low.
Anyone that needs to make a choice (or has a choice for that matter) should take a long, hard look at the situation as it is.
Programmers that actually promote their products to production need an installer. (pre-emptive "programming related" justificaton.)
For deploying a new suite of internal corporate apps and services, I'm trying to decide between using WIX and the InstallShield Express edition that comes with Visual Studio 2010.
I've looked, but haven't found a feature matrix that highlights the features that are not in the express edition. I expect WIX to be generally quite capable, but more difficult to use, and have heard of situations that WIX doesn't support well.
Has anyone found a feature matrix, or have other recommendations on the long-term best way to manage internal deployments?
I find that wix is a great choice (in spite of the very very steep learning curve) if you need to manage installers in a complex environment because
setup definitions are stored in an XML format
it gives you full control to the underlying windows installer technology; the XML schema typically closely follows the windows installer database schema (which is also the main reason why the learning curve is so steep)
It is easy to integrate into your automated build
Parts of the setup can be generated automatically
It allows you to define small reusable modules and manage complex dependencies between them.
no cost or licensing issues (before wix we all had to use a single "Installshield PC")
Why the XML format is an advantage: this allows you to fully leverage code versioning systems like subversion or mercurial. Reviewing changes, examining history or even merging changes across branches is a breeze. Compare that to installshield projects which are opaque binary blobs.
What I mean by managing complex dependencies: in our case we have a big pool of reusable component libraries with a complex set of dependencies between them, and many applications that were build on top of that. Before wix, this was a nightmare when a new dependency was introduced somewhere: ALL setups had to be updated.
Now with wix, we have a ComponentGroup for each library, organized into a couple wixlibs. Each component group references other component groups that it depends on with a ComponentGroupRef. Application setup developers only need to reference the component groups of direct dependencies, and wix will do the rest by following the references. As a result, introducing a new dependency only requires making a single local change. Our automated builds and wix do the rest to regenerate all the setups.
InstallShield Express is for basic deployments (it's nothing but glorified WinZip). You can also check my favorite AdvancedInstaller. They have also free express edition but I think both of them will be no use to you, because if you need to do anything with IIS, MS SQL, Active directory, GAC etc, you will need "enterprise level" editions. WiX is free but learning curve is so steep, that it's not worth learning. I regret ever learning it.
If you need this just for internal deployments and cannot spend $1,000 on installer, just create your own "installation" project from scratch. System.EnterpriseServices.Internal namespace contains some useful wrappers for IIS, GAC etc. System.Configuration.Install.ManagedInstallerClass can help you deploy windows services. In other words, you can make your own program from scratch that can handle all necessary steps for deployment of your primary product. Many companies don't use for their flagship products commercial installers, they make their own.
The feature matrix for Install shield can be found here:
http://www.flexerasoftware.com/products/installshield/features.htm
However, for the IIS section (I assume you need IIS based on the link to my earlier question) all it says is "Limited". It is up to you to guess what Limited means, but I am betting it will not support an enterprise level deployment.