I am trying to create a "one click solution" with a Hadoop cluster, Ambari Server and a Talend via Apache Brooklyn in the cloud.
I can create all of the things, but now I have to connect them.
I am able to create "the project/connection" between the Ambari Server and the Talend manually. I have the url of the Ambari Server, so I can open the Talend and create the connection with the Hadoop cluster using the wizard of the Talend.
The question is, is there any way to do it without opening the Talend. I mean, creating manually the files that are needed and leave them into the corresponding folders.
In case of yes, which would be the files I need to create and what would be the content of this files?
I'm not familiar with Talend but a few Google searches, as well as this anwser suggest that Talend Open Studio does not come with a REST API.
As for a configuration file, I could not find any results. So my conclusion is that it is not possible to automatised.
When you think about it, it actually makes sense as the Talend Open Studio is mean to be a graphical and visualisation tool to build complex jobs.
Related
I am using MuleSoft CloudHub with Runtime v4.4 to upload CSV data to Tableau Server. The documentation page https://docs.mulesoft.com/tableau-specialist-connector/1.1/ confirms that its not possible to use Hyper Configuration and its operations in CloudHub because CloudHub does not allow executing external code due to security reasons. That is why I am trying to use REST configurations and it's available operations.
With all my attempts, I am able to connect to Tableau server and successfully perform simple operations like Initial file upload, Query project, Append to file upload, etc. But, these operations does not help to publish my CSV content to Tableau. Publish workbook operation also requires file content in *.twbx format, and I am not sure how to convert CSV/JSON/XML to TWBX content type.
I have referred some websites and MuleSoft technical videos where HTTPS connection can be used to upload data to Tableau but those examples are using *.hyper file from classpath.
So, basically I am stuck at 2 different paths:
How can I transform CSV content to hyper file content in Mule flow. If this transform is possible then I can use HTTPS connection to Tableau and upload my data.
Using MuleSoft Tableau connector v1.1 and with REST configurations, is it possible to upload data to Tableau?
If there is any other solution, then I am happy to change my implementation strategy. Please can somebody guide me to correct direction?
I'm using Talend for Data Integration v 7.3.1.20200219_1130 and I want to use tREST_request and tREST_response as server side in order to convert an Excel file to XML file.
My problem is that I cannot find both components in ESB section, as described in Talend documentation, I looked also in "Palette Settings", there's only tRESTClient.
I'm wondering if this is a version problem (those components are omitted in this version) or those components are not avaible in free version?
You have to download Talend Open Studio for ESB in order to get those components.
I don't know why, but this version is not available anymore on talend website. You have to go to sourceforge to find it.
https://sourceforge.net/projects/talendesb/
With Talend Open Studio for ESB you can develop job to provide services (through tRestRequest/tRestResponse components, are SOAP components), as well as developing classic Talend Data Integration jobs.
As part of our project we have developed many etl solutions through Talend, they are extensively tested across platforms which are contained to local system - meaning they were tested by manually executing through the desktop software both the free version and subscription version. Now we are targeting to push/publish the Jobs gradually to Talend Cloud. How the Talend Cloud (management console etc...) works I have a fair bit of knowledge on that but what keeps me on doubt are the file based jobs which were developed.
Scenario: We have few jobs which are file based - access files from FTP or push files to FTP or write data to excel/delimited files. Now we couldn't read/write data directly from files that are in FTP so we need to have local copy first. Until now as we had developed/tested on desktop software this was all good but now what I am not sure is how do we handle the situation when we publish these jobs to Talend Cloud.
More specifically how do we handle/change the file paths that were until now pointing to some random C/D/E drive but now needs to be remapped to Cloud paths - how are the Talend Cloud directories defined?
Development Platform: Talend Open Studio for Data Integration Version: 6.5.1
Cloud Platform: Talend Integration Cloud Hybrid Edition Version: 6.5.1
Let say , If you are publishing already created job to Talend Cloud.
You can able to run that published Job on one Remote server in the Talend Cloud.
SO when pointing local directory for the FTP fetch,U have to provide remote server path.
Consider:- In existing job, you have c:/temp as local directory
similarly in the remote engine create on temp path c:/temp directory in order for your jobs to work with out any job modification.
Which talend tool should i download . I need to use enterprise technologies like REST/SOAP/JSON/XML/JDBC/SFTP/XSD (Oracle).
My use cases are :
Exposing services(REST/SOAP)
Reading from file like MT940,CSV,flat files and storing in database (Oracle)
Using SFTP ,File Movements frequently.
What is the difference between TALEND Data integration and Talend ESB.
Currently i have download Talend Big Data Open studio .
Will this suffice?
It depends on what you are wanting to do with it. I'm thinking Talend Data Integrator, the free version should suffice, if all you want to do is pull data.
I want to connect with following tools.So Are the following connectors available in Talend?.Please suggest me.
1)BuiltWith
2)Datanyze
3)New Relic
4)Zend Desk
May I suggest the following link for you to peruse that will allow you to see what components are available for each Talend product.
https://www.talendforge.org/components/
For example, I looked at Talend Open Studio for Data Integration (6.2.0) and did not find any components for BuiltWith, Datanyze, New Relic or Zend Desk.
HTH