How can I extract data using Talend from websites such as below to do some data analysis:
Airbnb,
change.org
monster.com
ebay
I am new to TOS and not familiar with internet components. I think I may be confused regarding what connectors to use (trest, tsoap...). If anyone could help me understand which kind of connectors are needed that would be great.
You can use following architecture
tREST --> tExtractJSON or tExtractXMLFields component depending on your requirement.
Related
I'm trying to connect to a SAP system using SAP JCo. Our client is taking long time to download and give the SAP JCo. Is SAP JCo dll and Jar specific to a SAP Box or can be used across different boxes? Can I use a SAP JCo downloaded using SAP ID registered in our SAP Box and use it?
Note that the redistribution of the connector is not allowed by SAP.
-> if you develop an application for a customer, this customer has to download and provide you the JCO lib for his SAP installation.
See : https://support.sap.com/en/product/connectors.html
SAP JCo is library which can be used to communicate with any SAP on-premise system that supports SAP's RFC protocol. This is comparable to a database vendor specific JDBC driver.
Just provide the logon credentials and connect to any available system of this type.
You can find further general information about the SAP Java Connector here:
https://support.sap.com/jco
(Much appreciate trixx's suggestion in the comments; I am editing this reply to directly answer op's question instead of giving general statement)
SAPJco is not specific to an SAP installation. Assume you have a valid S-ID to access SAP software download page ("Connector" section) to download the JCO file. Once you download it, you can start with some simple examples. Here is one blog for reference.
(original reply was:
Your best bet would be to search in Google through keywords like "SAP JCO sample" to read some very basic examples, and try to practice from them. Once you start to get used to the design pattern, you can blend your requirement in and become productive. It is not difficult to get started. Keep learning and practicing. )
I'm working on a project, within which we are using semantic web technologies and creating web application allows user to get recommendation in order to take right decision ( won't get into the details).
For me and my team its a first experience to work with ontology.
We've already created ontology (have rdf and owl formatted files)(We are using eclipse to keep them).
Separately, we've created web application. My question how to connect web page and owl, rdf formatted data, more precisely, how to ensure input through webpage to dataset and get output on page.
I've found some info( on old forums), that its easyrdf which can be used as embedded in php script. But not clear.
Based on youtube tutorials, I've downloaded jena fuseki and don't know what is the next step.
I would be glad to get any advice, suggestion :)
In my view, there is no a single way to do this.
I usually set up some back-end application in order to pre-process this kind of information (build SPARQL queries, execute them and parse the results) and then return to the front in some way understandable by that side.
So, you could have all your data in RDF format store, for example, in a TDF exposed by Fuseki and interact with that data with some back-end, aimed to consume, update and parse the results you could find there.
That's my advice, hope could be useful for you.
Good luck!
We are trying to build a wrapper system for business users and we want to explore option of building a capability to submit the HIVE query from a JSP page. I could not find a best example or suggested mechanism for this. Anyone tried this before? If so can someone share their best ideas? We are looking for the REST API mechanism. If that wont work, then we can use java from JSP servlets.
Appreciate your support.
Kiran
You can use JDBC. I dont think there is a REST API for Hive.
But since most developers & application typically use JDBC this should be the preferred mode.
More details can be found here (Assuming you are using latest Hive versions) : Hive 2 Clients
Sample code sample code
I'm looking to interact with my Microsoft Dynamics CRM system from my iPhone, performing tasks such as pulling down, updating, creating and deleting records.
Is this possible? If so, can anyone link me to any good resources on the matter or provide me with any information you feel would be relevant?
Many thanks,
Jack
Yes this will be possible and there are at least some relevant pointers in the CRM SDK (Development from Non-.NET Clients in Microsoft Dynamics CRM) however general support and anecdotal information is sparse (in fact the referenced topic and it's links are all that exist in an official sense).
You will be accessing via the SOAP endpoint and the link to the WSDL for that is exposed via the CRM UI (Settings > Customizations > Developer Resources).
I'd start with downloading the CRM SDK and reading the topics I linked to.
Caveat - I know nothing of Objective-C or IOS
I don't know anything about this, but maybe that'll help: http://www.cwrmobility.com/
If your looking to develop something yourlself, this might help: http://www.microsoft.com/en-us/download/details.aspx?id=13621
It is possible, you'll need to use the web services API.
MSDN web services API docs
It uses JScript, so on the iPhone, you should use NSURLRequest and NSURLConnection to retrieve the data coming back.
Here is another link for using JSON, as iOS has a JSON parser built in now
MS CRM using JSON
I have been trying to find information regarding if it is possible to upload and download files using WCF Data Services (formerly ADO.NET Data Services), but haven't been able to make any leads due to perhaps less help content available on wcf data services on the web as of now.
Is it possible for us to write a wcf data service so that client can post to the following URI to upload a file - http://some-restfulwebservice/Files/upload
and this url to download the fie - http://some-restfulwebservice/File('XYZ.txt')/download
Any good examples/sample code? Any help or direction would be appreciated?
Astoria supports something very much like this through something called Media Link Entries.
I am working on samples to help here at the moment, but it will take me a few more weeks probably
Check out IDataServiceStreamProvider in the meantime.
And check back on my Custom Data Service Providers series in a week or two.
Hope this helps
Cheers
Alex
Data Services Team - Microsoft.