Talend DI Component to visit URL - talend

Is there any component in Talend Open Studio for Data Integration to visit URL and records the timings, or perform some activities, etc.

You can use tHttpRequest to send http request to server, and to get timing use tChronometerStart and tChronometerStop.

Related

How to use Talend tRESTClient component to send xml request with POST method

I'm trying to use Talend studio 6.4.1 to call a REST API, the request body is xml and the method is POST, by using a tRESTClient component, the response is
Error Response
It seems that the problem is caused by wrong url, but by using the Postman, it works well.
The screenshot is as below:
The job and tRESTClient component
and the input schema is like as below:
The input schema
I have search for this problem via Google and StackOverflow for a long time, but I can't find the reason, any suggestion would be very appreciated, thank you in advance. By the way, the 1.1.1.1 is not real IP I used, but just for privacy purpose.

WWW::Mechanize::Chrome capture XHR response

I am using Perl WWW::Mechanize::Chrome to automate a JS heavy website.
In response to a user click the page among many other requests, requests and loads a JSON file using XHR.
Is there some way to save this particular JSON data to a file?
To intercept requests like that, you generally need to use the webRequest API to filter and retrieve specific responses. I do not think you can do that via WWW::Mechanize::Chrome.
WWW::Mechanize::Chrome tries to give you the content of all requests, but Chrome itself does not make the content of XHR requests available ( https://bugs.chromium.org/p/chromium/issues/detail?id=457484 ). So the approach I take in (for example ) Net::Google::Keep is to replay the XHR requests using plain Perl LWP requests by copying the cookies and parameters from the Chrome requests-
Please note that the official support forum for WWW::Mechanize::Chrome is https://perlmonks.org , not StackOverflow.

how to send the ouput of wso2cep to REST api?

I am working with wso2cep3.1.0. I am taking the input by subscribing to ActiveMQ. But I want to output the contents of wso2cep to REST api. How can I do that??
You can use HTTP event output adaptor for this purpose[1]. This adapter will generate HTTP GET request. You can dynamically inject attributes from streams to the request with the following fix[2]. Fix is already available in public repository in github.
[1] https://docs.wso2.com/display/CEP310/Output+HTTP+Event+Adapter
[2] https://wso2.org/jira/browse/CEP-998

Is it normal for IBM Connections opensocial gadgets to make 2 HTTP requests on gadgets.io.makeRequest?

Within an IBM Connections sharebox/share dialog gadget my-sharebox.xml, I make the following request:
gadgets.io.makeRequest(url, function (response) { ... });
Using tcpflow on the IBM Connections server to capture the outgoing request & response, I see 2 HTTP requests.
The first one to the url specified above, and a second request to the gadget XML file, my-sharebox.xml.
Is this second request expected behaviour?
Is it possible to somehow suppress the second request?
In a production environment it should be caching the gadget XML and only fetch it once. That will usually happen when the gadget is rendered. Do you have all debug parameters related to opensocial disabled?

How to modify GET request size (IIS Express)

I have coded a web application that runs on IIS Express. I want to send large data set to server(over 4MB) and get response. (I have implemented this as a REST service).
When i tried ,i realize that I can only have 311bytes long URL.
So how can i change that?
as i know IE allows 2083 length URL as default. and there should be a way to configure IIS express via web.config or applicationhost.config right?
can anybody help me?
You need to use an http post verb to send the data, instead of trying to send it encoded in the URL as a GET. In straight HTML, this would involve having a form tag with a submit button. What framework are you coding this in? (asp.net, mvc, php, etc?)