How do I Exclude RSS feeds from Fiddler? - fiddler

I'm completely new to Fiddler (installed in yesterday) and in my Web Sessions section all of my RSS feeds in my bookmarks are being captured. Is there a way to stop Fiddler from doing that so I can just watch the request made for what I'm currently working on?

You can do that using regular expressions for the filters. In the 'Filters' tab you have to choose 'Show only if the URL contains'.
If you put a regex string in there that allows everything except RSS feeds those will be filtered:
REGEX:(?insx).*[^(rss2|rss|rdf)]$
You can add of course more filetypes to the list, if required.

Related

Link query strings get cut off

I'm not aware of link designing strategies, so I am not sure why my link gets chopped off when someone clicks on from sources like Facebook etc.
I have a 'share feature' on my platform, which lets a user create a link to their listing and share it with people.
The link I generate for the listing in my backend has parameters, which reads the listing id and the type and displays content over HTML
Here's a sample link for a listing
https://www.fayvors.com/Share.html?hash=5eccccaa-7b8d-42bd-af8c-08d50da0c867?type=lessons/
However, when I share the link on facebook and click it, the browser redirects to a link that's cut off
https://www.fayvors.com/Share.html?hash=5eccccaa-7b8d-42bd-af8c-08d50da0c867%3Ftype%3Dlessons
I'm not aware of link designing principles, so I'm a bit lost here!
Thanks!
Your URL contains “special characters” (like a second question mark inside the query string), but you neglected to apply proper URL encoding when putting this URL as a parameter value into another URL:
javascript:window.location.replace('https://www.facebook.com/sharer/sharer.php?u='+window.location)
Use encodeURIComponent on the value you are concatenating to the sharer URL here.

How to set starting options in facebook messenger for pages?

Is it possible to set starting options in facebook messenger for pages like example bellow:
example of expected result
I figured that similar could be achieved by using messenger BOT with 'start button', multiple BOT replies with 'quick reply' buttons and passing conversation to live chat in required cases.
The problem with this is that after user clicks 'get started' button BOT publish text replay 'Get started' which is not desired.
I wonder if there is an build-in setting to achieve this? If not, how would one solve it?
EDIT: It seems to me, it is not possible to build something like that neither with facebook quick reply neither with templates/buttons
EDIT 2: I also tried doing this in Facebook's page settings with no result. It seems it doesn't have anything to do with Facebook's 'quick replies'
First of all there is no way to set those options from facebook platform itself. Those questions are generated by facebook to give user a head start to a conversation and those are generated based on the type of page you are created. To see the option go to
Your Page's Settings-> Messaging -> General Settings
It is ideal that you will configure the 'Get Started' to initiate conversation with your bot and then show users a bunch of options using various templates like quick replies, carousel, list etc. By this way you have full control over your templates and expected answers.
But then again if you want to use those generated options from facebook then you can look for those option's text in the delivered json to your configured web hook. Here is a sample json:
{"object":"page","entry":[{"id":"","time":1519980744192,"messaging":[{"sender":{"id":""},"recipient":{"id":""},"timestamp":1519980743903,"message":{"mid":"","seq":1,"text":"Could you give me a call? I'd like to speak to someone."}}]}]}
Look at the 'text' attribute. The text is from after clicking one of those options. But again this is not ideal as the options can get changed anytime by facebook's algorithm.
My suggestion is to use 'Get Started' button and then send a list to the user.
The screenshot you posted shows a features that is currently being tested for Pages, so it is not available to every Page. There is no built-in way to do this, other than sending quick replies in response to the get started postback, messaging_optins or messaging_referrals events.
You can create a persistent menu to achieve this.
Here are few video tutorials I created to help you with Facebook integration and sending rich messages in facebook messenger through Dialogflow.
https://www.youtube.com/watch?v=fJ4HoYxoKl8
https://www.youtube.com/watch?v=JC9Y-AmcL6A

urlread pound sign (#) doesn't work

Trying to read in the pricing lists under pricing information tab:
urlread( ' http://www.cefconnect.com/Details/Summary.aspx?Ticker=KYE#pricing ' )
But in url '#pricing' doesn't help.
Any suggestions?
As already pointed out by Darin, it's no use adding #pricing to the URL. The web page uses client-side techniques to switch between tabs; not something that can be used by urlread.
Summary.aspx always returns all tabs together as one big page. CSS and JavaScript make it look like a collection of tabs, when opened in a web browser.
Use the developer toolbar of your web browser to inspect the web page. For example in Google Chrome, just right-click on the section you are interested in, and select 'inspect element'.
I don't know what you are going to do with the result of urlread, but you'll probably have to do some parsing to distill the information you need from the HTML clutter.
Please note Summary.aspx launches additional HTTP requests to retrieve additional data. Use the 'Network' tab of Chrome's developer toolbar to analyze that behavior. For example, the following request is made when you click 'GO' after adjusting the pricing history filter criteria.
http://www.cefconnect.com/Resources/TableData/?Type=PricingHistory&Cusip=48660P104&param0=1M&param1=06/06/2014
At first, this seems to complicate the whole matter, but it may actually be a great opportunity. You can call urlread with the URL above, and get some data in JSON format, which is far less cluttered than HTML. Adjust the parameters to get different data. I'm not sure what 48660P104 is; it might be an internal representation of KYE. You may want to use an initial HTTP request to Summary.aspx to retrieve that code; you'll notice the webpage is littered with URLs containing the same parameter Cusip.
The # character has a special meaning in an url. It represents the fragment identifier and the value following it is never sent to the server. Only client side javascript can access it. You will need to url encode the value if you want to send it to the server:
urlread( ' http://www.cefconnect.com/Details/Summary.aspx?Ticker=KYE%23pricing ' )
This also stands true for other special characters. You need to properly encode them.

Events triggering loading content on Facebook's timeline

I am working on Apache Nutch modification project. We already swapped Nutch's original module with ours built using HtmlUnit. I need to download whole Facebook user site (ex. http://www.facebook.com/profile.php?id=100002517096832), which is going to be parsed using our own parser. Unfortunately Facebook is using mechanism called BigPipe (http://www.facebook.com/note.php?note_id=389414033919). That's why most of current website is hidden in <.!-- --> tags.
Usually when we scroll down Facebook page, new content is being unpacked every time we are about to hit bottom of the page. I have tried to use Javascript that scroll my htmlPage (HtmlPage object from HtmlUnit project), but finally I realized that scrolling is not triggering loading new content on Facebook user site.
How can I check, what event on page triggers loading content on current Facebook page? Maybe I should approach problem from different side, for example try to extract BigPipe "things" on my own? Have you ever did that?
Before dealing to your question … what kind of project are you trying to build there?
Since Apache Nutch is an open source web-search software, I think you are trying to build some kind of search engine, that scrapes Facebook user profiles/feeds to get data and make it searchable on some third-party website?
Well, that would be a violoation of Facebook Platform Policies:
I. Features and Functionality
12. You must not include data obtained from us in any search engine or directory without our written permission.
So, do you have that written permission?

I want to get content of timesofindia website for my native app

I want to develop a native iPhone/iPad app for TimesOfIndia.
I want to get that news content and images.
How do I get that content ?
I don't know if this answers your question.. but it seems like TOI already has an iPhone application..
Check this website: http://timesofindia.indiatimes.com/mobileapplist/7404562.cms
If you want to get the news from any website, here are some steps you can use (and I am no expert):
Try to use a tool like wget to download a url to a file and then parse the html, like so: wget -O hindu.html www.thehindu.com (wget is available on linux machines). Parse the html or xml in that file and display the headlines and news on your app. Note that this downloading and parsing is best done on a server which could then be pushed (as data) onto the phones of your users.
RSS feed. Get an RSS style feed for the website whose content you want. You can then parse the RSS feed and push that onto the users device.
Try to build an aggregator (like news.google.com) or use an existing one. That way, you can have stories from multiple sources.