I like to retrieve 2014-2015 tweets based on some search key for data mining.
I am using twitter4j(java) and calling API GET search/tweets.I am getting only last week tweets.Can anyone please suggest me the solution?
gnip
You got to pay for data older than about a week.
Via Gnip, you can order a one-time data pull (called a Historical PowerTrack One-Time Job). You provide the rule, and a data file will be sent back to you with download directions.
You can learn more about Historical PowerTrack here and here
Related
I am trying to impleement PokeAPI's data for a webapp, but I cannot seem to find all the data I need. When calling some data for, say, butterfree, I would call the data with (https://pokeapi.co/api/v2/pokemon/butterfree/). Under "stats" it has all 6 of butterfree's stats, however it only has the stats from the most recent generation. Is there a way to specify a specific generation somewhere in the API request URL that would show the stats for a generation before the most recent one?
It says on their website that not all information is guaranteed as completely up to date and accurate.
However, you can update this information yourself or file an issue to report missing/incorrect data in the pokedex GitHub repo.
I want to analyse my music consumption on Deezer.
Researching resulted in their rest api but the amount of entries in the user history seems to be limited (see https://stackoverflow.com/a/19497151/9909548 to navigate through all entries).
In my case, it resulted in only about 140 tracks which should be thousands.
From now on I could regularly store the results of that request but all data till now would be lost.
I'm aware that, by EU law, I could request all stored user data and parse that (in case I get it digitally) but I would not consider that a solution.
Is there a different api call to get the complete history or another api or some other way to get this?
There is no other way to access the entire history:
Deezer Support on 05.12.2020
Hello, Thanks for your email, apologies for the delay in getting back to you. XXX from Support here
https://www.deezer.com/app/stateeztics/
that is the best tool, but else sadly we do not have data analysis tools or data, besides recently played. Other option though: 2020 highlights (in Music)
Kind regards, XXX
The recommended app is stuck when opened and Deezer is slowly stopping their support for app extensions anyway.
I'm using the Core Reporting API (Reporting API V4).
Is there any way for me to determine the last time the data my query is returning was updated?
I'd like to be able to indicate whether the data being displayed was last updated several hours ago versus several minutes ago.
The API does respond with isDataGolden which tells you if the data will change again, if your website is small the data processing latency could be almost nothing.
From your question it sounds like you are more interested in not just if the data is stale but how stale. You could request the the ga:hour and ga:minute to find out when the last processed hit was recorded.
Note there is also the Realtime API which gives you a read of what is happening instantaneously.
I'm trying to download 1 minute historical stock prices from Yahoo Finance, both for the current day and the previous ones.
Yahoo (just like Google) supports up to 15 days worth of data, using the following API query:
http://chartapi.finance.yahoo.com/instrument/1.0/AAPL/chartdata;type=quote;range=1d/csv
The thing is that data keeps on changing even when the markets are closed! Try refreshing every minute or so and some minute bars change, even from the beginning of the session.
Another interesting thing is that all of these queries return slightly different data for the same bars:
http://chartapi.finance.yahoo.com/instrument/2.0/AAPL/chartdata;type=quote;range=1d/csv
Replace the bold number with 100000 and it will still work but return slightly different data.
Does anyone understand this?
Is there a modern YQL query that can fetch historical minute data instead of this API?
Thanks!
Historical minute data is not as easily accessible as we all would like. I have found that the most affordable way to gather Intraday Stock Price data is to develop automated scripts that log price information for whenever the markets are open.
Similar to the Yahoo data URL that you shared, Bloomberg maintains 1-Day Intraday Price information in JSON format like this : https://www.bloomberg.com/markets/api/bulk-time-series/price/AAPL%3AUS?timeFrame=1_DAY
The URL convention appears easy to input on your own once you have a list of Ticker Symbols and an understanding of the consistent syntax.
To arrive at that URL initially though, without having any idea for guessing / reverse-engineering it, I simply went here https://www.bloomberg.com/quote/AAPL:US and used Developer Tools on my browser and tracked a background GET request which led me to that URL. I wouldn't be surprised if you could employ similar methods on other Price Data-related websites.
You can also write scripts to track price data as fast as your internet goes. One python package that I find pretty handy and is ystockquote
You can have it request price data every couple of seconds and log that into a daily time series database.
Yes there is other APIs.
I don't know if it can still help but if you need intraday data, there is a API on rapidapi called (Quotient) which allows to pull intraday (at 1-min level), EOD market (FX, Crypto, Stocks (US, CANADIAN, UK, AUSTRALIA, EUROPE), ETFs and Futures. It also provides earnings, dividends, splits and a lot others informations.
I have been using Flurry.com to capture my analytical data for my iPhone app. I send them custom event information about what is going on in my application (registration/login/etc). I pass extra information with these events. Now I want to access this information and analyze it. How do I do that?
On their website I can see small 'pages' of information captured from my app. I can even 'export to CSV' a small 'page' of this data. But I do not see a way to export all of the data for a given period of time. Am I missing something?
I found api.flurry.com RESTful API today, but again it looks like I can only make two different calls that seem kind of useless (AppMetrics/AppInfo) and only return information for canned metrics. I really want to get at the custom events and custom event data that I sent to them. Is there a way to do this?
Thanks for any help.
There now appears to be EventMetrics API call, it allows you to request information about your Events.
I received the following response from Flurry:
I apologize for the inconvenience. We will eventually be expanding Flurry's API functionality to include events data. But until that occurs you should be able to access your event's data via Flurry's CSV files.
It looks like my data is stuck inside of Flurry.com right now. I think I better re-think my analytics strategy. I need my data out of Flurry.com and into my own data warehouse!
Update:
Flurry has now implemented its events data API. However, if you want to do custom analytics on the custom data that you send, you will probably be disappointed. The output of a call to the events data API is a summary, not your original logs.