Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

35
Pushshift is now ingesting all tweets from all verified Twitter Accounts (~323k accounts)
Post Body

I found a method to track and ingest all tweets made by all verified Twitter accounts (including original tweets, retweets and quoted tweets). I need to check the Twitter TOS to see exactly what data I can make available for academic use (they usually have more relaxed terms for academic use).

The data is being fed into elasticsearch (version 7.x) in near real-time (generally a 0-20 second delay -- mainly dependent on how quickly Twitter makes the tweets available via their API).

The goal for this project is to track all politicians and news sources for disinformation research. If there is any interest in this data, please let me know. This method gets all tweets, retweets and quoted tweets from all verified accounts (I have done some preliminary testing and there doesn't appear to be any missing data from the accounts I've tested -- including extremely active ones). This also includes the data for tweets that are retweeted or quoted by a verified account.

All tweets ingested have their meta-data refreshed (retweet_count, favorite_count, etc.) at 1 hour, 4 hour and 24 hour periods. The total tweets ingested averages around 50k-100k tweets an hour. Newly verified accounts from Twitter are automatically added instantly (no missed tweets from newly verified accounts).

Author
Account Strength
100%
Account Age
11 years
Verified Email
No
Verified Flair
No
Total Karma
143,730
Link Karma
34,810
Comment Karma
108,242
Profile updated: 2 days ago
Posts updated: 6 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
5 years ago