This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
The new script is now able to catch up much faster than the previous script. It is currently processing the rest of May 12 and should catch up within a couple days at most (probably in 2 days). While the old script was limited to making serialized requests, the new script can handle making parallel requests to speed up the ingest.
This new enhancement will help the script keep up with the amount of comments being made on Reddit (including all that delicious spam that has been increasing).
There is one last bit that needs to be fixed -- handling updates to gildings and custom awards. Reddit changed how gildings are represented in comment objects (surprisingly, submission objects still have the old structure). The plan is to get that fixed later this week.
Thanks!
Subreddit
Post Details
- Posted
- 5 years ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/pushshift/c...