This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
I've rewritten the monthly ingest script to better handle large batches of spam that hit Reddit occasionally. The new script is running and starting with June data and should move faster than the old script.
It will take a couple of weeks to get all of June and probably around a month to get both June and July. The monthly comment dumps should get caught up completely in the next 6-8 weeks and then resume the normal schedule (the previous month's comments will be made available generally on the second week of the new month).
Right now it's up to June 3'rd and running as quickly as possible. Eventually I will need to add another ingest account to speed up the process, but I hope to have June available in approximately two weeks and then July two weeks after that (give or take a few days).
Monthly submission dumps are currently caught up and September submissions should be available approximately a week into October.
Thanks!
Subreddit
Post Details
- Posted
- 5 years ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/pushshift/c...