This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
The Verizon guy was able to patch the fiber break and the APIs are coming back up. It will take a little bit of time for previous missed comments and submissions to get ingested. What we are going to do is focus on continuing the transition into the COLO and start populating all of the data into the new servers that were purchased (big ass Dell servers with 100 TB Nvme and 6 terabytes of RAM).
If your script only cares about recent posts and comments, you should be able to use the API now. Please let me know if you notice any issues but keep in mind that we'll probably have sporadic issues until the move into the COLO is complete. We are targeting today to get a majority of the data loaded into the COLO servers.
Unfortunately a fiber cut is a worse case scenario, but we are moving all of Pushshift into a COLO with redundant 10gb internet lines and 100gb switches for our internal network. Once the API is moved into the COLO, we should see much improved performance.
We will continue to bring up services today and I'll continue to update the community.
Thank you for your patience!
- Jason
Ps: Thank you Mr. Verizon guy!
Subreddit
Post Details
- Posted
- 2 years ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/pushshift/c...