This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
The latency has been increasing over time for calls so in order to try and reduce pressure on the back-end, I am dropping the limit to 120 requests per minute until I'm able to get the additional hardware in place to increase capacity.
This shouldn't affect many users and may actually improve response times for everyone.
There are a few calls hitting the DB that are taking much longer to complete than expected -- I'll be looking at that over the next week and determining the best way to decrease latency there. Most likely just upgrading the primary DB to an NVMe backed array or even Optane drives would significantly reduce latency to below 100ms. I'll also probably get a 256 GB server to act as a huge Redis cache for frequently accessed data and to cache the previous month worth of comments and submissions entirely in RAM which would speed up some calls tremendously.
My thinking here is that any call that can be served directly from cache wouldn't count against any rate-limits.
Subreddit
Post Details
- Posted
- 5 years ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/pushshift/c...