Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

19
Pushshift request limit dropped to 120 request per minute (2 per second)
Post Body

The latency has been increasing over time for calls so in order to try and reduce pressure on the back-end, I am dropping the limit to 120 requests per minute until I'm able to get the additional hardware in place to increase capacity.

This shouldn't affect many users and may actually improve response times for everyone.

There are a few calls hitting the DB that are taking much longer to complete than expected -- I'll be looking at that over the next week and determining the best way to decrease latency there. Most likely just upgrading the primary DB to an NVMe backed array or even Optane drives would significantly reduce latency to below 100ms. I'll also probably get a 256 GB server to act as a huge Redis cache for frequently accessed data and to cache the previous month worth of comments and submissions entirely in RAM which would speed up some calls tremendously.

My thinking here is that any call that can be served directly from cache wouldn't count against any rate-limits.

Author
Account Strength
100%
Account Age
11 years
Verified Email
No
Verified Flair
No
Total Karma
143,730
Link Karma
34,810
Comment Karma
108,242
Profile updated: 2 days ago
Posts updated: 6 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
5 years ago