Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

10
Implementing webhooks -- Any interest for bot developers in this new Pushshift feature?
Post Body

I was thinking about implementing a new service using webhooks for bot developers or other users who could utilize push delivery for data. This new utility would incorporate a number of features. Basically, you could choose what data you would want pushed to a webhook URL of your choosing. Some of the features I was thinking about implementing include:

  • Ability to choose what data is pushed in real-time including the ability to match exact substrings. As an example, the "remindme!" bot might not care about letter case but the exclamation point may be important. So any comments with remindme in any case proceeded by "!" could be set as a trigger.

  • Ability to set multiconditional triggers like a certain phrase along with a specific subreddit or author.

  • Ability to set time ranges for triggers so that you can choose when triggers are active.

  • Real-time triggers or batched data so that data is sent only once every X minutes or having data sent immediately when a trigger is activated.

  • Smart triggers that also take into context the source of a post. For instance, if someone makes a post that links to a news article, a trigger can be created if something within that article matches (external source triggers).

  • Triggers that match certain conditions outside of the normal Reddit data returned. For instance, you could create a trigger that sends comments that were made as a reply to another comment under X seconds. Or match comments that are X levels deep in a comment tree.

  • Metadata triggers: Get an alert when a subreddit goes dark or is banned. Get a comment that matches NLP triggers as well. For instance, you can set up an NLP trigger for the Baltimore Ravens and if a comment mentioned the Ravens quarterback, it would trigger.

  • Current event triggers: A mass shooting occurs and there is suddenly a large percentage of posts and comments mentioning the current-event which sets off a trigger. Using statistical analysis, the trigger could be fine-tuned to give an alert quickly while also reducing false positives.

  • Submission locked triggers:. Get notifications when submissions are locked. If the submission was active, the notification would be quick (within a minute or two of the submission being locked)

  • Locational Triggers: You set a Locational trigger for Washington D.C. with a 50 mile radius and a comment mentioning Silver Spring Maryland would trigger it.

  • Abusive and Harrassing User Trigger:. Get an alert when a user is abusive or harrasses another user. Detection of hate speech, etc.

  • Category triggers:. You set a trigger for AMD and a comment mentioning Ryzen would trigger it.

  • Filters on top of triggers:. You could set a filter so that only users with a comment Karma score in the upper 25th percentile range would trigger for a specific comment.

  • Participation Filters:. You can filter users who have high participation in certain subreddits from triggering previous filters. For example, you could choose to ignore comments from a user where more than 20% of their comment activity is within a specific subreddit.

To set up the webhook, you would need to prove you own the domain (to prevent spam, etc.). You could set up a bot and use this service without having to poll Reddit's API constantly.

I was thinking about this idea for awhile but wanted to gauge interest first and to get feedback from the developer community.

Author
Account Strength
100%
Account Age
11 years
Verified Email
No
Verified Flair
No
Total Karma
143,730
Link Karma
34,810
Comment Karma
108,242
Profile updated: 3 days ago
Posts updated: 6 months ago
Pushshift.io data scientist

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
7 years ago