I've been working on a bot for the last few weeks. It's not live for public consumption yet but working awesome.

I've been logging it's performance metrics and displaying them in a Grafana dashboard.

Figured some might find this interesting.

https://i.imgur.com/ncQ7H0f.png

​

Here's the compute getting thrown at it.

https://i.imgur.com/Oes1oBc.png

Load is being split between a VM with 10 cores / 32gb RAM and a physical server with 12 cores / 24gb RAM.

​

MySQL performance

https://i.imgur.com/DWHqxjE.png

​

About the bot

The idea is similar to RepostStatistics on Imgur. Except I'm shooting for realtime checking over all submission types with some extra features. It has the ability to work as watchdog for OC. Users can request a certain post be watched and get notified if it is posted by someone else.

Image and link post check are done. Video is in the works.

I currently have about 2.5 million images indexed and can return all matches for a given image in ~1 second.

It's written in Python and heavily uses Celery with a Redis broker.