Suggestion for historical database

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

Post Body

We have a system now using net8 and EF core toward Postgres. Every minute it’s about 40000 (40k) measurements going in in 200 bulks in one query. As this is a lot of data when I need to join it’s hitting hard in performance wise with million new rows in a short .

I have been thinking to use influx for long term and Postgres for short with this method

At insert, write to both, daily delete with cask from Postgres everything older than 24h

Anyone that can suggest a better method? Also a suggestion how to seemless extract data when it might span over two databases. Sadly I think ef doesn’t support influx

Author

Account Strength

90%

Account Age

9 years

Verified Email

Yes

Verified Flair

Total Karma

1,261

Link Karma

561

Comment Karma

700

Profile updated: 7 months ago

Posts updated: 3 hours ago

alekslyse

Subreddit

r/dotnet

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.

Posted: 1 month ago
Reddit URL: View post on reddit.com
External URL: reddit.com/r/dotnet/comm...