Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

0
Looking database designs/advice for handling massive amount of image data...
Post Body

Hello, I have been tasked with outlining some ideas for a database to store scientific image data. I am looking for suggestions for a server architexture database that will allow for scaling, high avaialbility and preformance. from what i read, it seems to be best practice to store urls or filepaths metadata in a db that point to the image. I was looking at using MongoDB, Postgresql or something similiar.

I am looking for suggestions, best practices, expirence etc.:

To summerize:

  1. What are some recommended databases that preform well and are scable?

  2. What is the best way to handle TB datasets of image data.

  3. What is the best filetype to use (HDF5 vs TIFF vs something else?) in this scenario?

  4. Are there any HW recommendations?

  5. Lastly, ZFS? ext4/5? what type of filesystem is best for this?

Thanks.

Author
User Disabled
Account Strength
0%
Disabled 8 months ago
Account Age
11 years
Verified Email
Yes
Verified Flair
No
Total Karma
229
Link Karma
95
Comment Karma
134
Profile updated: 1 day ago
Posts updated: 10 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
10 years ago