Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

4
Getting thousands of files of output back from a container
Post Body

So I'm pretty new to the whole docker/ container thing and I'm updating an application to be able to run inside containers, this application produces quite literally hundreds of files (on average about 800) as output and this takes about 10 minutes to run, from one input file and I have thousands of input files, which is why I'm containerizing it, orchestrate tons of these containers to run it all in parallel. Which is where my problem arises, how do I actually get all these hundreds of files back into one place?

One solution I could think of is mounting a network share as a volume and writing to that, but I don't like the idea of tens of containers writing to one network share at the same time.

Again, I'm pretty new to docker, so I'm pretty sure there's a better solution, does anyone have any input?

Author
Account Strength
100%
Account Age
8 years
Verified Email
Yes
Verified Flair
No
Total Karma
73,466
Link Karma
5,159
Comment Karma
67,263
Profile updated: 14 hours ago
Posts updated: 7 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
1 year ago