I have an ever growing amount of data. However in the last ten years i failed integrating a proper recovery plan.

So currently i am Running with 818TB x2 exos in truenas (core) with Raid6 which is now again at its Limits. From the old setup i have still 1210tb lying around. Further for fast data I already have a all NVME Ceph Cluster with roughly 40tb spread across 6 nodes.

Now i want to increase the number of 18tb disks as the 10tbs used a lot of space. However i am a Bit concerned about the recovery time if one or two fail. Further i am scared of some App which might destroy all data. So i want to be able to Revolver from Even that. Off Site was the First idea but since i only have a 1gb/50mb Internet Connection will make the initial backup take forever and Even restores might be problematic. So I want to use the local high Speed connections for that to another local node.

Now RAID Feels old and adding disks or adding bigger disks during time is Not really possible. Also i do NOT Like truenas core. Having Clients for all Kind of devices would be awesome and having Max Speed too.

Now i read about SeeweadFS, MooseFS or als TruenasScale or something Like omv.

There of course is unraid where i just dont Like the closed Source nature when trusting this with my data.

However What do you use for file / Storage System and how do you backup? Would you build an all connected distributed huge Pool with everything availabel or more complete systems for backup and prod.? How would you spread the disks? How Safe is raid6 with e.g. 14*18tb in one vdev? What Tools/Ressources do you know and Can recommend?

Also What about Tapes (LTO)? Im a Bit scared of this.