Which file system for 100 + 140 TB Veeam servers and repositories?

[etfz]

Hi,

I'm installing Proxmox on a new host, to be used for backups, primarily. It has two RAID devices of 100 and 140 TB, respectively.

Normally, I would just create LVM thin pools, because that seems to be the goto, and also supports snapshots, which I think it required for backing up using Veeam, but it is apparently limited to 127 TB. I'm going to have a few backup VMs, which themselves need to be backed up, and a few repository VMs, which will have dedicated virtual disks for the data, which does not need backing up, and possibly not the VM either. The backup data disks will use XFS, in case that matters.

What are my options here? I thought I might create a smaller storage for the backup VMs, and something else for the storage VMs, or at least the virtual disks. I found that ZFS is an option if I want a single storage for both raid devices, but that it can be a bad idea, depending on the guest file system.

 

[fba]

Hi,

you could create the thinpool (on cli) with a larger chunksize like 1M, which would allow storage of more than 250TiB. As the limit originates from chunk size 512KiB and the max size of the metadata pool (~15.88GiB). Increasing the chunk size requires less metadata to be stored there.
There are some drawbacks of course regarding zeroing, write amplification, space waste, overhead...

 

[etfz]

Thanks. I had read that 512 kB is the maximum chunk size for snapshots, and perhaps thought it to be the maximum chunk size in general. If LVM thin is still the best option I might just do that then.

 

[fba]

You mentioned RAID devices so ZFS is not an option, it needs direct disk access instead.