which storage for large VM's?

[Welby]

Hi!

I have a cluster with three Proxmox VE Server and Ceph storage (SSD, 500TB total) configured as HCI, connected with 40GB Network adapters.

One question about large VM's: What will be the best way to store VM's with big data up to 20TB each? The VM's are used for Nextcloud, SVN, Git, docker repo, software mirror and so on.

- Should I use a qcow2 file?
- or CephFS on the cluster and mount it into the VM?
- or a external NAS/SAN storage and a NFS mountpoint on the VM?

Or is there another/better way?

Thanks!

 

[sg90]

If you want to use CEPH to storage the files you have the option of CEPHFS or RBD as you state.

Thing with RBD or any FS once you get big you get negatives such as long FS scans and many other things if you ever have an issue down the road, the benefit of cephfs is all that stuff is running in the background continously and should not result in any delayed booting or data being unaccessible e.t.c

 

[hec]

I work with NetApp Clusters and NFS. Simple growing und shrinking. If you use dedup, compression and compaction you can save a lot of space.