Choosing Performance Cluster FS with Horizontal Scaling

[tane]

Hi Guys,

We are interesting in creating large scale installation of proxmox. The system is on the same location so the nodes and cluster filesystem bond with 10G networks switches, we are think using 100G.

Basic idea:

• Create 3+ node proxmox cluster 10G link to shared storage FS
• Create 3+ file system cluster (Ceph , HA-LVM -DRBD, MooseFS, DRBD- OCFS2 )

The question which opensource Shared Cluster Storage works fastest with proxmox, we would have lot of VM running large PGSQL DB writes/reads.

So the question is what Shared Storage system to use to get best performance.

Thank you for you recommendation.

 

[manu]

well it is not only a question of performance
what about throughput vs data consistency for instance ?

however for distributed storage we recommend Ceph, this is the storage you will the more support from us and the Proxmox community

 

[aderumier]

I don't recommend a cluster file system, for hosting vm images. (too much overhead, lock contention,...)

Use ceph rbd block device (not cephfs) , best storage ever !

(running 100TB ssd cluster , never had failure or hang since 3 years now)