Multiple PVE clusters sharing a Ceph cluster

alyarb

Well-Known Member
Feb 11, 2020
140
25
48
37
Due to Corosync there is clearly a finite and rather small number of nodes that a single Proxmox cluster can support, yet Ceph clusters have no such size limit.

The only thing preventing multiple Proxmox clusters going hog-wild on a shared Ceph cluster is the certainty of overlap and collision of machine IDs and by extension the RBD disk names.

Each cluster will unknowingly create a machine using the next available ID and create RBD disks following the innocent convention vm-$id-disk-$k and so on. Even with external non-HCI storage support, a Proxmox cluster handling multiple Ceph clusters faces the challenge of ensured uniqueness.

What I'm looking for is a way to either pre-define a range of permitted VM IDs at the cluster level to ensure against overlap with multiple clusters, and an even better solution to offer in addition to this would also be to offer specifying a cluster-specific prefix on virtual disk names.

So if we have 2 clusters, pve01.domain.tld and pve02.domain.tld, all of the virtual disks in each cluster could be prefixed pve01- or pve02- or whatever the admin wants. I would be great if the virtual disk names were defined in a text file somewhere but I doubt it. Looking for some guidance.
 
Wow I can't believe I missed that, I went through all the datacenter tabs. A cluster prefix would be nice too, and cleaner looking, but this certainly gets the job done.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!