Dedicated Ceph Setup for Multiple PVE Clusters

[tjk]

New to Ceph on PVE, have a couple of questions.

Is it possible to setup one large Ceph cluster that is dedicated to just running Ceph, but using PVE to set it up and manage it?

If so, can I then present this ceph cluster to multiple clusters of PVE?

End goal here is one large ceph cluster running as primary storage for different private cloud PVE deployments.

 

[tjk]

Anyone have any feedback on this?

 

[RokaKen]

Yes, while not directly supported, you may have one PVE cluster dedicated to managing your Ceph storage and then create RBD pools which can be mounted as external storage to other PVE compute clusters as described here [0]. You will have to manually deconflict the pools because the other PVE clusters will not be aware of each other. There may be some security concerns if the other PVE compute clusters are not under you administrative control becuase the cephx keys will be exposed.

[0] https://pve.proxmox.com/wiki/Storage:_RBD

 

[bbgeek17]

Since you are effectively disaggregating Ceph from PVE and dedicating hardware resources, an alternative option would be Blockbridge - both the control and data paths are natively Multi-cloud/Multi-tenant.

---

Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox