[SOLVED] Ceph only on some selected nodes in cluster?

zaphyre

Active Member
Oct 6, 2020
55
5
28
36
Hi, I am currently planning a small Proxmox cluster. It is planned to have all system requirements met for a Ceph Installation (here: 4* NVMe via HBA per node + disks for the OS) on three nodes. We want these three nodes to participate in the Ceph setup but to use a total of five nodes in the cluster.

Is this possible, or do all nodes need to run Ceph then?
Can the two PVE nodes which are member of the cluster but have no Ceph use the ceph based storage?

Thanks a lot!
 
You can do that. I hope you do have a fast network for Ceph (10Gbit or faster) available on all nodes.

The non Ceph nodes can still use Ceph as storage. For those nodes you could still configure the same Ceph Repository (/etc/apt/sources.list.d/ceph.list) to get the RBD (rados block device) client from the more current Proxmox VE Ceph repository and not the Debian one which tends to provide a bit an older version.
 
  • Like
Reactions: zaphyre
You can do that. I hope you do have a fast network for Ceph (10Gbit or faster) available on all nodes.

The non Ceph nodes can still use Ceph as storage. For those nodes you could still configure the same Ceph Repository (/etc/apt/sources.list.d/ceph.list) to get the RBD (rados block device) client from the more current Proxmox VE Ceph repository and not the Debian one which tends to provide a bit an older version.
Thanks for your fast answer Aaron! This helps a lot!
Ceph-Network will be @ dual 10GbE or 25/40GbE