CEPH or Cluster first

[apap]

I am trialing 3 nodes PVE with cluster and CEPH. Should I setup the cluster first or CEPH first.

 

[Moayad]

Hi,

First you have to setup the cluster.

 

[apap]

Thank you. If I have a 3 node ceph/pve, do you recommend every node to be a monitor?

 

[Moayad]

3 monitors are enough if your cluster is small to medium [0].

[0] https://pve.proxmox.com/pve-docs/chapter-pveceph.html#pve_ceph_monitors

 

[jdancer]

For a 3-node cluster setup, I recommend a full-mesh broadcast setup https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server#Broadcast_Setup


Works quite well on 12-year old servers using 1GbE.