Existing 3-node CEPH/HA cluster. Want to add two more nodes that only CEPH/HA with each other.

Arkive

Member
Dec 26, 2023
11
0
6
I have three low-end nodes in a CEPH/HA cluster with failover groups configured. I recently bought a high-performance node running standalone Proxmox and am thinking of buying another. If I add those two high-performance nodes to my cluster I maintain quorum, but the question is can I configure CEPH and HA *just* between those two nodes so their workloads could failover to each other if either one goes down?
 
your question is ambiguous.

If you want to ADD nodes to the cluster, it wouldnt be JUST between the two nodes by definition. if you want to create a new cluster, all contraindications for two nodes apply.
 
Ceph: no, requires 3 servers for 3 replicas. If you had 3 new servers you could add their disks as OSD with a different device class, create a crush rule with that device class and create a pool that uses just disks of that device class. Still, Ceph quorum will require mayority from all monitors, think about it.

HA: yes, create HA group with those 2 servers and add VM/CT to such group.