Ceph monitors MUST run on the public network

paradox55

Member
May 31, 2019
92
4
13
34
I can't configure the monitors to use the private network. Ceph is configured private on both pub/private in the ceph.conf. But if the monitors aren't on the public network (10.0.0.0/12) ceph no longer responds.

Ceph traffic does flow over the private network (172.16.2.0/12) so not sure why the monitors need to be on 10.0.0.0/12...
 
Cephs public and private networks are explained in chapter 4.2.2: https://pve.proxmox.com/pve-docs/pve-admin-guide.html#chapter_pveceph
The official Ceph network documentation has a nice diagram which shows which service uses which type of network: https://docs.ceph.com/docs/nautilus/rados/configuration/network-config-ref

The Ceph cluster network is optional and used to move the replication traffic between OSDs to another network.

Yeah, it actually worked itself out once I added a third IP block.