[SOLVED] Proxmox Ceph Monitor

Apr 29, 2022
24
2
8
Hey all,

I am getting this error while adding the third monitor into the ceph.
I saw I have mistakely given a wrong IP-Adress to the ceph network (monitor) and changed it.
All three nodes are in cluster and I cannot ping the third node with the Monitoring network.
I reinstalled the ceph on the third node but it didn't help.


1660226290817.png

Code:
[global]
         auth_client_required = cephx
         auth_cluster_required = cephx
         auth_service_required = cephx
         cluster_network = 192.168.22.241/24
         fsid = 02324643-d167-4a01-81bf-9abe60524e3b
         mon_allow_pool_delete = true
         mon_host = 192.168.21.241 192.168.21.242 192.168.21.243
         ms_bind_ipv4 = true
         ms_bind_ipv6 = false
         osd_pool_default_min_size = 2
         osd_pool_default_size = 2
         public_network = 192.168.21.241/24

[client]
         keyring = /etc/pve/priv/$cluster.$name.keyring

[mon.pvecloud01]
         public_addr = 192.168.21.241

[mon.pvecloud02]
         public_addr = 192.168.21.242

[mon.pvecloud03]
         public_addr = 192.168.21.243
 
Could you solve it? If yes, please share how. Otherwise, please remove the [solved] tag from the title.
 
I had to reinstall Ceph 2 more times in order him to function again.
The second time I had the same problem with node2
But it's working fine now.

Code:
#Done on all the nodes
#Remove ceph configuration file by executing the following command from terminal

rm /etc/ceph/ceph.conf

#Stop the monitor service
systemctl stop ceph-mon@pvenode01

#Disable the monitor service
systemctl disable ceph-mon@pvenode01

#Removes the ceph .conf files
rm -r /etc/pve/ceph.conf
rm -r /etc/ceph
rm -rf /var/lib/ceph

#Removes Ceph installtion
pveceph purge

apt purge ceph-mon ceph-osd ceph-mgr ceph-mds

apt purge ceph-base ceph-mgr-modules-core

Source: https://dannyda.com/2021/04/10/how-...ph-and-its-configuration-from-proxmox-ve-pve/
 
Last edited:
  • Like
Reactions: Matthias.