I can't remove the ceph monitor

rmbenitez

New Member
Aug 1, 2022
2
0
1
I have a cluster+CEPH+HA with 3 PC, one of them crash, and i replace it, the new PC have the same name and the same IP, i install CEPH into the new PC and i can made the OSD device, but into the monitor list, i have 3 monitors, one of then show me "Host unknow" and don't let me to remove, i try with the GUI tools and i try with the pveceph destroymon command, but the monitor whith blank Host name, don't desapear.
When i try to add the new monitor, the PC have the same name and give me this error, the monitor Exists.
I am into the loop, i can't remove the old monitor, because don't have a host name into the list, and, i can't add the new monitor because indicate me that this monitor exist.

the ceph.conf file
-----------------------------------------------------------------------------
[global]
auth_client_required = cephx
auth_cluster_required = cephx
auth_service_required = cephx
cluster_network = 10.10.10.236/24
fsid = f6199d61-308c-4aa4-a5d7-d8e43ae88b67
mon_allow_pool_delete = true
mon_host = 192.168.0.236 192.168.0.235
ms_bind_ipv4 = true
ms_bind_ipv6 = false
osd_pool_default_min_size = 2
osd_pool_default_size = 3
public_network = 192.168.0.236/24

[client]
keyring = /etc/pve/priv/$cluster.$name.keyring

[mon.pvirtual1]
public_addr = 192.168.0.236

[mon.pvirtual235]
public_addr = 192.168.0.235
------------------------------------------------------------------------------

The new PC --> pvirtual238 and 192.168.0.238
when i try to add the new monitor
Give me the follow error.
command 'monmaptool --clobber --addv pvirtual238 '[v2:192.168.0.238:3300,v1:192.168.0.238:6789]' --print /tmp/monmap' failed: exit code 1

I have a monitor --> mon.pvirtual238 --> with blank host name "unknow" --> 192.168.0.238:6789/0 and with Cuorum status "NO"
try to remove this monitor
Give me the follow error.
Method 'DELETE /' not implemented (501)

When i try to join the pvirtual238 PC, i have problem because the old PC configuration was into the nodes configuration, i delete the /etc/pve/nodes/pvirtual238 folder, in this way i can to join the new pvirtual238 and i can to install CEPH and i can to add the OSD devices from pvirtual238 (2 ssd 2 TB), but the only thing that i can't do is add the pvirtual238 monitor.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!