Ceph OSD will not delete

paradox55

Member
May 31, 2019
92
4
13
33
It refused to delete itself in the OSD list on proxmox. It's still "loaded" on the host node even after reboot.

I've also wiped/zapped the entire disk with gdisk and restarted.

Can't remove the OSD from /var/lib/ceph/osd because it's active.

...this is not the first time I've had this issue with Proxmox 6.

Ideas? I've already tried removing it from the tree/crush mapping via commands.

Code:
root@sb-01:~# ceph osd destroy osd.4 --yes-i-really-mean-it
Error EBUSY: osd.4 is not `down`.

root@sb-01:~# sudo systemctl status ceph-osd@4
● ceph-osd@4.service - Ceph object storage daemon osd.4
   Loaded: loaded (/lib/systemd/system/ceph-osd@.service; disabled; vendor preset: enabled)
  Drop-In: /usr/lib/systemd/system/ceph-osd@.service.d
           └─ceph-after-pve-cluster.conf
   Active: inactive (dead)

   root@sb-01:~# ceph osd tree
ID CLASS WEIGHT TYPE NAME      STATUS REWEIGHT PRI-AFF
-1            0 root default                         
HOSTS BLAH HERE               
-3            0     host sb-01                       
4            0 osd.4              up        0 1.00000
 
PVE7.0-1
I have the same issue with the last osd. Stop doesn't work from GUI.
I could remove all osd from GUI but the last one didn't want to.
I tried after the commands and it was removed but in GUI won't disappear from the list and not able to select the disk when creating an osd.
Ceph complains about the osd existing in the crush map.
~# ceph osd crush remove osd.0 will fix it.
 
Same problem here on latest Proxmox
hilarious that how many years later, this is still a huge bug
 
Additional CLI Commands to remove Ceph to those provided above.

# List the Cephs
lsblk

# List the Ceph individually
lsblk |grep ceph | cut -b 7- | cut -d " " -f1

# Option - Remove single Ceph (copy & paste the ceph from lsblk)
dmsetup remove ceph-foobar.....

# Option - Full automatical removal of Ceph
lsblk |grep ceph | cut -b 7- | cut -d " " -f1 | awk -F: '{print $0}' | xargs dmsetup remove
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!