[SOLVED] [Ceph] Unknown OSDs out/down - Safe to remove ?

[McFouch]

Hi,

I got the admin on a ceph cluster in which out/down OSDs are listed in the GUI but do not correspond to any device :
Cluster is healthy and my "known" OSD are in/up.

#ceph osd status
+----+------+-------+-------+--------+---------+--------+---------+------------+
| id | host |  used | avail | wr ops | wr data | rd ops | rd data |   state    |
+----+------+-------+-------+--------+---------+--------+---------+------------+
| 0  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 1  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 2  | pve2 |  189G |  257G |    1   |  8192   |    0   |     0   | exists,up  |
| 3  | pve2 |  201G |  245G |    5   |  23.2k  |    0   |     0   | exists,up  |
| 4  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 5  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 6  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 7  |      |    0  |    0  |    0   |     0   |    0   |     0   | exists,new |
| 8  | pve3 |  209G |  237G |    0   |  3276   |    0   |     0   | exists,up  |
| 9  | pve3 |  182G |  264G |    0   |  1638   |    0   |     0   | exists,up  |
| 10 | pve1 |  197G |  249G |    5   |  24.0k  |    0   |     0   | exists,up  |
| 11 | pve1 |  194G |  252G |    2   |  13.6k  |    0   |     0   | exists,up  |
+----+------+-------+-------+--------+---------+--------+---------+------------+

# ceph device ls
DEVICE                                  HOSTEV DAEMONS LIFE EXPECTANCY
INTEL_SSDSC2BB480G6_PHWA634503EL480FGN  pve3:sdb osd.9                
INTEL_SSDSC2BB480G6_PHWA634506SF480FGN  pve3:sda osd.8                
INTEL_SSDSC2BB480G7O_PHDV645100E9480BGN pve1:sda osd.10                
INTEL_SSDSC2BB480G7O_PHDV64510380480BGN pve1:sdb osd.11                
INTEL_SSDSC2KB480G7_BTYS8081023D480BGN  pve2:sda osd.2                
INTEL_SSDSC2KB480G7_BTYS80900ACV480BGN  pve2:sdb osd.3

Is it safe to delete it with 'ceph osd del osd.x' or there is a specific way with ProxmoxVE ?

Thanks for your advices.

 

[shrdlicka]

Hi,

try deleting one, if ceph stays happy you can delete the others as well . You can just use the ceph command you posted .

 

[McFouch]

Hi,

try deleting one, if ceph stays happy you can delete the others as well . You can just use the ceph command you posted .

Thanks for your reply,

I will first backup & delete auth keys of this OSD and after remove them.

 

[McFouch]

All is clean and up to date now. I can plan to upgrade to Octopus !