[SOLVED] Ceph, create OSD and no disks unused (greyed out)

[damonpillinger]

Hi All,
I have 4 nodes in a cluster
Node 2 is the primary node and I can add disks (create OSD) connected to this node with no problems.

The other 3 nodes all have spare SSD drives but none of them will appear when I try to add an OSD

when I try to destroy the contents I get this

root@prox4:~# ceph-volume lvm zap /dev/sdb --destroy
--> Zapping: /dev/sdb
Running command: /usr/sbin/wipefs --all /dev/sdb
stderr: wipefs: error: /dev/sdb: probing initialization failed: Device or resource busy
--> RuntimeError: command returned non-zero exit status: 1


when I use cfdisk /dev/sdb it lists a free space

Free space 2048 1953525134 1953523087 931.5G

in the GUI under disks the drive appears



fdisk -l shows me this (sda is used by proxmox)


Disk /dev/sda: 232.9 GiB, 250059350016 bytes, 488397168 sectors
Disk model: Samsung SSD 850
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: gpt
Disk identifier: 510609B0-CD1B-409E-82B1-1CD0E1F113F6

Device Start End Sectors Size Type
/dev/sda1 34 2047 2014 1007K BIOS boot
/dev/sda2 2048 1050623 1048576 512M EFI System
/dev/sda3 1050624 488397134 487346511 232.4G Linux LVM


Disk /dev/sdb: 931.5 GiB, 1000204886016 bytes, 1953525168 sectors
Disk model: Samsung SSD 860
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: gpt
Disk identifier: 458FE083-DDE4-3B44-BB0F-9B5319B22953


Disk /dev/mapper/pve-root: 58 GiB, 62277025792 bytes, 121634816 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/mapper/ceph--33363f2b--22d7--403d--82b0--3ffd3992b19c-osd--block--f04e9bbe--8379--47ba--9a3c--d25b6375b8e8: 931 GiB, 999653638144 bytes, 1952448512 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/mapper/pve-swap: 8 GiB, 8589934592 bytes, 16777216 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Any Ideas?

thanks
Damon

 

[damonpillinger]

if anyone this error here is the solution.

migrate the VM's to another node

shutdown the node

start the node

problem gone.

 

[Kaboom]

This didn't help for me, are you sure this was the solution?

 

[damon1]

worked for me again - lucky I put this here as I spent hours trying to figure it out again.

try this

ceph-volume lvm zap /dev/sdb
for each disk you want to use

reboot machine

 

[aha]

your post saved me a lot of time. Tried it first with wipefs, but it still appeared as an used disk in proxmox.

 

[eagleflyfree]

worked for me again - lucky I put this here as I spent hours trying to figure it out again.

try this

ceph-volume lvm zap /dev/sdb
for each disk you want to use

reboot machine

Genious! Thanks, you saved me a huge headache!