Ceph unable to add another OSD

[RaV001]

I am trying to add a new disk plus journal to my ceph.

In the Proxmox GUI I get this error:

command 'ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid 99e013e5-955b-44c8-a541-0e45233114b1 --journal-dev /dev/sdb /dev/sdd' failed: exit code 1

 

[wolfgang]

Hi,

are the disks gpt formatted?

 

[RaV001]

yes the disk is gpt formatted. I have changed the disk to a new one and the same issue occurs. It looks like that the commands in the background are also formatting the disk with gpt

 

[wolfgang]

ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid 99e013e5-955b-44c8-a541-0e45233114b1 --journal-dev /dev/sdb /dev/sdd

And what error you get if you run this command manually?

 

[RaV001]

This is the output:

root@host03:~# ceph-disk prepare --zap-disk --fs-type xfs --cluster ceph --cluster-uuid 99e013e5-955b-44c8-a541-0e45233114b1 --journal-dev /dev/sdb /dev/sdd
Caution: invalid backup GPT header, but valid main header; regenerating
backup header from main header.

****************************************************************************
Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk
verification and recovery are STRONGLY recommended.
****************************************************************************
GPT data structures destroyed! You may now partition the disk using fdisk or
other utilities.
Creating new GPT entries.
The operation has completed successfully.
prepare_device: OSD will not be hot-swappable if journal is not the same device as the osd data
Setting name!
partNum is 2
REALLY setting name!
Warning: The kernel is still using the old partition table.
The new table will be used at the next reboot.
The operation has completed successfully.
Setting name!
partNum is 0
REALLY setting name!
The operation has completed successfully.
meta-data=/dev/sdb1 isize=2048 agcount=4, agsize=183141597 blks
= sectsz=4096 attr=2, projid32bit=1
= crc=0 finobt=0
data = bsize=4096 blocks=732566385, imaxpct=5
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096 ascii-ci=0 ftype=0
log =Internes Protokoll bsize=4096 blocks=357698, version=2
= sectsz=4096 sunit=1 blks, lazy-count=1
realtime =keine extsz=4096 blocks=0, rtextents=0
mkfs.xfs: libxfs_device_zero schreiben fehlgeschlagen: Eingabe-/Ausgabefehler
ceph-disk: Error: Command '['/sbin/mkfs', '-t', 'xfs', '-f', '-i', 'size=2048', '--', '/dev/sdb1']' returned non-zero exit status 1

 

[wolfgang]

I would say you have a faulty disk.

mkfs.xfs: libxfs_device_zero schreiben fehlgeschlagen: Eingabe-/Ausgabefehler

I would check the disk or the controller.