Hello!
Hopefully this is an easy fix, but honestly I'm not sure what the problem even is.
I have a 3 node cluster with an existing ceph pool. It has 4 disks/OSD's and I am trying to create a 5th.
Usually I use the GUI, and everything is fine, but this OSD just doesn't want to work, and it isn't giving me a reason as to why it is failing.
I have tried zapping the drive:
Before it says unable to complete a new OSD, will rollback changes, the vgcreate command completes successfully, and it doesn't show what happens after.
I have looked, but it doesn't seem like pveceph osd create has a verbose option. Is there any way to see what commands are being ran, and where the issue is?
Version info:
Thanks for the help, and the great product!
Hopefully this is an easy fix, but honestly I'm not sure what the problem even is.
I have a 3 node cluster with an existing ceph pool. It has 4 disks/OSD's and I am trying to create a 5th.
Usually I use the GUI, and everything is fine, but this OSD just doesn't want to work, and it isn't giving me a reason as to why it is failing.
I have tried zapping the drive:
ceph-volume lvm zap /dev/sde --destroy and then I run:
Code:
# pveceph osd create /dev/sde
create OSD on /dev/sde (bluestore)
wiping block device /dev/sde
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.536836 s, 391 MB/s
Running command: /bin/ceph-authtool --gen-print-key
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 6a9159c9-fcda-4c35-b437-b9974e37c59d
Running command: vgcreate --force --yes ceph-9a291834-c662-4047-ad83-5835a61ba841 /dev/sde
stdout: Physical volume "/dev/sde" successfully created.
stdout: Volume group "ceph-9a291834-c662-4047-ad83-5835a61ba841" successfully created
--> Was unable to complete a new OSD, will rollback changes
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.4 --yes-i-really-mean-it
stderr: 2025-03-15T19:51:23.251-0400 71d1450006c0 -1 auth: unable to find a keyring on /etc/pve/priv/ceph.client.bootstrap-osd.keyring: (2) No such file or directory
2025-03-15T19:51:23.251-0400 71d1450006c0 -1 AuthRegistry(0x71d140064298) no keyring found at /etc/pve/priv/ceph.client.bootstrap-osd.keyring, disabling cephx
stderr: purged osd.4
--> RuntimeError: Unable to find any LV for zapping OSD: 4
command 'ceph-volume lvm create --data /dev/sde' failed: exit code 1I have looked, but it doesn't seem like pveceph osd create has a verbose option. Is there any way to see what commands are being ran, and where the issue is?
Version info:
Code:
proxmox-ve: 8.3.0 (running kernel: 6.8.12-4-pve)
pve-manager: 8.3.5 (running version: 8.3.5/dac3aa88bac3f300)
proxmox-kernel-helper: 8.1.1
proxmox-kernel-6.8: 6.8.12-8
proxmox-kernel-6.8.12-8-pve-signed: 6.8.12-8
proxmox-kernel-6.8.12-4-pve-signed: 6.8.12-4
ceph: 18.2.4-pve3
ceph-fuse: 18.2.4-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2+deb12u1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.6.0
libproxmox-backup-qemu0: 1.5.1
libproxmox-rs-perl: 0.3.5
libpve-access-control: 8.2.0
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.10
libpve-cluster-perl: 8.0.10
libpve-common-perl: 8.2.9
libpve-guest-common-perl: 5.1.6
libpve-http-server-perl: 5.2.0
libpve-network-perl: 0.10.1
libpve-rs-perl: 0.9.2
libpve-storage-perl: 8.3.3
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.5.0-1
proxmox-backup-client: 3.3.3-1
proxmox-backup-file-restore: 3.3.3-1
proxmox-firewall: 0.6.0
proxmox-kernel-helper: 8.1.1
proxmox-mail-forward: 0.3.1
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.3.6
pve-cluster: 8.0.10
pve-container: 5.2.4
pve-docs: 8.3.1
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.1.0
pve-firmware: 3.14-3
pve-ha-manager: 4.0.6
pve-i18n: 3.4.0
pve-qemu-kvm: 9.2.0-2
pve-xtermjs: 5.3.0-3
qemu-server: 8.3.8
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.7-pve1Thanks for the help, and the great product!