Hi All,
I'm having an issue adding an SSD drive to my hosts. Current setup is 3 Dell hosts, running a few SSDs in each host. I'm looking to create some Ceph storage, and was able to create some OSDs succesfully.
The drives that are giving me issues are all Intel 400 GB (SSDSC2BA400G4). I have a total of 4 of these drives across the hosts, and they all give me issues when trying to add them. The other SSDs work fine.
See error messages below. I tried just creating a LVM-THIN vs adding a CEPH OSD but it still fails. I can however create a regular LVM device.
Running PVE 8.2.2
Errors if I just try to create an LVM-THIN storage device.
I'm having an issue adding an SSD drive to my hosts. Current setup is 3 Dell hosts, running a few SSDs in each host. I'm looking to create some Ceph storage, and was able to create some OSDs succesfully.
The drives that are giving me issues are all Intel 400 GB (SSDSC2BA400G4). I have a total of 4 of these drives across the hosts, and they all give me issues when trying to add them. The other SSDs work fine.
See error messages below. I tried just creating a LVM-THIN vs adding a CEPH OSD but it still fails. I can however create a regular LVM device.
Running PVE 8.2.2
Code:
()
create OSD on /dev/sdb (bluestore)
wiping block device /dev/sdb
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.788577 s, 266 MB/s
Running command: /bin/ceph-authtool --gen-print-key
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring -i - osd new 0dbcd843-4671-4371-9265-1767f39291f8
Running command: vgcreate --force --yes ceph-575d7486-966e-4912-b0b1-b29870b3c609 /dev/sdb
stdout: Physical volume "/dev/sdb" successfully created.
stdout: Volume group "ceph-575d7486-966e-4912-b0b1-b29870b3c609" successfully created
Running command: lvcreate --yes -l 95388 -n osd-block-0dbcd843-4671-4371-9265-1767f39291f8 ceph-575d7486-966e-4912-b0b1-b29870b3c609
stderr: Failed to initialize logical volume ceph-575d7486-966e-4912-b0b1-b29870b3c609/osd-block-0dbcd843-4671-4371-9265-1767f39291f8 at position 0 and size 4096.
Aborting. Failed to wipe start of new LV.
stderr: Error writing device /dev/sdb at 7168 length 1024.
stderr: WARNING: bcache_invalidate: block (0, 0) still dirty.
Failed to write metadata to /dev/sdb.
Failed to write VG ceph-575d7486-966e-4912-b0b1-b29870b3c609.
Manual intervention may be required to remove abandoned LV(s) before retrying.
--> Was unable to complete a new OSD, will rollback changes
Running command: /bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring osd purge-new osd.0 --yes-i-really-mean-it
stderr: 2024-05-01T19:40:52.238-0400 7ab76fe006c0 -1 auth: unable to find a keyring on /etc/pve/priv/ceph.client.bootstrap-osd.keyring: (2) No such file or directory
2024-05-01T19:40:52.238-0400 7ab76fe006c0 -1 AuthRegistry(0x7ab768063ec8) no keyring found at /etc/pve/priv/ceph.client.bootstrap-osd.keyring, disabling cephx
stderr: purged osd.0
--> RuntimeError: Unable to find any LV for zapping OSD: 0
TASK ERROR: command 'ceph-volume lvm create --crush-device-class nvme --data /dev/sdb' failed: exit code 1Errors if I just try to create an LVM-THIN storage device.
Code:
()
Physical volume "/dev/sdb" successfully created.
Volume group "IntelTemp" successfully created
Rounding up size to full physical extent <365.04 GiB
Rounding up size to full physical extent <3.73 GiB
Thin pool volume with chunk size 64.00 KiB can address at most <15.88 TiB of data.
Failed to initialize logical volume IntelTemp/lvol0 at position 0 and size 1048576.
Aborting. Failed to wipe start of new LV.
Error writing device /dev/sdb at 7168 length 1024.
WARNING: bcache_invalidate: block (0, 0) still dirty.
Failed to write metadata to /dev/sdb.
Failed to write VG IntelTemp.
Manual intervention may be required to remove abandoned LV(s) before retrying.
TASK ERROR: command '/sbin/lvcreate --type thin-pool -L382766612.48K --poolmetadatasize 3905781.76K -n IntelTemp IntelTemp' failed: exit code 5
