Ceph cannot add disk, weird result on lsblk

S

Springtime

Member
Nov 18, 2024
34
5
8
Hello,

I am not an extreme Linux pro, but I do know my way around Linux at least to some point, I'd say.
I have an issue that I'm playing with Ceph, and saw that I cannot add two disks as usual to the Ceph-Cluster. I get only 40GB /dev/sde4.
When I do lsblk, I get following:
Code: 
root@s02p00a3103:~# lsblk
NAME                                                                                                  MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
sda                                                                                                     8:0    0 894.3G  0 disk
└─ceph--75ae2d95--6cc5--49c6--9a00--998abaf641c6-osd--block--650bc4a6--a66e--403e--849b--d3e14a4c3d5c 252:1    0 894.3G  0 lvm 
sdb                                                                                                     8:16   0 894.3G  0 disk
└─ceph--f2b2726d--a442--44ff--a3cc--a8ace1db0d2e-osd--block--1010c432--5691--4cdd--83e7--77a50540e9a5 252:3    0 894.3G  0 lvm 
sdc                                                                                                     8:32   0 894.3G  0 disk
└─ceph--5ba00b93--92c1--42c8--87ff--3246f0485111-osd--block--44ee92b0--a5c3--4892--80ce--8b153a794c4b 252:2    0 894.3G  0 lvm 
sdd                                                                                                     8:48   0 894.3G  0 disk
└─ceph--f186cf8a--28ca--44d2--abcb--e584f1e70da0-osd--block--171ec5bb--bace--47f1--9d67--36b8fa05d517 252:0    0 894.3G  0 lvm 
sde                                                                                                     8:64   0 894.3G  0 disk
└─sde4                                                                                                  8:68   0    37G  0 part
sdf                                                                                                     8:80   0 894.3G  0 disk
└─sdf4                                                                                                  8:84   0    37G  0 part
sdg                                                                                                     8:96   0 894.3G  0 disk
sdh                                                                                                     8:112  0 894.3G  0 disk
sdi                                                                                                     8:128  0 894.3G  0 disk
├─sdi1                                                                                                  8:129  0  1007K  0 part
├─sdi2                                                                                                  8:130  0     1G  0 part /boot/efi
└─sdi3                                                                                                  8:131  0 893.3G  0 part
  ├─pve-swap                                                                                          252:4    0     8G  0 lvm  [SWAP]
  └─pve-root                                                                                          252:5    0 885.3G  0 lvm  /
sr0                                                                                                    11:0    1  1024M  0 rom

And if I do fdisk -l:
Code: 
root@hostname:~# fdisk -l
Disk /dev/sda: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdb: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdc: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdd: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sde: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdg: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdf: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdh: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/sdi: 894.25 GiB, 960197124096 bytes, 1875385008 sectors
Disk model: MK000960GWJPP   
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disklabel type: gpt
Disk identifier: 0506D6A5-343E-45BB-9005-C1DABE68D584

Device       Start        End    Sectors   Size Type
/dev/sdi1       34       2047       2014  1007K BIOS boot
/dev/sdi2     2048    2099199    2097152     1G EFI System
/dev/sdi3  2099200 1875384974 1873285775 893.3G Linux LVM

Partition 1 does not start on physical sector boundary.


Disk /dev/mapper/ceph--f186cf8a--28ca--44d2--abcb--e584f1e70da0-osd--block--171ec5bb--bace--47f1--9d67--36b8fa05d517: 894.25 GiB, 960193626112 bytes, 1875378176 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/mapper/ceph--75ae2d95--6cc5--49c6--9a00--998abaf641c6-osd--block--650bc4a6--a66e--403e--849b--d3e14a4c3d5c: 894.25 GiB, 960193626112 bytes, 1875378176 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/mapper/ceph--5ba00b93--92c1--42c8--87ff--3246f0485111-osd--block--44ee92b0--a5c3--4892--80ce--8b153a794c4b: 894.25 GiB, 960193626112 bytes, 1875378176 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/mapper/ceph--f2b2726d--a442--44ff--a3cc--a8ace1db0d2e-osd--block--1010c432--5691--4cdd--83e7--77a50540e9a5: 894.25 GiB, 960193626112 bytes, 1875378176 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/mapper/pve-swap: 8 GiB, 8589934592 bytes, 16777216 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk /dev/mapper/pve-root: 885.25 GiB, 950529949696 bytes, 1856503808 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes

Also, if I enter fdisk, it tells me there are no partitions.
Doing wipefs -a /dev/sde* also doesn't help.

Also had ZFS on these drives, so I know they should be usable, ZFS recognized them as 960GB disks.
 
You must log in or register to reply here.
Top Bottom