how to get the ssd drives to show up as new OSDs in ceph

hassoon

Active Member
Jan 27, 2020
38
0
26
64
Hi, Im struggling to find a way out of this, I have 3 nodes
they have 8 drives each and all are SAS ones, Ive done 2 drives raid1 which has proxmox OS.
the rest are kept as data for ceph. due to performance issues I had to remove the 6th drive and change it with SSD so that I put the journaling on it. now I have connected the ssd and the system has detected the drive and I had to add it as raid0 via ssacli command as
ssacli ctrl slot=0 create type=ld drives=2I:1:8 raid=0
the drive is created but I cant add it in OSD nor I cant see it under journal/db/disk section. how can I make it showing pls?
 
anyone here to help? what makes the normal drive appear to be added as new osd while ssd drive does not appear to be added?
 
First, using a RAID controller for Ceph drives is a bad idea. They usually don't pass through the drive as is which might cause other problems down the road as the system does not get all the data / the true data from the drive. Putting a RAID0 on top of the drive will definitely show other data to the system than the disk itself would. Replacing a failed disk will also be much more of a hassle.

Ideally you connect the disks for Ceph directly via an SATA controller or an HBA controller. The same is valid if you want to use ZFS.

the drive is created but I cant add it in OSD nor I cant see it under journal/db/disk section. how can I make it showing pls?
After you created the raid0, do you see a new disk being detected by the system? Check the dmesg output or lsblk.

Otherwise you might have to reboot.
 
thanks for the reply
I know about raid0 but I had no option but to do it
lsblk shows this

root@pve2:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 136.7G 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 256M 0 part
└─sda3 8:3 0 136.5G 0 part
├─pve-swap 253:0 0 8G 0 lvm [SWAP]
├─pve-root 253:1 0 34G 0 lvm /
├─pve-data_tmeta 253:2 0 1G 0 lvm
│ └─pve-data 253:4 0 76.5G 0 lvm
└─pve-data_tdata 253:3 0 76.5G 0 lvm
└─pve-data 253:4 0 76.5G 0 lvm
sdb 8:16 0 931.5G 0 disk
├─sdb1 8:17 0 100M 0 part /var/lib/ceph/osd/ceph-6
└─sdb2 8:18 0 931.4G 0 part
sdc 8:32 0 931.5G 0 disk
├─sdc1 8:33 0 100M 0 part /var/lib/ceph/osd/ceph-7
└─sdc2 8:34 0 931.4G 0 part
sdd 8:48 0 111.8G 0 disk
└─sdd1 8:49 0 111.8G 0 part
sde 8:64 0 279.4G 0 disk
├─sde1 8:65 0 100M 0 part /var/lib/ceph/osd/ceph-9
└─sde2 8:66 0 279.3G 0 part
sdf 8:80 0 279.4G 0 disk
├─sdf1 8:81 0 100M 0 part /var/lib/ceph/osd/ceph-10
└─sdf2 8:82 0 279.3G 0 part
sdg 8:96 0 279.4G 0 disk
├─sdg1 8:97 0 100M 0 part /var/lib/ceph/osd/ceph-12
└─sdg2 8:98 0 279.3G 0 part
root@pve2:~#

SDD is the ssd and as you see it the system already is seeing it the strange thing if I do raid0 on any normal SAS drive it will show up to add as new osd. only this ssd is not showing and not even under the journal section
any ideas?
 
SDD is the ssd and as you see it the system already is seeing it the strange thing if I do raid0 on any normal SAS drive it will show up to add as new osd. only this ssd is not showing and not even under the journal section
any ideas?
If the SSD is not listed in lsblk, then it is an issue with the configuration of the controller or the SSD. Once the device shows up, it should be seen by ceph-volume. But it might not be identified as SSD.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!