Adding SSD to have separate DB/WAL device for OSDs

[cchock]

Hello,

I'm currently running a 3 Node Proxmox server 6.3.3 with 3 x 10TB SAS drives for my CEPH Storage each

Currently I would like to add 3 x 1 TB NvME drives into my servers but i have already created my OSDs
Is there a way to add in these NvME drives and then move Block.db and block.wal into them?

I do understand there is this command :

pveceph osd create /dev/sd[X] -db_dev /dev/sd[Y] -wal_dev /dev/sd[Z]

BUT my OSDs has already been created and populated.

Please advise. If I have to destroy the OSD can I do it one node at a time so I could still maintain the integrity of my DATA

Thanks

 

[Alwin]

Currently I would like to add 3 x 1 TB NvME drives into my servers but i have already created my OSDs
Is there a way to add in these NvME drives and then move Block.db and block.wal into them?

The easiest is to destroy & create the OSD again.

Please advise. If I have to destroy the OSD can I do it one node at a time so I could still maintain the integrity of my DATA

You can do it a host at a time.

But if you want to minimize the impact, then best reweight the OSD first to 0. This will cause Ceph to distribute the data on that OSD to the others on that node. Once it is empty a destroy & create will just copy the data from the other OSDs back. This way there is less impact on the other nodes and you have no issue with any other unexpected failures in the cluster.