Removing HDD from CEPH with different crush rules (HDD/SSD)

[tiopz]

Hello,

I have a cluster of 4 servers in a proxmox datacenter.
On these, CEPH is configured. All the servers are added as monitors and manager, everything is working properly.
There is also a CRUSH rule for HDD and for SSD storage.
Ceph version is 18.2.2

On 3 of 4 servers, there are HDD and SSD that are used for CEPH storage, for VM. On the 4th, only SSD.
I have 2 CEPH pools, ceph_hdd and ceph_ssd, to use only HDD or SSD.

I want to remove the HDD from the servers, and wanted a confirmation on the way to do that :
1. Move all VM and LXC data to ceph_ssd
2. When I don't have anything left inside ceph_hdd : Remove ceph_hdd from Datacenter > Storage, then destroy ceph_hdd from <Node> > Ceph > Pools
3. Waiting for CEPH to rebalance ? What should I check before going farther ?
4. Out the HDD drives from <Node> > Ceph > OSD
5. Waiting for CEPH again ? What should I check before going farther ?
6. Stopping the OSD from <Node> > Ceph > OSD
7. Destroy the OSD from <Node> > Ceph > OSD
8. Removing the drives from the servers ?

Thanks

 

[SteveITS]

You'd destroy the OSD before removing it. Though I haven't done this process, if there's no data on them I'd expect no real rebalancing time.

 

[tiopz]

Thank you for your answer, I just edited my original post to reflect what you said. Is that correct ?
Are there anything to except that could go wrong while doing everything mentioned above ?