CEPH: Switching to SSD drives

sc3705

Member
Jul 3, 2020
27
1
8
42
Hi All,

I'm just making sure this is a solid enough plan before I execute.

I have a 3 node, 5 disk(each) cluster with ceph storage. currently the cluster consists of (combined) 3 2TB NVME and 15 2-3 TB spinning disks. I just got approval last week to convert all 15 spinning disks to 2TB ssds (and add 3 more SSDs) but I can't do it until the budget resets at the end of the year. My luck; i lost a drive yesterday, exactly one week after my conditional approval. We're certain it's dead, the OSD keeps crashing and the node is spitting out some nasty looking IO errors for the affected disks.

To my crazy question; how bad of an idea is it to replace the failed spinning disk with an SSD today? I'm aware that I wont see the performance benefits of the SSD in this configuration. My thinking is why buy a new spinning disk today just to completely replace it for an SSD in 3 months; I'll have no use for these spinning disks after the upgrade. so instead of buying 18 SSD in January we'll only buy 17 (or 16 if we loose another one before then). I'm unsure if there are any performance or stability issues when mixing drive types like this. Maybe there is a completely different type of issue when mixing disks that i'm ignorant to.

It will only be until the end of the year but if this a risky operation we'll replace the failed disk with a comparable and upgrade all the SSDs as one project in January.

Thoughts? (feel free to just tell me i'm nuts... :) )
 
Hi,

if you do not use disk classes then you could replace an HDD with an SSD without problems.
As you say you will not see any speedup in the cluster as long all HDD disks are replaced.
If you use disk classes you must check how they are used.
 
Hi,

if you do not use disk classes then you could replace an HDD with an SSD without problems.
As you say you will not see any speedup in the cluster as long all HDD disks are replaced.
If you use disk classes you must check how they are used.

Thank you for validating.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!