Is mixing SSD disks with different sizes in ceph cluster recommended?

Maggi

New Member
Apr 26, 2024
7
0
1
Hello,

I currently have a Hyper-Converged Ceph proxmox production cluster with 3 old r730xd servers. Each of them have 3 x 1.6 TB SSDs and 19 x 1.8 TB hdd. I created 2 ceph storage 1 with the 3 SSDs and another one with the hdd. Now I need to replace those servers with 5 R750 and 2 R740xd, sorry if my questions are so silly but I starting to work with proxmox and ceph so I am learning.

  1. I have available 12 x 3.84TB SSDs, 16 x 800GB SSDs, 16 x 7.68 TB SSDs, 36 x 2.4 TB HDDs and the disks from the 3 servers I will remove from the cluster. Is it ok to create a pool with disks of different sizes? The documentation says that is better to have same size, what would be the impact to have 3 different sizes in the same pool? or it is better to create a pool per size (pool1 x 3.84TB, pool2 x 7.68TB and pool3 x 800GB)?
  2. If I will set the number of replicas to 3 and the minimum number of replicas to 2, do I have to distribute the disks between the 7 servers? or is it better to distribute them between only 3 servers and, in this case, Will the others be able to write/read the pool(s)?
Thanks in advance, any help or guidance would be greatly appreciated.