Understand Ceph log and write approach to the Boot and OSD disks

logui

Member
Feb 22, 2024
84
15
8
I have a 3 node cluster, each node has 2 consumer SATA SSDs, one for the Proxmox OS/Boot and the other SSD is used for Ceph OSD, no mirroring anywhere, this is a home lab, only testing, so no needed. each SSD has different TBW (Terabytes Written) value:

  • OS/Boot SSD TBW = 300
  • Ceph/OSD SSD TBW = 600
My focus has been to assign the SSD with the higher TBW value to the SSD that Ceph will write the most, I am assuming that, it would be the OSD SSD (currently with 600 TBW), but in my monitoring of the SSD (SMART - smartctl) I have noticed a lot of write activity on the Boot SSD (currently with 300 TBW) as well, in some cases, even more than on the OSD SSD.

Should I swap them, and use the SSD with higher TBW for Boot instead? Does this means that Ceph writes more logs to the Boot disk than to the OSD disk? Any feedback will be appreciated, thank you