How does this sound for a 3-node Proxmox Ceph HA cluster?

asincero

New Member
Mar 3, 2023
4
0
1
I'm trying to put together a small 3-node HA Proxmox Ceph cluster. Here's the relevant hardware in each box:

  • Dual Intel Xeon 3204 CPUs (1.9Ghz)
  • 64GB Memory
  • Two 10G NICs (for the Ceph network)
  • Three 3.84TB Samsung PM893 SATA SSDs
I will be connecting the boxes together directly via DAC cable and will not be utilizing a switch.

The cluster will not be hosting a large number of VMs. Probably 4 at the most.

Should I try and get more memory? What about the NICs? Should I go 25G instead?

We haven't bought the hard drives yet, but after a little bit of Googling the PM893 seems like a good choice. The boxes do not have U.3, only SATA so I'm limited to SATA SSDs only. Are there other recommendations for SSDs that work well in a Ceph environment?
 
Network is okay for a small number of VMs, RAM probably is if those VMs don't user more than 10gb RAM per vm. These ssds work okay, i have a few of them in some clusters. All in all nice 3 node cluster for start.
 
Network is okay for a small number of VMs, RAM probably is if those VMs don't user more than 10gb RAM per vm. These ssds work okay, i have a few of them in some clusters. All in all nice 3 node cluster for start.

Thanks for your input!

I accidentally omitted one other detail. The boxes will also have 2 1G NICs, and that will be for "all other network traffic". The 10G will be for Ceph only. What you said probably still holds true, though.

Do you know of any other enterprise SATA SSDs I should be considering?