How does this sound for a 3-node Proxmox Ceph HA cluster?

asincero

New Member
Mar 3, 2023
4
0
1
I'm trying to put together a small 3-node HA Proxmox Ceph cluster. Here's the relevant hardware in each box:

  • Dual Intel Xeon 3204 CPUs (1.9Ghz)
  • 64GB Memory
  • Two 10G NICs (for the Ceph network)
  • Three 3.84TB Samsung PM893 SATA SSDs
I will be connecting the boxes together directly via DAC cable and will not be utilizing a switch.

The cluster will not be hosting a large number of VMs. Probably 4 at the most.

Should I try and get more memory? What about the NICs? Should I go 25G instead?

We haven't bought the hard drives yet, but after a little bit of Googling the PM893 seems like a good choice. The boxes do not have U.3, only SATA so I'm limited to SATA SSDs only. Are there other recommendations for SSDs that work well in a Ceph environment?
 
Network is okay for a small number of VMs, RAM probably is if those VMs don't user more than 10gb RAM per vm. These ssds work okay, i have a few of them in some clusters. All in all nice 3 node cluster for start.
 
Network is okay for a small number of VMs, RAM probably is if those VMs don't user more than 10gb RAM per vm. These ssds work okay, i have a few of them in some clusters. All in all nice 3 node cluster for start.

Thanks for your input!

I accidentally omitted one other detail. The boxes will also have 2 1G NICs, and that will be for "all other network traffic". The 10G will be for Ceph only. What you said probably still holds true, though.

Do you know of any other enterprise SATA SSDs I should be considering?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!