Hardware for Proxmox+CEPH

monxp

New Member
Mar 22, 2016
4
0
1
45
Hello everybody,

First of all, sorry about my poor English, it's not my native languaje.

In our company, we've an old 4 nodes proxmox cluster, but we need more reliability and compute capacity. We're thinking to get a new 3 node Cluster, each one like this configuration:
  • E5-2630-V3 processor (8 cores, 2,4Ghz), with capability to dual CPU
  • 128GB of DDR4 LPDIMM
  • 2 SSD SATA 128GB Raid1 for the OS
  • 4 WD RE 3TB for the CEPH FS, with capability for 12 drives
  • 1 Samsung 950PRO 240GB NVMe for CEPH cache, with capability for 3 drives
  • 4x 10Gbe network interfaces, 2 for ceph and 2 for management, all in bonding
  • Redundant power supply
  • ...

Our providers, logically, wants to sell us a turnkey-system, with SAS SSD drives or a VMWARE installation. But we want a custom system, with more capacity and better price.

Supermicro has the SSG-6028R-OSD072P. Adding a better CPU, more RAM and a other network card, would be enough. On the other hand, the Lenovo salesman told us that a configuration with 6 SATA drives + 1 NVMe drive may be a unstable installation. Furthermore, Lenovo does not sell Hard Drive installation caddys without the hard drive, it would be a problem.

Anyone has experience with a similar installation? Any hardware recomendation?

Thank you
 
  • Like
Reactions: monxp
Thank you for your reply. I stayed away from computer and a don't see your reply until now.

What do you think is a good choice? Just the Intel P3700? As I can see, the Sandisk SX300 minimum storage capability is on 1,3TB, too much for jounaling, and too expensive of course.

Thank you
 
I know many people use the Intel S3500 or the S3610.
 
  • Like
Reactions: monxp
Thank you again.

I'm talking with a provider to get 3 Supermicro Server with dual E5-2630-V3, 128GB RAM, SSD for de OS and P3700 for journaling. The internal communication will be at 10Gbe.

All the configuration will be replicated. Bonded networks, double switching, 2 UPS, redundant power supplyes... ¿Any recomendation to get the best reliability? It's a critical infraestructure, but we don't have too much money to spend (like everyone, I suppose). I'm thinking to add a fourth server, just for CEPH Monitor. It would be an old server, but I hope It will be enough. Is It recommendable?

I hope it'll be enough for our uptime and performance requirements.