New cluster install with Ceph

[iruindegi]

Hi,

We had a proxmox server runing for a year and now we bought 2 more servers (so we have 3 identical Supermicro servers):

• CSE-825TQ-R720LPB CHASIS
  
• MBD-X10DRH-C-O SUPERMICRO INTEL motherboard
  
• 2 x INTEL BROADWELL-EP 8C E5-2620V4 2.1G 20M 8GT
• Each server 128Gb RAM ( 4 x 32GB DDR4-2400 2Rx4 LP ECC REG )
  
• Each server RAID 5 SSD (3 x 2.5" SSD SAMSUNG 850 EVO 500GB MZ-75E500B)

What we want is to enable HA and for that we think to install 3 Microservers with FreeNas (Lagg, Carp and Hast) and use iSCSI for proxmox storage. We realised that it is not an easy setup, due to lack of documentation so we are thinking to go to Ceph.

Microservers are: 3 HP Microserver Gen8:

• 2,3 GHz, Intel Xeon, E3-1220LV2
  
• 8 Gb RAM
• 1 SSD 250Gb for SO
• 4 x WD RED NAS 4TB

Now the question is... are this microservers a good place for ceph or it's better to take the hard drives (WD Red NAS 4TB) and put them to Supermicro servers and install it all together?

Thanks in advance

 

[manu]

the critical factor for ceph is that you need 10GB networks between the nodes, preferably on a dedicated NIC that's one of the most important thing to consider.

 

[iruindegi]

We can buy them... what about microserver hardware? is it enough? or better go and install all together in supermicro servers?