Hardware setup for ceph and HA

[hdavy2002]

Hello folks,

I have 3 servers with high storage 15x10 TB on each server. I have a 10Gb Switch. Each server has 1GB network card as well as one 10GB card. All 10GB ports are plugged into 10GB switch.

I will run 5 VMs and need HA and Ceph Storage. I can add more nodes as business grows.

Question is: Can I have HA and Ceph with three nodes?

another confusion was:

Is a HA cluster different from a Ceph cluster. I mean does one create a ceph cluster and then map a folder into Proxmox?

While the HA cluster only does HA. In that case, I will need more servers.

Somewhere, I read that I can have everything in 4 servers. And so I thought to ask you gurus and clarify.

Many thanks folks.

Cheers

 

[sb-jw]

I have 3 servers with high storage 15x10 TB on each server. I have a 10Gb Switch. Each server has 1GB network card as well as one 10GB card. All 10GB ports are plugged into 10GB switch.

Multiple Spindles will bring more Performance, but i doubt the Disks are really usable for CEPH. Check first which technology they use, it should not be an SMR Disk. Better using SSDs instead of Hard Disks.

Question is: Can I have HA and Ceph with three nodes?

Yes.

Is a HA cluster different from a Ceph cluster.

In general yes, but not in the case of PVE. You should using here the HCI Concept, then you will have all in one.

I mean does one create a ceph cluster and then map a folder into Proxmox?

You should not map a Folder, you should use RBD to use CEPH Storage. Otherwise you can use CephFS, which you can mount as a folder on the HV or the VMs itself.

Somewhere, I read that I can have everything in 4 servers. And so I thought to ask you gurus and clarify.

You put all on one Server, but this isnt really recommended. I'm running a Single PVE / CEPH Node for Backups, with a Replica of 2, per OSD. The Server itself run a single CEPH Mon, the CEPH Storage with 10 OSDs, a VM (as Gateway, i've installed it before CephFS was out). It worked very well up to today. For Backups it's okay, for the production VM you shouldn't use it.