Hardware setup for ceph and HA

hdavy2002

New Member
May 30, 2019
1
0
1
47
Hello folks,

I have 3 servers with high storage 15x10 TB on each server. I have a 10Gb Switch. Each server has 1GB network card as well as one 10GB card. All 10GB ports are plugged into 10GB switch.

I will run 5 VMs and need HA and Ceph Storage. I can add more nodes as business grows.

Question is: Can I have HA and Ceph with three nodes?

another confusion was:

Is a HA cluster different from a Ceph cluster. I mean does one create a ceph cluster and then map a folder into Proxmox?

While the HA cluster only does HA. In that case, I will need more servers.

Somewhere, I read that I can have everything in 4 servers. And so I thought to ask you gurus and clarify.

Many thanks folks.

Cheers
 
I have 3 servers with high storage 15x10 TB on each server. I have a 10Gb Switch. Each server has 1GB network card as well as one 10GB card. All 10GB ports are plugged into 10GB switch.
Multiple Spindles will bring more Performance, but i doubt the Disks are really usable for CEPH. Check first which technology they use, it should not be an SMR Disk. Better using SSDs instead of Hard Disks.

Question is: Can I have HA and Ceph with three nodes?
Yes.

Is a HA cluster different from a Ceph cluster.
In general yes, but not in the case of PVE. You should using here the HCI Concept, then you will have all in one.

I mean does one create a ceph cluster and then map a folder into Proxmox?
You should not map a Folder, you should use RBD to use CEPH Storage. Otherwise you can use CephFS, which you can mount as a folder on the HV or the VMs itself.

Somewhere, I read that I can have everything in 4 servers. And so I thought to ask you gurus and clarify.
You put all on one Server, but this isnt really recommended. I'm running a Single PVE / CEPH Node for Backups, with a Replica of 2, per OSD. The Server itself run a single CEPH Mon, the CEPH Storage with 10 OSDs, a VM (as Gateway, i've installed it before CephFS was out). It worked very well up to today. For Backups it's okay, for the production VM you shouldn't use it.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!