How would you deploy 5 Node Ceph over three rooms?

jsterr

Renowned Member
Jul 24, 2020
787
223
68
33
Is a 4:2 pool setup with 3 rooms correct?

room1: server 1 and server 2
room2: server 3 and server 4
room3: server 5

  • how much mons do I need here, 5?
  • Is this setup correct so I can loose 2 servers anytime at the same time without having downtime?
 
Last edited:
What do you mean with rooms? Different datacenters or just another room at home for different failure domains?
The more mons you have, the more can be offline without interrupting the cluster. More than half the number has to be online, so with five mons two can be offline.
 
What do you mean with rooms? Different datacenters or just another room at home for different failure domains?
The more mons you have, the more can be offline without interrupting the cluster. More than half the number has to be online, so with five mons two can be offline.

different server rooms in different fire sections :-)
 
It's important for a cluster two have a low latency connection for Corosync and Ceph as well. If that is accomplished, you can easily spread the machines in different sections. And with 5 machines in 3 sections you're all set. :)
 
  • Like
Reactions: jsterr

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!