Largest cluster *without* HA

[Jeff Escamilla]

Howdy all,

So I'm trying to get an odd question answered here that I can't seem to find. I know that Proxmox uses Corosync to create and manage a cluster which will let you use a single interface to manage multiple physical nodes, as well as handling HA and live migrations, but from everything I've seen Corosync has a limit of around 32 nodes before things get ugly.

Here's the problem: I want to create a cluster of approximately 300 nodes, but I do not need HA or failover as all guest instances will be hosted locally and will not need to be migrated. Given the sheer number of nodes however I definitely need to have a single pane of glass for monitoring and management.

Is there any way to do this with Proxmox? This is my last hurdle as the rest of it looks amazing and fits my needs exactly.

Thanks!

 

[aderumier]

It's impossible to do it in 1 cluster.
I think corosync have a hardlimit in code, around 100 nodes. (and this need a lot of tuning of corosync) I never have tested more than 20 nodes.

I think the proxmox plan was to be able in the future, in 1 interface, to manage multiple clusters. But nothing is done yet.

 

[dietmar]

It is usually much better to create several different clusters instead, especially if you do not need HA and migration.

 

[Jeff Escamilla]

Is there any way to offer a "single pane of glass" management for this then? If we can only (realistically) have about 64 nodes in a cluster that means our Operations team would have 5 individual clusters that they would have to log in to, monitor and manage. I'd be fine with the multiple clusters, but I'm also trying to reduce operational overhead.

 

[Alessandro 123]

IMHO, if you need so many VMs in a single cluster, you should look for an ochestration system like OpenNebula, developed to manage thousands VMs