I can't seem to find any info on what the largest distributed (non-datacenter) deployment of ProxMox is. We are investigating replacing Vsphere with another product, and Proxmox is on my list to test. Each site would have few hosts (2-5 per site), but we have more than a thousand sites. Does anyone have any information that I could reference, etc? Any help is greatly appreciated...thanks!
Proxmox scalability - max clusters in a datacenter
- Thread starter climbtech
- Start date
Proxmox does not have native multi-cluster single pane of glass management tool (today). There are a few companies that have built such capabilities, mostly with an eye on CSP market (cloud service providers). A thousand sites with 2-5 nodes per side, I suspect, will require custom development.
Good luck
Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
Good luck
Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
you can give a try to
https://cluster-manager.fr/
to centralize management of multiple clusters
(This is a friend who's develop it, windows only for now)
https://cluster-manager.fr/
to centralize management of multiple clusters
(This is a friend who's develop it, windows only for now)
Multi-cluster-management is in the works:
But if this is supposed/planned to be able to handle such a massive environment is a question to be answered by the developers...
But if this is supposed/planned to be able to handle such a massive environment is a question to be answered by the developers...
Openstack is probably overkill - unless you actually need the bells/whistles it brings. And its multi-site federation is a bit of a bolt-on - it works but is clumsily not native to how OpenStack was originally designed.
For multi-site management of a large number small (3-5 node) sites doing rather simple virtualization and storage management you might want to look at XCP-ng.
Note to moderators: I feel somewhat awkward mentioning a competing system here - but it does solve a problem that Proxmox does not (at least not yet). Feel free to delete this post if you feel it is inappropriate.
For multi-site management of a large number small (3-5 node) sites doing rather simple virtualization and storage management you might want to look at XCP-ng.
Note to moderators: I feel somewhat awkward mentioning a competing system here - but it does solve a problem that Proxmox does not (at least not yet). Feel free to delete this post if you feel it is inappropriate.
I'd be very curious to know what use-case requires a thousand sites with 2-5 nodes hypervisor cluster in each...
Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
There are many
Very common actually. There are many use cases in this situation. Retailers like Costco, Walmart, Academy, Target, Home Depot/Lowes, Dollar General...just to name a few, not to mention DMV and other govt instances. I believe our state DMV alone has 1500 sites.
Yeah we are looking at alternatives to Vmware, so we are only looking at open source options at the moment. Openstack would likely be less than Vmware licensing, but also less feature-rich (or so I would guess). I'm getting an idea how to implement Proxmox for our environment, but will need to beat it up in the lab for a while to make sure it is viable.
at that scale, writing a custom integration/monitoring/management/.. solution on top of our API is probably the best way to go - you'll likely require it for some parts of your operation anyway, since neither the current PVE (cluster) GUI nor the upcoming cross-cluster management pane will cover all your bases.
https://pve.proxmox.com/wiki/Proxmox_VE_API
https://pve.proxmox.com/pve-docs/pve-admin-guide.html#pveum_tokens
https://pve.proxmox.com/pve-docs/api-viewer/index.html
probably contain some helpful information
https://pve.proxmox.com/wiki/Proxmox_VE_API
https://pve.proxmox.com/pve-docs/pve-admin-guide.html#pveum_tokens
https://pve.proxmox.com/pve-docs/api-viewer/index.html
probably contain some helpful information
So what's the point in proxmox if its hard limited to 32 nodes only https://pve-user.pve.proxmox.narkive.com/lyWg0aOB/how-many-nodes-can-there-be-in-a-proxmox-cluster
This is not a scalable solution at all!
This is not a scalable solution at all!
30 nodes is not that much. even we as a small company have had problems with this limi5s, resulting in operating several clusters.
this is one of the biggest disadvanteges of proxmox in my opinon.
this is one of the biggest disadvanteges of proxmox in my opinon.
Vmware it's 64 (but 32 for vSAN). That said, IMHO the cluster size doesn't matter much once you get past a dozen as long as you can manage multiple clusters from a single GUI and can vmotion cross clusters (both of which vmware has).