Hi everyone,
i am currently evaluating proxmox for a large cluster hosting 10.000 vms and above.
I read about in a forum post from 2018 that about 100.000 vms should be possible https://forum.proxmox.com/threads/maximum-number-of-vms-per-proxmox-server.47233/ but the number of nodes should be limited even though reports of 50+ node clusters seem to exist.
Currently running:
pve-manager/8.1.5
Linux 6.5.13-1-pve
In my testing with a single proxmox node i seem to have reached a limit of around 11.000 VMs before the pmxcfs file system says no more exits.
For this i created a vm with a 1GB disk as a template and created full clones via the api. All vms were off. Each vm config was around 400 bytes in size, so we shouldn´t reach any pmxcfs maximum size limits.
Meanwhile even at a couple of thousand vms the webui becomes very unresponsive. The proxmox server seems to be able to generate the resources json, which the webui parses, in about 1 second for about 10.000 hosts but parsing it in the browser takes quite a bit longer at around 20 seconds. Attached is a fIrefox profile image of a page refresh. The firefox tab is at 100% cpu load during this time.
Also the extract from journalctrl when the pve-cluster service exited at slightly above 11.000 cloned vms:
i am currently evaluating proxmox for a large cluster hosting 10.000 vms and above.
I read about in a forum post from 2018 that about 100.000 vms should be possible https://forum.proxmox.com/threads/maximum-number-of-vms-per-proxmox-server.47233/ but the number of nodes should be limited even though reports of 50+ node clusters seem to exist.
Currently running:
pve-manager/8.1.5
Linux 6.5.13-1-pve
In my testing with a single proxmox node i seem to have reached a limit of around 11.000 VMs before the pmxcfs file system says no more exits.
For this i created a vm with a 1GB disk as a template and created full clones via the api. All vms were off. Each vm config was around 400 bytes in size, so we shouldn´t reach any pmxcfs maximum size limits.
Meanwhile even at a couple of thousand vms the webui becomes very unresponsive. The proxmox server seems to be able to generate the resources json, which the webui parses, in about 1 second for about 10.000 hosts but parsing it in the browser takes quite a bit longer at around 20 seconds. Attached is a fIrefox profile image of a page refresh. The firefox tab is at 100% cpu load during this time.
Also the extract from journalctrl when the pve-cluster service exited at slightly above 11.000 cloned vms:
