Deploy up to 40 instances in a parallel processes

[al124578]

Hi,

Im trying to deploy up to 40 instances simultaneously,
i get errors, try to contact the support, it seems an issue with proxmox or my hardware,
my quotation if somebody her try that and subsided to do that?
I only subsided to deploy 10.

 

[bbgeek17]

You'd need to define what "simultaneously" means to you.
Are you actually doing something similar to "parallel -j0 echo qm create {} ::: {1..100}"?
Are you using CLI or API?
Is this against a single host or a cluster?
Are you deploying from template?
Does deploy include starting the instance?
What type of storage are you using behind it?
Is it possible? Yes, with careful planning and appropriate resources. Things to watch out are system locks at various points in "deploy", ie:
- storage creation
- vm start up
- overloading the system if its a single host
- taking care of spreading the creates across multiple nodes if its a cluster

Have you examined and understood the errors - what system limitation are they pointing to?

Here is an example of creating a 100 empty VMs in parallel being run on a nested virtualized PVE

Spoiler: output

root@pve7demo1:~# time parallel -j0 qm create {} ::: {200..300}
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK
trying to acquire lock...
OK

real 0m6.342s
user 0m58.003s
sys 0m7.675s

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox