[Proxmox Backup] Backups fail to lock file

H

hac3ru

Well-Known Member
Mar 6, 2021
63
2
48
34
Hello,

I have a large proxmox cluster but with only three nodes (three physical hosts that run hundreds of VMs). I have a PBS and I would really love to take backups of ALL my VMs nightly. Unfortunately, I can only run the backups in a relatively short period of time (from 23:00 to 06:00) so about seven hours. The problem is that if I try to take a backup of all the VMs in this short window, they won't finish in time, as I have lots of "waiting for lock" in place (backing up based on pools, so some backups are running while others are waiting for locks).
Can't we have multiple backup processes run in parallel at the same time? How do people usually take backups of a ton of VMs in a relatively short period of time?

Thank you!
 
I think set up the Proxmox Backup Server Cluster so you can run simultas more jobs.
Your Backup Network must be fast enough for this job.
Basis Proxmox Server VE file system must be ZFS and your Proxmox Backup Server run on NVMe and SSD only.
And after that you can sync to each Proxmox Backup Server your data.
 
Last edited:
Hey guys,
Thanks for the reply.

@Onslow As I understood it, fleecing only helps if there's a lot of writes during the backup - which is not the case for me. During nightime almost no data is being updated. Am I wrong in my understanding?

@news Proxmox Backup Server Cluster?! You mean running PBS on multiple VMs and then do the sync across the PBS? That's.....
The network is fast enough, that's not an issue (running a 100Gbps inter-servers and the NASes). The problem is that PVE is only running one backup process at a time, and if you've got a ton of VMs in the pools the backups run sequentially, which is suboptimal.
 
You must log in or register to reply here.
Top Bottom
Back