Feature request: parallel/concurrent backup jobs

Andreas_H

Member
Jan 6, 2021
16
2
8
46
Hello,

I would like to know if it is theoretically possible to implement multiple backup jobs running in parallel. I am thinking of two backups, one local backup to a USB drive or NAS and another backup to a remote PBS.

We are quite happy with our PBS, where we backup multiple sites to our central office. However, we used to do local backups as well to USB drives, which are rotated on a weekly schedule. On some sites, the amount of data to be backed up has grown so large that it will take all night to backup to PBS over a DSL uplink (40 MBit/s). Currently it is impossible to run the local backup in parallel, we have to find a schedule that will guarantee under all circumstances that the PBS backup is finished before the local backup is run (or vice versa).

Additionally, in some cases, e.g. when the dirty bitmap is lost, backups to the PBS will take more than 24 hours, so we don't have a current (local) backup until this is finished.

Is there any way to improve this?

Yes, we could run a local PBS on every site and sync that to the remote one, but that is too expensive for our case.
 
Hi,
unfortunately, I don't think there is a good workaround currently, except the one you mentioned with multiple PBS instances (maybe use virtualized local instances? - but has it's own downsides of course). Feel free to add your use case to the existing feature request, but it sounds like you'd like to backup the same VM to different storages at the same time which is even more difficult to implement.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!