Concurrent backup question

karnalta

Member
Jan 25, 2024
16
1
8
Hello,

I am starting to do backup to S3 storage additionally to my local storage (all by PBS).

Smaller VM has been scheduled during weekend while daily local backup does not run.

Now it's time to make the initial backup of a large file server VM and with our slow internet connectivity, it's probably going to take a week..

I was wondering what's going to happen when the daily backup will trigger and that VM will still be locked in backup state ? I will miss all daily backup for a week (which is not an option) ?

Is there another way to handle this ?

Initially I wanted to do a sync job of the local PBS datastore, but it seem you can only PUSH sync to a "remote" and not to a "s3 endpoint". So I just rolled another sets of backup job in Proxmox with the S3 repository as target.

Thank for your help.
 
Hello,

I am starting to do backup to S3 storage additionally to my local storage (all by PBS).

Smaller VM has been scheduled during weekend while daily local backup does not run.

Now it's time to make the initial backup of a large file server VM and with our slow internet connectivity, it's probably going to take a week..

I was wondering what's going to happen when the daily backup will trigger and that VM will still be locked in backup state ? I will miss all daily backup for a week (which is not an option) ?

Yes, new backups of VMs with exclusive backup lock will fail.

Is there another way to handle this ?

Initially I wanted to do a sync job of the local PBS datastore, but it seem you can only PUSH sync to a "remote" and not to a "s3 endpoint". So I just rolled another sets of backup job in Proxmox with the S3 repository as target.

You can already setup either a push or pull sync job from the local datastore to the one which is backed by the s3 endpoint.
 
You can already setup either a push or pull sync job from the local datastore to the one which is backed by the s3 endpoint.

Correct me if I am wrong but you can only set a sync job to another (remote) Proxmox Backup Server ?

My target storage is just a Wasabi S3 storage account, there is no remote PBS server.
 
Correct me if I am wrong but you can only set a sync job to another (remote) Proxmox Backup Server ?
You can setup a local pull sync job from the non-s3 datastore to the datastore backed by the s3 endpoint, by this you do not even need to configure the PBS as it's own remote (which you would need to when doing push sync jobs).

My target storage is just a Wasabi S3 storage account, there is no remote PBS server.
You will have to use this to configure an s3 endpoint on the PBS instance (if you do not have it already) and use it to back the s3 datastore.