PBS crash/freeze during backups to an S3 backed datastore

bzed_debian.org said:
I've built the current git version for trixie, no issues at all so far. Thanks for fixing the issue!

Packages - no warranties for your data or anything though - are here: https://shell.bzed.at/~bzed/.publish/2025-09-30-bEuCQ1zyb8o/
Click to expand...
I had the same problems with Hetzner S3 Objectstorage.

1. Fix - Provider Quirks - Skip If-None-Match header (VMs > 32GB Crash during Backup)

2. Fix - Install 4 patched PBS Debian Files on my PBS Server (Can't finish backup - Log hangs at 100%):
dpkg -i proxmox-backup-server_4.0.15-1_amd64.deb
dpkg -i proxmox-backup-client_4.0.15-1_amd64.deb
dpkg -i proxmox-backup-docs_4.0.15-1_all.deb
dpkg -i proxmox-backup-file-restore_4.0.15-1_amd64.deb

Now it's working perfect!

Best regards Stephan
 
Last edited:
shartenauer said:
I had the same problems with Hetzner S3 Objectstorage.

1. Fix - Provider Quirks - Skip If-None-Match header (VMs > 32GB Crash during Backup)

2. Fix - Install 4 patched PBS Debian Files on my PBS Server (Can't finish backup - Log hangs at 100%):
dpkg -i proxmox-backup-server_4.0.15-1_amd64.deb
dpkg -i proxmox-backup-client_4.0.15-1_amd64.deb
dpkg -i proxmox-backup-docs_4.0.15-1_all.deb
dpkg -i proxmox-backup-file-restore_4.0.15-1_amd64.deb

Best regards Stephan
Click to expand...

Did you restart the backup server service? The packages don't do that. Needs to be done manually or just reboot..
 
Then I'm out of clues - maybe just a result of too many slightly different S3 implementations. I'm using it with wasabi s3 and it just works well now.
 
bzed_debian.org said:
Then I'm out of clues - maybe just a result of too many slightly different S3 implementations. I'm using it with wasabi s3 and it just works well now.
Click to expand...
No, you misunderstood my reply, everything is fine now after I applied the patches to my PBS Server
 
Last edited:
I updated to the latest version within PBS today - not from the .debs you built bzed. I'm running 4.0.15 from the pbs no sub repo.

Unfortunately the issue still persists. It did seem to get a little further this time. But after about a minute the PBS web UI becomes unresponsive.

Tried with and without skip if non match header. I'm using AWS S3 as the backend.

Is there a difference between 4.0.15 in the no-subscription repo and the packages you built bzed?
 
lunchboxtheman said:
I updated to the latest version within PBS today - not from the .debs you built bzed. I'm running 4.0.15 from the pbs no sub repo.

Unfortunately the issue still persists. It did seem to get a little further this time. But after about a minute the PBS web UI becomes unresponsive.

Tried with and without skip if non match header. I'm using AWS S3 as the backend.

Is there a difference between 4.0.15 in the no-subscription repo and the packages you built bzed?
Click to expand...
proxmox-backup-server_4.0.15-1_amd64.deb 15-Sep-2025 20:05 34535460

the packages in the mirror are older than the patch - I just didn't update the version number because of lazyness :)
 
Chris said:
Please note that proxmox-backup-server 4.0.16-1 packages including several patches to fix possible deadlocks are also available in the pbs-test repo at the time of writing. To enable the test repo, see https://pbs.proxmox.com/docs/installation.html#proxmox-backup-test-repository.
Click to expand...
Thank you. I installed 4.0.16-1 from the pbs-test repo. Unfortunately, it does not fix the issue. Running the sync job on my aws s3-backed datastore still hangs pbs and requires a reboot.
 
lunchboxtheman said:
Thank you. I installed 4.0.16-1 from the pbs-test repo. Unfortunately, it does not fix the issue. Running the sync job on my aws s3-backed datastore still hangs pbs and requires a reboot.
Click to expand...
Please install the PBS debug symbols on you system and try to generate a backtrace when the sync job hangs the next time as described here.
 
Here you go. I ran the sync, it hung. I let it sit for a minute or so then killed the PBS server. Looks like some memory addressing issues?

Of note - I'm running PBS in an unprivileged LXC on PVE. Used the debian 13 trixie LXC template available from pve-am - didn't do anything funky there. Everything else works great.

Hope this helps and thank you for being so engaged!
 

Attachments

You must log in or register to reply here.
Top Bottom