Error when removing backup for one backup job since a couple of days

[peterge]

...
INFO:  98% (294.1 GiB of 300.0 GiB) in 3h 15m 20s, read: 75.3 MiB/s, write: 67.5 MiB/s
INFO:  99% (297.0 GiB of 300.0 GiB) in 3h 16m 41s, read: 36.3 MiB/s, write: 27.6 MiB/s
INFO: 100% (300.0 GiB of 300.0 GiB) in 3h 17m 45s, read: 47.8 MiB/s, write: 30.8 MiB/s
INFO: backup is sparse: 37.91 GiB (12%) total zero data
INFO: transferred 300.00 GiB in 11865 seconds (25.9 MiB/s)
INFO: archive file size: 207.39GB
INFO: adding notes to backup
INFO: prune older backups with retention: keep-daily=2
INFO: removing backup 'DasiCGN:backup/vzdump-qemu-123-2024_06_28-23_00_02.vma.zst'
ERROR: error when removing backup 'DasiCGN:backup/vzdump-qemu-123-2024_06_28-23_00_02.vma.zst' - removing archive /mnt/pve/DasiCGN/dump/vzdump-qemu-123-2024_06_28-23_00_02.vma.zst failed: Resource temporarily unavailable
ERROR: Backup of VM 123 failed - error pruning backups - check log
INFO: Failed at 2024-07-01 02:22:07
INFO: Backup job finished with errors
TASK ERROR: job errors

Hello, since a couple of days we receive this error in the daily backup job of our VM 123 & 143 (on another proxmox host, so in a different job log). First I checked the other backup jobs and saw that our other backup job starts at 2:00. I changed the other job to start at 3:00, but now this error still shows up.

This is what the Datacenter > Backup page currently looks like:


I do not know why this error keeps showing up, and why it only shows up on two of these VMs & LXCs that get backed up every night.

 

[peterge]

This error still occurs on a daily basis, now I have scheduled the first job to begin at 04:00, while the other still starts at 23:00:

INFO:  99% (298.0 GiB of 300.0 GiB) in 3h 4m 22s, read: 48.6 MiB/s, write: 23.8 MiB/s
INFO: 100% (300.0 GiB of 300.0 GiB) in 3h 4m 23s, read: 2.0 GiB/s, write: 0 B/s
INFO: backup is sparse: 21.13 GiB (7%) total zero data
INFO: transferred 300.00 GiB in 11063 seconds (27.8 MiB/s)
INFO: archive file size: 195.09GB
INFO: adding notes to backup
INFO: prune older backups with retention: keep-daily=2
INFO: removing backup 'DasiCGN:backup/vzdump-qemu-143-2024_06_30-23_47_50.vma.zst'
ERROR: error when removing backup 'DasiCGN:backup/vzdump-qemu-143-2024_06_30-23_47_50.vma.zst' - removing archive /mnt/pve/DasiCGN/dump/vzdump-qemu-143-2024_06_30-23_47_50.vma.zst failed: Resource temporarily unavailable
ERROR: Backup of VM 143 failed - error pruning backups - check log
INFO: Failed at 2024-07-03 03:01:51

 

[peterge]

Meanwhile this problem is occuring on 4 VMs, the logs are the same:


Any idea whats causing this?

 

[peterge]

I am able to remove the files via the synology webui just fine. Only the log & notes file are left, the huge zst file gets removed just fine...

(123 is the CrefoKI VM)


Is there any way to surpress this kind of errors? But I fear that I do not recognize any real failures if I just mute them...

 

[peterge]

• Enable Opportunistic Locking: Select to enable "Opportunistic Locking" of SMB, so that the client can better cache file contents and avoid small read/write overhead. When this option is deselected, database applications will perform better in accessing database files stored on the Synology NAS via network.
  • Enable SMB2 lease: Enabling this option allows more SMB2-related settings to fine-tune the client caching mechanism provided by Opportunistic Locking.

I cleared the SMB Cache and diasbled Opportunistic Locking in the File Share on our Synology NAS. Maybe this will help...

 

[peterge]

INFO: removing backup 'DasiCGN:backup/vzdump-qemu-33162-2024_07_12-23_00_03.vma.zst'
ERROR: error when removing backup 'DasiCGN:backup/vzdump-qemu-33162-2024_07_12-23_00_03.vma.zst' - removing archive /mnt/pve/DasiCGN/dump/vzdump-qemu-33162-2024_07_12-23_00_03.vma.zst failed: Resource temporarily unavailable
ERROR: Backup of VM 33162 failed - error pruning backups - check log

The SMB log shows that the Delete was executed just fine. But there is a Rename for the notes file, which seems to cause the errors...
The only files that are left when searching for

vzdump-qemu-33162-2024_07_12-23_00_03

are the .log & the .notes file:

 

[peterge]

View attachment 71359

I cleared the SMB Cache and diasbled Opportunistic Locking in the File Share on our Synology NAS. Maybe this will help...

I do not know if clearing Cache or disabling locking on the Synology did fix my problem, but on of both things did help. I did not experience this problem for the last 4 days.