LXC backup isses and Backup job errors

[AT_WL82]

Hey guys, any thoughts on this issue

Steps I clear

Backups runs to an NFS share call RUNNING, remotely

Permissions are ok on that NFS

Space enough

Some VMs save to that NFS too with no issue

Use to be working for a while I think after update gets bad because since may it doesn't work

It’s also been happening to me in others server also that I don’t touch for a while

Create a temp dir on vzdump.conf



Backup LOG

INFO: starting new backup job: vzdump 403 --fleecing 0 --notes-template '{{guestname}}' --compress zstd --node orion --mode snapshot --all 0 --storage LXC
INFO: Starting Backup of VM 403 (lxc)
INFO: Backup started at 2024-09-27 11:16:15
INFO: status = running
INFO: CT Name: sh-omada
INFO: including mount point rootfs ('/') in backup
INFO: mode failure - some volumes do not support snapshots
INFO: trying 'suspend' mode instead
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: CT Name: sh-omada
INFO: including mount point rootfs ('/') in backup
INFO: temporary directory is on NFS, disabling xattr and acl support, consider configuring a local tmpdir via /etc/vzdump.conf
INFO: starting first sync /proc/581473/root/ to /mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tmp
INFO: first sync finished - transferred 2.06G bytes in 113s
INFO: suspending guest
INFO: starting final sync /proc/581473/root/ to /mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tmp
INFO: final sync finished - transferred 110.64M bytes in 7s
INFO: resuming guest
INFO: guest is online again after 7 seconds
INFO: creating vzdump archive '/mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tar.zst'
INFO: tar: /mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tmp: Cannot open: Permission denied
INFO: tar: Error is not recoverable: exiting now
ERROR: Backup of VM 403 failed - command 'set -o pipefail && lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- tar cpf - --totals --one-file-system -p --sparse --numeric-owner --acls --xattrs '--xattrs-include=user.*' '--xattrs-include=security.capability' '--warning=no-file-ignored' '--warning=no-xattr-write' --one-file-system '--warning=no-file-ignored' '--directory=/mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tmp' ./etc/vzdump/pct.conf ./etc/vzdump/pct.fw '--directory=/mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tmp' --no-anchored '--exclude=lost+found' --anchored '--exclude=./tmp/?*' '--exclude=./var/tmp/?*' '--exclude=./var/run/?*.pid' . | zstd '--threads=1' >/mnt/pve/LXC/dump/vzdump-lxc-403-2024_09_27-11_16_15.tar.dat' failed: exit code 2
INFO: Failed at 2024-09-27 11:18:37
INFO: Backup job finished with errors
TASK ERROR: job errors





vzdum.conf

# vzdump default settings



#tmpdir: /mnt/pve/VAULT/dump

#dumpdir: DIR

#storage: STORAGE_ID

#mode: snapshot|suspend|stop

#bwlimit: KBPS

#performance: [max-workers=N][,pbs-entries-max=N]

#ionice: PRI

#lockwait: MINUTES

#stopwait: MINUTES

#stdexcludes: BOOLEAN

#mailto: ADDRESSLIST

#prune-backups: keep-INTERVAL=N[,...]

#script: FILENAME

#exclude-path: PATHLIST

#pigz: N

#notes-template: {{guestname}}

#pbs-change-detection-mode: legacy|data|metadata

#fleecing: enabled=BOOLEAN,storage=STORAGE_ID

 

[ITandAutomation]

why do you know that the permissions are ok?
In the logs it says that it is a permission error.

 

[AT_WL82]

# ls -ld /mnt/pve/RUNNING/dump
drwxrwxrwx 1 root root 89524 Sep 26 23:22 /mnt/pve/RUNNING/dump

 

[AT_WL82]

I think is a bug

 

[AT_WL82]

1. On NFS for me does not work neither with a none compression option, but I mount the same folder as SMB/CIFS as I had it before with ZSTD compression and work fast and good
   
   
   
   
   
2. [1:38 PM]
   ()INFO: starting new backup job: vzdump 403 --node orion --compress zstd --fleecing 0 --notes-template '{{guestname}}' --storage LXC-SMB --all 0 --mode snapshotINFO: filesystem type on dumpdir is 'cifs' -using /var/tmp/vzdumptmp1581198_403 for temporary filesINFO: Starting Backup of VM 403 (lxc)INFO: Backup started at 2024-09-27 13:35:02INFO: status = runningINFO: CT Name: sh-omadaINFO: including mount point rootfs ('/') in backupINFO: mode failure - some volumes do not support snapshotsINFO: trying 'suspend' mode insteadINFO: backup mode: suspendINFO: ionice priority: 7INFO: CT Name: sh-omadaINFO: including mount point rootfs ('/') in backupINFO: starting first sync /proc/581473/root/ to /var/tmp/vzdumptmp1581198_403INFO: first sync finished - transferred 2.06G bytes in 15sINFO: suspending guestINFO: starting final sync /proc/581473/root/ to /var/tmp/vzdumptmp1581198_403INFO: final sync finished - transferred 14.11K bytes in 2sINFO: resuming guestINFO: guest is online again after 2 secondsINFO: creating vzdump archive '/mnt/pve/LXC-SMB/dump/vzdump-lxc-403-2024_09_27-13_35_02.tar.zst'INFO: Total bytes written: 1788835840 (1.7GiB, 60MiB/s)INFO: archive file size: 859MBINFO: adding notes to backupINFO: Finished Backup of VM 403 (00:00:51)INFO: Backup finished at 2024-09-27 13:35:53INFO: Backup job finished successfullyTASK OK
   
   
   
   
   
3. [1:39 PM]
   Solution for now honestly I prefer NFS

 

[AT_WL82]

NFS definitely has an issue

 

[AT_WL82]

it looks like nfs does not support xattr at this time

 

[tl5k5]

I've had this same issue since v7 backing up to TrueNAS NFS shares. SMB backups work fine to the same storage location.

ERROR: Backup of VM 303 failed - command 'set -o pipefail && lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- tar cpf - --totals --one-file-system -p --sparse --numeric-owner --acls --xattrs '--xattrs-include=user.*' '--xattrs-include=security.capability' '--warning=no-file-ignored' '--warning=no-xattr-write' --one-file-system '--warning=no-file-ignored' '--directory=/mnt/pve/NAS-NFS/dump/vzdump-lxc-303-2024_10_09-01_30_07.tmp' ./etc/vzdump/pct.conf ./etc/vzdump/pct.fw '--directory=/mnt/vzsnap0' --no-anchored '--exclude=lost+found' --anchored '--exclude=./tmp/?*' '--exclude=./var/tmp/?*' '--exclude=./var/run/?*.pid' ./ | zstd --rsyncable '--threads=1' >/mnt/pve/NAS-NFS/dump/vzdump-lxc-303-2024_10_09-01_30_07.tar.dat' failed: exit code 2