[SOLVED] Cannot backup only LXC to NFS, VM works

jsalas424

Active Member
Jul 5, 2020
142
3
38
34
I recently started a cluster and am sharing directories mounted at ZFS via NFS.

Here are my config details. I am on 192.168.1.24 and am mounting a share from 192.168.1.129
root@TracheNodeA:~# cat /etc/fstab
# <file system> <mount point> <type> <options> <dump> <pass>
/dev/pve/root / ext4 errors=remount-ro 0 1
UUID=956D-B105 /boot/efi vfat defaults 0 1
/dev/pve/swap none swap sw 0 0
proc /proc proc defaults 0 0

# NFS Share of new_ssd from TracheServ
#192.168.1.129:/new_ssd /new_ssd nfs defaults 0 0
192.168.1.129:/new_ssd/shared/dir /new_ssd/shared/dir nfs defaults 0 0
#192.168.1.129:/Nextcloud.Storage /Nextcloud.Storage nfs defaults 0 0
192.168.1.129:/Nextcloud.Storage/User.Data.Backups /Nextcloud.Storage/User.Data.Backups nfs defaults 0 0
192.168.1.129:/Nextcloud.Storage/NC.VM.Backups /Nextcloud.Storage/NC.VM.Backups nfs defaults 0 0

root@TracheNodeA:~# showmount -e 192.168.1.129
Export list for 192.168.1.129:
/Nextcloud.Storage/NC.VM.Backups (everyone)
/Nextcloud.Storage/User.Data.Backups (everyone)
/Nextcloud.Storage 192.168.1.24/32
/new_ssd/shared/dir (everyone)

This is the error I get when backing up my LXC
INFO: starting new backup job: vzdump 100 300 500 700 --quiet 1 --mailnotification failure --storage NC.VM.Backups.dir --all 0 --node TracheNodeA --mode snapshot --compress zstd
INFO: Starting Backup of VM 100 (lxc)
INFO: Backup started at 2021-06-12 07:32:27
INFO: status = running
INFO: CT Name: AdGuard
INFO: including mount point rootfs ('/') in backup
INFO: mode failure - some volumes do not support snapshots
INFO: trying 'suspend' mode instead
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: CT Name: AdGuard
INFO: including mount point rootfs ('/') in backup
INFO: temporary directory is on NFS, disabling xattr and acl support, consider configuring a local tmpdir via /etc/vzdump.conf
INFO: starting first sync /proc/1277/root/ to /Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tmp
INFO: first sync finished - transferred 1.57G bytes in 81s
INFO: suspending guest
INFO: starting final sync /proc/1277/root/ to /Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tmp
INFO: final sync finished - transferred 0 bytes in 3s
INFO: resuming guest
INFO: guest is online again after 3 seconds
INFO: creating vzdump archive '/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tar.zst'
INFO: tar: ./var/lib/apt/lists/partial: Cannot open: Permission denied
INFO: tar: ./var/lib/postfix/master.lock: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/maildrop: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/private: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/flush: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/incoming: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/active: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/bounce: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/saved: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/defer: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/trace: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/deferred: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/hold: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/corrupt: Cannot open: Permission denied
INFO: tar: ./var/spool/postfix/public: Cannot open: Permission denied
INFO: tar: ./var/cache/apt/archives/partial: Cannot open: Permission denied
INFO: Total bytes written: 1585172480 (1.5GiB, 32MiB/s)
INFO: tar: Exiting with failure status due to previous errors
ERROR: Backup of VM 100 failed - command 'set -o pipefail && lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- tar cpf - --totals --one-file-system -p --sparse --numeric-owner --acls --xattrs '--xattrs-include=user.*' '--xattrs-include=security.capability' '--warning=no-file-ignored' '--warning=no-xattr-write' --one-file-system '--warning=no-file-ignored' '--directory=/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tmp' ./etc/vzdump/pct.conf ./etc/vzdump/pct.fw '--directory=/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tmp' --no-anchored '--exclude=lost+found' --anchored '--exclude=./tmp/?*' '--exclude=./var/tmp/?*' '--exclude=./var/run/?*.pid' . | zstd --rsyncable '--threads=1' >/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_12-07_32_27.tar.dat' failed: exit code 2
INFO: Failed at 2021-06-12 07:35:07
INFO: Starting Backup of VM 500 (qemu)
INFO: Backup started at 2021-06-12 07:35:07
INFO: status = running
INFO: VM Name: WireGuard
INFO: include disk 'scsi0' 'local:500/vm-500-disk-0.qcow2' 10G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-qemu-500-2021_06_12-07_35_07.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task 'feed7e33-1ffb-407f-b9f1-387d3a9ed4ad'
INFO: resuming VM again
INFO: 7% (768.5 MiB of 10.0 GiB) in 3s, read: 256.2 MiB/s, write: 156.0 MiB/s
INFO: 13% (1.4 GiB of 10.0 GiB) in 6s, read: 209.0 MiB/s, write: 156.0 MiB/s
INFO: 22% (2.3 GiB of 10.0 GiB) in 9s, read: 315.4 MiB/s, write: 148.2 MiB/s
INFO: 45% (4.6 GiB of 10.0 GiB) in 12s, read: 774.5 MiB/s, write: 131.7 MiB/s
INFO: 52% (5.2 GiB of 10.0 GiB) in 15s, read: 235.9 MiB/s, write: 138.7 MiB/s
INFO: 59% (6.0 GiB of 10.0 GiB) in 18s, read: 242.6 MiB/s, write: 148.3 MiB/s
INFO: 65% (6.6 GiB of 10.0 GiB) in 21s, read: 217.5 MiB/s, write: 147.8 MiB/s
INFO: 70% (7.1 GiB of 10.0 GiB) in 24s, read: 158.3 MiB/s, write: 142.2 MiB/s
INFO: 76% (7.7 GiB of 10.0 GiB) in 27s, read: 201.8 MiB/s, write: 148.0 MiB/s
INFO: 82% (8.2 GiB of 10.0 GiB) in 30s, read: 197.0 MiB/s, write: 131.6 MiB/s
INFO: 87% (8.8 GiB of 10.0 GiB) in 33s, read: 194.5 MiB/s, write: 143.6 MiB/s
INFO: 92% (9.2 GiB of 10.0 GiB) in 36s, read: 142.6 MiB/s, write: 129.1 MiB/s
INFO: 100% (10.0 GiB of 10.0 GiB) in 39s, read: 268.0 MiB/s, write: 127.5 MiB/s
INFO: backup is sparse: 4.58 GiB (45%) total zero data
INFO: transferred 10.00 GiB in 39 seconds (262.6 MiB/s)
INFO: archive file size: 2.29GB
INFO: Finished Backup of VM 500 (00:00:53)
INFO: Backup finished at 2021-06-12 07:36:00
INFO: Backup job finished with errors
TASK ERROR: job errors
 
If you want to backup privileged LXCs you need to make sure that the LXCs root user (propably mapped to UID 100000 on the host) has rights to write to your backup storage.
Like the message already tried to tell you...
INFO: temporary directory is on NFS, disabling xattr and acl support, consider configuring a local tmpdir via /etc/vzdump.conf
... you could edit the "/etc/vzdump.conf" and add a line like tmpdir: /tmp. That way the temporary files would be saved to "/tmp" which got chmod 777 so everyone can write there instead directly writing it to your NFS share.
 
If you want to backup privileged LXCs you need to make sure that the LXCs root user (propably mapped to UID 100000 on the host) has rights to write to your backup storage.
Like the message already tried to tell you...

... you could edit the "/etc/vzdump.conf" and add a line like tmpdir: /tmp. That way the temporary files would be saved to "/tmp" which got chmod 777 so everyone can write there instead directly writing it to your NFS share.
This is an unprivileged container, I'm not sure how much that changes this.

1623526615251.png
 
Sorry I mean unprivileged LXC not privileged.
LXC UID is mapped to 0
Code:
root@AdGuard:~# id
uid=0(root) gid=0(root) groups=0(root)

Same as it's host (Cluster node)
Code:
root@TracheNodeA:~# id
uid=0(root) gid=0(root) groups=0(root)

And same as the NFS host
Code:
root@TracheServ:~# id
uid=0(root) gid=0(root) groups=0(root)
 
... you could edit the "/etc/vzdump.conf" and add a line like tmpdir: /tmp. That way the temporary files would be saved to "/tmp" which got chmod 777 so everyone can write there instead directly writing it to your NFS share.
Did you tried that?
 
Did you tried that?
Thanks, that worked!

Code:
INFO: starting new backup job: vzdump 100 300 500 700 --compress zstd --mailnotification failure --quiet 1 --all 0 --storage NC.VM.Backups.dir --mailto --mode snapshot --node TracheNodeA
INFO: Starting Backup of VM 100 (lxc)
INFO: Backup started at 2021-06-13 11:57:05
INFO: status = running
INFO: CT Name: AdGuard
INFO: including mount point rootfs ('/') in backup
INFO: mode failure - some volumes do not support snapshots
INFO: trying 'suspend' mode instead
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: CT Name: AdGuard
INFO: including mount point rootfs ('/') in backup
INFO: starting first sync /proc/1270/root/ to /tmp/vzdumptmp11179_100/
INFO: first sync finished - transferred 1.58G bytes in 5s
INFO: suspending guest
INFO: starting final sync /proc/1270/root/ to /tmp/vzdumptmp11179_100/
INFO: final sync finished - transferred 0 bytes in 1s
INFO: resuming guest
INFO: guest is online again after 1 seconds
INFO: creating vzdump archive '/Nextcloud.Storage/NC.VM.Backups/dump/vzdump-lxc-100-2021_06_13-11_57_05.tar.zst'
INFO: Total bytes written: 1602764800 (1.5GiB, 218MiB/s)
INFO: archive file size: 383MB
INFO: Finished Backup of VM 100 (00:00:15)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!