LXC backup fails with "failed: exit code 23"

Ovidiu

Renowned Member
Apr 27, 2014
325
12
83
All other LXC backups are working just fine but this one gives:

Code:
INFO: starting new backup job: vzdump 104 --node james --compress lzo --mode snapshot --remove 0 --storage local
INFO: Starting Backup of VM 104 (lxc)
INFO: status = running
INFO: mode failure - some volumes do not support snapshots
INFO: trying 'suspend' mode instead
INFO: backup mode: suspend
INFO: ionice priority: 7
INFO: starting first sync /proc/19091/root// to /var/lib/vz/dump/vzdump-lxc-104-2016_03_31-22_56_10.tmp
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./mnt"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./usr"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./opt"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./media"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./etc"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./boot"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./lib64"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./bin"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./sbin"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./home"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./root"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./lib"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./srv"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./var"",0) failed: Operation not supported (95)
INFO: rsync: get_xattr_names: llistxattr(""/proc/19091/root/./tmp"",0) failed: Operation not supported (95)
INFO: IO error encountered -- skipping file deletion
INFO: Number of files: 7 (reg: 1, dir: 6)
INFO: Number of created files: 6 (reg: 1, dir: 5)
INFO: Number of deleted files: 0
INFO: Number of regular files transferred: 1
INFO: Total file size: 0 bytes
INFO: Total transferred file size: 0 bytes
INFO: Literal data: 0 bytes
INFO: Matched data: 0 bytes
INFO: File list size: 0
INFO: File list generation time: 0.001 seconds
INFO: File list transfer time: 0.000 seconds
INFO: Total bytes sent: 288
INFO: Total bytes received: 120
INFO: sent 288 bytes  received 120 bytes  816.00 bytes/sec
INFO: total size is 0  speedup is 0.00
INFO: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
ERROR: Backup of VM 104 failed - command 'rsync --stats -X -A --numeric-ids -aH --delete --no-whole-file --inplace --one-file-system --relative '--exclude=/var/log/?*' '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' /proc/19091/root///./ /var/lib/vz/dump/vzdump-lxc-104-2016_03_31-22_56_10.tmp' failed: exit code 23
INFO: Backup job finished with errors
TASK ERROR: job errors

Any ideas?
 
Please post the output of
  • pveversion -v
  • pct config 104
  • mount
 
Here you go:

Code:
#pveversion -v
proxmox-ve: 4.1-41 (running kernel: 4.2.8-1-pve)
pve-manager: 4.1-22 (running version: 4.1-22/aca130cf)
pve-kernel-4.2.8-1-pve: 4.2.8-41
pve-kernel-4.2.2-1-pve: 4.2.2-16
pve-kernel-4.2.3-2-pve: 4.2.3-22
lvm2: 2.02.116-pve2
corosync-pve: 2.3.5-2
libqb0: 1.0-1
pve-cluster: 4.0-36
qemu-server: 4.0-64
pve-firmware: 1.1-7
libpve-common-perl: 4.0-54
libpve-access-control: 4.0-13
libpve-storage-perl: 4.0-45
pve-libspice-server1: 0.12.5-2
vncterm: 1.2-1
pve-qemu-kvm: 2.5-9
pve-container: 1.0-52
pve-firewall: 2.0-22
pve-ha-manager: 1.0-25
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u1
lxc-pve: 1.1.5-7
lxcfs: 2.0.0-pve2
cgmanager: 0.39-pve1
criu: 1.6.0-1
zfsutils: 0.6.5-pve7~jessie

Code:
#pct config 104
arch: amd64
cpulimit: 2
cpuunits: 1024
hostname: drake.mydomain.co.za
memory: 2048
nameserver: 94.XXX.XXX.XXX 8.8.8.8
net0: bridge=vmbr0,gw=94.XXX.XXX.254,hwaddr=02:00:00:b1:6f:52,ip=51.XXX.XXX.84/28,ip6=dhcp,name=eth0,type=veth
onboot: 1
ostype: ubuntu
rootfs: local:104/vm-104-disk-1.raw,size=8G,acl=0
searchdomain: mydomain.co.za
swap: 0

Code:
sysfs on /sys type sysfs (rw,relatime)
proc on /proc type proc (rw,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=4101934,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,relatime,size=6568956k,mode=755)
/dev/sda2 on / type ext3 (rw,relatime,errors=remount-ro,data=ordered)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /sys/fs/cgroup type tmpfs (rw,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_ag
ent=/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset,clone_chil
dren)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls
,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event,re
lease_agent=/run/cgmanager/agents/cgm-release-agent.perf_event)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb,release_
agent=/run/cgmanager/agents/cgm-release-agent.hugetlb)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=23,pgrp=1,timeout=300,minpro
to=5,maxproto=5,direct)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext3 (rw,relatime,data=ordered)
rpc_pipefs on /run/rpc_pipefs type rpc_pipefs (rw,relatime)
cgmfs on /run/cgmanager/fs type tmpfs (rw,relatime,size=100k,mode=755)
tmpfs on /run/lxcfs/controllers type tmpfs (rw,relatime,size=100k,mode=700)
hugetlb on /run/lxcfs/controllers/hugetlb type cgroup (rw,relatime,hugetlb,release_agent=/run/
cgmanager/agents/cgm-release-agent.hugetlb)
perf_event on /run/lxcfs/controllers/perf_event type cgroup (rw,relatime,perf_event,release_ag
ent=/run/cgmanager/agents/cgm-release-agent.perf_event)
net_cls,net_prio on /run/lxcfs/controllers/net_cls,net_prio type cgroup (rw,relatime,net_cls,n
et_prio)
freezer on /run/lxcfs/controllers/freezer type cgroup (rw,relatime,freezer)
devices on /run/lxcfs/controllers/devices type cgroup (rw,relatime,devices)
memory on /run/lxcfs/controllers/memory type cgroup (rw,relatime,memory)
blkio on /run/lxcfs/controllers/blkio type cgroup (rw,relatime,blkio)
cpu,cpuacct on /run/lxcfs/controllers/cpu,cpuacct type cgroup (rw,relatime,cpu,cpuacct)
cpuset on /run/lxcfs/controllers/cpuset type cgroup (rw,relatime,cpuset,clone_children)
name=systemd on /run/lxcfs/controllers/name=systemd type cgroup (rw,relatime,xattr,release_age
nt=/lib/systemd/systemd-cgroups-agent,name=systemd)
lxcfs on /var/lib/lxcfs type fuse.lxcfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_o
ther)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permiss
ions,allow_other)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime)
 
Which template did you use to setup the container? What filesystem is in use as / in the container? I cannot reproduce this here, neither with zfs with turned off posixacls, nor with lvm-thin/ext4 nor with local/ext4 with acl=0.
 
That LXC container is: Operating system Linux 4.2.8-1-pve (Ubuntu 14.04)

mount shows:
/dev/loop4 on / type ext4 (rw,relatime,noacl,data=ordered)

After the basic installation I installed Streisand into it => https://github.com/jlund/streisand
That is all that was done to that container as far as I remember.

Thanks for looking into it.
 
Like I said, I have the exact same combination of file systems here (ext4 with noacl and your complete config in the container, ext3 with the same mount flags for backup) and it works as expected. The problem seems to be that rsync thinks that your container file system does not support xattrs. You can try turning acls on for the container's rootfs (and rebooting it for the setting to take effect), but it should work either way..
 
Hello guys, I have the same problem :

Code:
    support.econcept.local    FAILED    00:07:33    command 'rsync --stats --numeric-ids -aH --delete --no-whole-file --sparse --one-file-system --relative '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' /proc/3039/root///./ /mnt/pve/PVE_Backup/dump/vzdump-lxc-103-2017_08_28-20_19_09.tmp' failed: exit code 23

How can I enable acls ? I have many LXC container wich backup without error, but this one failed every backup !
 
this thread is about vzdump tar backups, not PBS - please open a new thread and clearly describe your issue:
- versions of PVE and PBS
- config of containers that fail to backup
- storage.cfg
- full backup task log
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!