Snapshot backup of LXC: Exit code 23

mfkrause

New Member
Dec 23, 2022
4
0
1
Hello,

I'm currently setting up backup jobs for a PVE host. While the VMs work fine, I'm running into some trouble with an LXC. The jobs all fail with exit code 23 at this rsync command:
Bash:
rsync --stats -h --numeric-ids -aH --delete --no-whole-file --sparse --one-file-system --relative '--exclude=/tmp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' /proc/61351/root//./ /mnt/pve/nfsbackup/dump/vzdump-lxc-102-2022_12_23-10_03_17.tmp

I have tried running this manually from the container and narrowed the issue down to the /dev, /proc and /sys directories:
Code:
/ # rsync --stats -h --numeric-ids -aH --delete --no-whole-file --sparse --one-file-system --relative '--exclude=/t
mp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' /dev /root/vzdump-lxc-102-2022_12_23-10_03_17.tmp
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.console.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.full.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.null.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.ptmx.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.random.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.tty.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.tty1.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.tty2.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.urandom.743" failed: Operation not permitted (1)
rsync: [generator] mknod "/root/vzdump-lxc-102-2022_12_23-10_03_17.tmp/dev/.zero.743" failed: Operation not permitted (1)

Number of files: 19 (reg: 1, dir: 3, link: 4, dev: 10, special: 1)
Number of created files: 9 (reg: 1, dir: 3, link: 4, special: 1)
Number of deleted files: 0
Number of regular files transferred: 1
Total file size: 95 bytes
Total transferred file size: 37 bytes
Literal data: 37 bytes
Matched data: 0 bytes
File list size: 0
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 589
Total bytes received: 69

sent 589 bytes  received 69 bytes  1.32K bytes/sec
total size is 95  speedup is 0.14
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1336) [sender=3.2.7]

/ # rsync --stats -h --numeric-ids -aH --delete --no-whole-file --sparse --one-file-system --relative '--exclude=/t
mp/?*' '--exclude=/var/tmp/?*' '--exclude=/var/run/?*.pid' /proc /root/vzdump-lxc-102-2022_12_23-10_03_17.tmp
rsync: [sender] read errors mapping "/proc/cpuinfo": No data available (61)
rsync: [sender] send_files failed to open "/proc/kcore": Permission denied (13)
rsync: [sender] read errors mapping "/proc/stat": No data available (61)
rsync: [sender] read errors mapping "/proc/swaps": No data available (61)
rsync: [sender] send_files failed to open "/proc/sysrq-trigger": Permission denied (13)
rsync: [sender] read errors mapping "/proc/uptime": No data available (61)
rsync: [sender] read errors mapping "/proc/cpuinfo": No data available (61)
ERROR: proc/cpuinfo failed verification -- update discarded.
rsync: [sender] read errors mapping "/proc/stat": No data available (61)
rsync: [sender] read errors mapping "/proc/swaps": No data available (61)
rsync: [sender] read errors mapping "/proc/uptime": No data available (61)
ERROR: proc/stat failed verification -- update discarded.
ERROR: proc/swaps failed verification -- update discarded.
ERROR: proc/uptime failed verification -- update discarded.
file has vanished: "/proc/745/fdinfo/3"
file has vanished: "/proc/745/task/745/fdinfo/3"
rsync: [sender] send_files failed to open "/proc/acpi/wakeup": Permission denied (13)
rsync: [sender] send_files failed to open "/proc/sys/net/ipv4/route/flush": Permission denied (13)
rsync: [sender] send_files failed to open "/proc/sys/net/ipv6/route/flush": Permission denied (13)
rsync: [sender] send_files failed to open "/proc/sys/vm/compact_memory": Permission denied (13)
rsync: [sender] send_files failed to open "/proc/sys/vm/drop_caches": Permission denied (13)

Number of files: 9,406 (reg: 7,005, dir: 1,017, link: 1,384)
Number of created files: 9,406 (reg: 7,005, dir: 1,017, link: 1,384)
Number of deleted files: 0
Number of regular files transferred: 7,009
Total file size: 140.74T bytes
Total transferred file size: 140.74T bytes
Literal data: 101.81K bytes
Matched data: 0 bytes
File list size: 65.55K
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 615.83K
Total bytes received: 141.54K

sent 615.83K bytes  received 141.54K bytes  1.51M bytes/sec
total size is 140.74T  speedup is 185,824,423.17
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1336) [sender=3.2.7]

The error log from the /sys directory is too long to post here, but boils down to a lot of the same errors on different files. Excerpt:
Code:
rsync: [sender] read errors mapping "/sys/module/zfs/properties.dataset/sharenfs/type": No data available (61)
rsync: [sender] read errors mapping "/sys/module/zfs/properties.dataset/sharenfs/values": No data available (61)
rsync: [sender] read errors mapping "/sys/module/zfs/properties.dataset/sharenfs/visible": No data available (61)
rsync: [sender] read errors mapping "/sys/module/zfs/properties.dataset/sharesmb/datasets": No data available (61)

Any suggestions? This also happens with the "Suspend" backup option, by the way. A backup using a full stop of the system works. Here's the container config:
Code:
root@eros:~# pct config 102
arch: amd64
cmode: shell
cores: 1
hostname: nginx
memory: 1024
net0: name=eth0,bridge=vmbr1,hwaddr=[snip],ip=dhcp,type=veth
net1: name=eth1,bridge=vmbr0,firewall=1,gw6=[snip],hwaddr=[snip],ip6=[snip],type=veth
onboot: 1
ostype: alpine
rootfs: local:102/vm-102-disk-0.raw,size=8G
swap: 0
tags: npm
lxc.hook.mount: sh -c 'ln -fs $(readlink /etc/localtime) ${LXC_ROOTFS_MOUNT}/etc/localtime'
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!