Hello,
sometimes i have this trouble with LXC on ZFS and backup.
The Backup process seem freezed and the virtual machine is inaccessible.
I Have to do a Kill -15 to the Backup process and reboot the container.
The backup is small, 16G on a SATA Hard disk directly connected.
----------------------------------------------------------------------------------------------------------------------------
Syslog:
Feb 16 07:59:37 prx9 vzdump[12601]: ERROR: Backup of VM 100 failed - VM is locked (snapshot)
Feb 16 07:59:37 prx9 vzdump[12601]: INFO: Backup job finished with errors
Feb 16 07:59:37 prx9 vzdump[12601]: job errors
..
Feb 16 08:00:27 prx9 pct[24143]: stopping CT 100: UPID
rx9:00005E4F:1C965B15:56C2C90B:vzstop:100:root@pam:
Feb 16 08:00:28 prx9 pvedaemon[16060]: unable to get PID for CT 100 (not running?)
..
Feb 16 08:00:44 prx9 kernel: [4796429.951010] audit: type=1400 audit(1455606044.920:1440): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/fs/pstore/" pid=24447 comm="mount" fstype="pstore" srcname="pstore" flags="rw"
Feb 16 08:00:44 prx9 kernel: [4796429.951097] audit: type=1400 audit(1455606044.920:1441): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/fs/pstore/" pid=24447 comm="mount" fstype="pstore" srcname="pstore" flags="ro"
Feb 16 08:00:45 prx9 kernel: [4796430.121814] audit: type=1400 audit(1455606045.088:1442): apparmor="DENIED" operation="mount" info="failed flags match" error=-13 profile="lxc-container-default" name="/" pid=24556 comm="mount" flags="rw, remount, silent"
Feb 16 08:00:45 prx9 kernel: [4796430.208032] audit: type=1400 audit(1455606045.176:1445): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/run/lock/" pid=24623 comm="mount" flags="rw, nosuid, nodev, noexec, remount, relatime"
...
Feb 16 08:00:45 prx9 kernel: [4796430.208032] audit: type=1400 audit(1455606045.176:1445): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/run/lock/" pid=24623 comm="mount" flags="rw, nosuid, nodev, noexec, remount, relatime"
Feb 16 08:00:45 prx9 kernel: [4796430.222620] audit: type=1400 audit(1455606045.192:1447): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/" pid=24638 comm="mount" flags="ro, nosuid, nodev, noexec, remount, relatime"
Feb 16 08:00:45 prx9 kernel: [4796430.307387] audit: type=1400 audit(1455606045.276:1449): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/dev/pts/" pid=24712 comm="mount" flags="rw, nosuid, noexec, remount, relatime"
....
----------------------------------------------------------------------------------------------------------------------------
pveversion -v
proxmox-ve: 4.1-28 (running kernel: 4.2.6-1-pve)
pve-manager: 4.1-2 (running version: 4.1-2/78c5f4a2)
pve-kernel-4.2.6-1-pve: 4.2.6-28
pve-kernel-4.2.2-1-pve: 4.2.2-16
lvm2: 2.02.116-pve2
corosync-pve: 2.3.5-2
libqb0: 0.17.2-1
pve-cluster: 4.0-29
qemu-server: 4.0-42
pve-firmware: 1.1-7
libpve-common-perl: 4.0-42
libpve-access-control: 4.0-10
libpve-storage-perl: 4.0-38
pve-libspice-server1: 0.12.5-2
vncterm: 1.2-1
pve-qemu-kvm: 2.4-18
pve-container: 1.0-35
pve-firewall: 2.0-14
pve-ha-manager: 1.0-16
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u1
lxc-pve: 1.1.5-5
lxcfs: 0.13-pve2
cgmanager: 0.39-pve1
criu: 1.6.0-1
zfsutils: 0.6.5-pve6~jessie
zfs list -t all
NAME USED AVAIL REFER MOUNTPOINT
rpool 210G 1.55T 96K /rpool
rpool/ROOT 1.32G 1.55T 96K /rpool/ROOT
rpool/ROOT/pve-1 1.32G 1.55T 1.32G /
rpool/VPS 184G 1.55T 96K /rpool/VPS
rpool/VPS/subvol-100-disk-1 15.8G 84.2G 15.8G /rpool/VPS/subvol-100-disk-1
rpool/VPS/subvol-101-disk-1 3.24G 86.8G 3.24G /rpool/VPS/subvol-101-disk-1
rpool/VPS/vm-1002-disk-1 165G 1.69T 18.2G -
rpool/swap 24.4G 1.57T 3.88G -
Thanks!
sometimes i have this trouble with LXC on ZFS and backup.
The Backup process seem freezed and the virtual machine is inaccessible.
I Have to do a Kill -15 to the Backup process and reboot the container.
The backup is small, 16G on a SATA Hard disk directly connected.
----------------------------------------------------------------------------------------------------------------------------
Syslog:
Feb 16 07:59:37 prx9 vzdump[12601]: ERROR: Backup of VM 100 failed - VM is locked (snapshot)
Feb 16 07:59:37 prx9 vzdump[12601]: INFO: Backup job finished with errors
Feb 16 07:59:37 prx9 vzdump[12601]: job errors
..
Feb 16 08:00:27 prx9 pct[24143]: stopping CT 100: UPID
rx9:00005E4F:1C965B15:56C2C90B:vzstop:100:root@pam:Feb 16 08:00:28 prx9 pvedaemon[16060]: unable to get PID for CT 100 (not running?)
..
Feb 16 08:00:44 prx9 kernel: [4796429.951010] audit: type=1400 audit(1455606044.920:1440): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/fs/pstore/" pid=24447 comm="mount" fstype="pstore" srcname="pstore" flags="rw"
Feb 16 08:00:44 prx9 kernel: [4796429.951097] audit: type=1400 audit(1455606044.920:1441): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/fs/pstore/" pid=24447 comm="mount" fstype="pstore" srcname="pstore" flags="ro"
Feb 16 08:00:45 prx9 kernel: [4796430.121814] audit: type=1400 audit(1455606045.088:1442): apparmor="DENIED" operation="mount" info="failed flags match" error=-13 profile="lxc-container-default" name="/" pid=24556 comm="mount" flags="rw, remount, silent"
Feb 16 08:00:45 prx9 kernel: [4796430.208032] audit: type=1400 audit(1455606045.176:1445): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/run/lock/" pid=24623 comm="mount" flags="rw, nosuid, nodev, noexec, remount, relatime"
...
Feb 16 08:00:45 prx9 kernel: [4796430.208032] audit: type=1400 audit(1455606045.176:1445): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/run/lock/" pid=24623 comm="mount" flags="rw, nosuid, nodev, noexec, remount, relatime"
Feb 16 08:00:45 prx9 kernel: [4796430.222620] audit: type=1400 audit(1455606045.192:1447): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/sys/" pid=24638 comm="mount" flags="ro, nosuid, nodev, noexec, remount, relatime"
Feb 16 08:00:45 prx9 kernel: [4796430.307387] audit: type=1400 audit(1455606045.276:1449): apparmor="DENIED" operation="mount" info="failed type match" error=-13 profile="lxc-container-default" name="/dev/pts/" pid=24712 comm="mount" flags="rw, nosuid, noexec, remount, relatime"
....
----------------------------------------------------------------------------------------------------------------------------
pveversion -v
proxmox-ve: 4.1-28 (running kernel: 4.2.6-1-pve)
pve-manager: 4.1-2 (running version: 4.1-2/78c5f4a2)
pve-kernel-4.2.6-1-pve: 4.2.6-28
pve-kernel-4.2.2-1-pve: 4.2.2-16
lvm2: 2.02.116-pve2
corosync-pve: 2.3.5-2
libqb0: 0.17.2-1
pve-cluster: 4.0-29
qemu-server: 4.0-42
pve-firmware: 1.1-7
libpve-common-perl: 4.0-42
libpve-access-control: 4.0-10
libpve-storage-perl: 4.0-38
pve-libspice-server1: 0.12.5-2
vncterm: 1.2-1
pve-qemu-kvm: 2.4-18
pve-container: 1.0-35
pve-firewall: 2.0-14
pve-ha-manager: 1.0-16
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u1
lxc-pve: 1.1.5-5
lxcfs: 0.13-pve2
cgmanager: 0.39-pve1
criu: 1.6.0-1
zfsutils: 0.6.5-pve6~jessie
zfs list -t all
NAME USED AVAIL REFER MOUNTPOINT
rpool 210G 1.55T 96K /rpool
rpool/ROOT 1.32G 1.55T 96K /rpool/ROOT
rpool/ROOT/pve-1 1.32G 1.55T 1.32G /
rpool/VPS 184G 1.55T 96K /rpool/VPS
rpool/VPS/subvol-100-disk-1 15.8G 84.2G 15.8G /rpool/VPS/subvol-100-disk-1
rpool/VPS/subvol-101-disk-1 3.24G 86.8G 3.24G /rpool/VPS/subvol-101-disk-1
rpool/VPS/vm-1002-disk-1 165G 1.69T 18.2G -
rpool/swap 24.4G 1.57T 3.88G -
Thanks!