Can not start LXC after snapshot restore

sahara

New Member
Jul 19, 2023
10
1
3
Hello,

yesterday I upgraded the proxmox host from GUI - maybe important, don't know.

I restored a snapshot and could not start the LXC afterwards so I restarted the host. It took much longer than normal to boot up.
Today, same issue. I restored the snapshot several times without any problems, but after the last restore it again does not start.

Can you please help me? Thanks!


Code:
root@pve:# lxc-start -n 123 -F -l DEBUG -o /tmp/lxc-123.log
lxc-start: 123: ../src/lxc/utils.c: run_buffer: 571 Script exited with status 1
lxc-start: 123: ../src/lxc/start.c: lxc_init: 845 Failed to run lxc.hook.pre-start for container "123"
lxc-start: 123: ../src/lxc/start.c: __lxc_start: 2034 Failed to initialize container "123"
lxc-start: 123: ../src/lxc/utils.c: run_buffer: 571 Script exited with status 1
lxc-start: 123: ../src/lxc/start.c: lxc_end: 986 Failed to run lxc.hook.post-stop for container "123"
lxc-start: 123: ../src/lxc/tools/lxc_start.c: lxc_start_main: 307 The container failed to start
lxc-start: 123: ../src/lxc/tools/lxc_start.c: lxc_start_main: 312 Additional information can be obtained by setting the --logfile and --logpriority options
root@pve:# cat /tmp/lxc-123.log
lxc-start 123 20250430211632.216 INFO     lsm - ../src/lxc/lsm/lsm.c:lsm_init_static:38 - Initialized LSM security driver AppArmor
lxc-start 123 20250430211632.216 INFO     utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "123", config section "lxc"
lxc-start 123 20250430211632.799 DEBUG    utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 123 lxc pre-start produced output: zfs error: cannot mount 'rpool/data/subvol-123-disk-1': Permission denied

lxc-start 123 20250430211632.808 ERROR    utils - ../src/lxc/utils.c:run_buffer:571 - Script exited with status 1
lxc-start 123 20250430211632.808 ERROR    start - ../src/lxc/start.c:lxc_init:845 - Failed to run lxc.hook.pre-start for container "123"
lxc-start 123 20250430211632.808 ERROR    start - ../src/lxc/start.c:__lxc_start:2034 - Failed to initialize container "123"
lxc-start 123 20250430211632.808 INFO     utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-poststop-hook" for container "123", config section "lxc"
lxc-start 123 20250430211633.295 DEBUG    utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-poststop-hook 123 lxc post-stop produced output: umount: /var/lib/lxc/123/rootfs: not mounted

lxc-start 123 20250430211633.295 DEBUG    utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-poststop-hook 123 lxc post-stop produced output: command 'umount --recursive -- /var/lib/lxc/123/rootfs' failed: exit code 1

lxc-start 123 20250430211633.305 ERROR    utils - ../src/lxc/utils.c:run_buffer:571 - Script exited with status 1
lxc-start 123 20250430211633.305 ERROR    start - ../src/lxc/start.c:lxc_end:986 - Failed to run lxc.hook.post-stop for container "123"
lxc-start 123 20250430211633.305 ERROR    lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:307 - The container failed to start
lxc-start 123 20250430211633.305 ERROR    lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:312 - Additional information can be obtained by setting the --logfile and --logpriority options
 
Thank you,

this is after reboot where it is working again.

I also added a new device /dev/net/tun before the issues started.

Code:
root@pve:~# zfs list
NAME                           USED  AVAIL  REFER  MOUNTPOINT
rpool                          288G   635G   104K  /rpool
rpool/ROOT                    9.28G   635G    96K  /rpool/ROOT
rpool/ROOT/pve-1              9.28G   635G  9.28G  /
rpool/data                     265G   635G   168K  /rpool/data
rpool/data/subvol-101-disk-1  5.63G  4.37G  5.63G  /rpool/data/subvol-101-disk-1
rpool/data/subvol-102-disk-0   900M  3.12G   900M  /rpool/data/subvol-102-disk-0
rpool/data/subvol-103-disk-0  23.0G  33.0G  23.0G  /rpool/data/subvol-103-disk-0
rpool/data/subvol-104-disk-0  4.53G  3.47G  4.53G  /rpool/data/subvol-104-disk-0
rpool/data/subvol-105-disk-0  12.2G  2.03G  12.0G  /rpool/data/subvol-105-disk-0
rpool/data/subvol-106-disk-0  6.10G  5.25G  3.75G  /rpool/data/subvol-106-disk-0
rpool/data/subvol-107-disk-0  9.74G  25.3G  9.74G  /rpool/data/subvol-107-disk-0
rpool/data/subvol-108-disk-0  3.93G  6.07G  3.93G  /rpool/data/subvol-108-disk-0
rpool/data/subvol-111-disk-0  4.51G  5.49G  4.51G  /rpool/data/subvol-111-disk-0
rpool/data/subvol-112-disk-0  3.84G  4.16G  3.84G  /rpool/data/subvol-112-disk-0
rpool/data/subvol-113-disk-0  2.79G  7.21G  2.79G  /rpool/data/subvol-113-disk-0
rpool/data/subvol-114-disk-1  3.05G   975M  3.05G  /rpool/data/subvol-114-disk-1
rpool/data/subvol-115-disk-0  5.98G  12.0G  5.98G  /rpool/data/subvol-115-disk-0
rpool/data/subvol-118-disk-0  2.07G  1.93G  2.07G  /rpool/data/subvol-118-disk-0
rpool/data/subvol-119-disk-2  7.66G  1.34G  7.66G  /rpool/data/subvol-119-disk-2
rpool/data/subvol-119-disk-3  2.34M   150G  2.34M  /rpool/data/subvol-119-disk-3
rpool/data/subvol-120-disk-0  4.44G  5.56G  4.44G  /rpool/data/subvol-120-disk-0
rpool/data/subvol-121-disk-0  1.47G  8.53G  1.47G  /rpool/data/subvol-121-disk-0
rpool/data/subvol-122-disk-0   459M  4.55G   459M  /rpool/data/subvol-122-disk-0
rpool/data/subvol-123-disk-1  45.2G  3.56G  41.4G  /rpool/data/subvol-123-disk-1
rpool/data/subvol-124-disk-0  5.89G  14.1G  5.89G  /rpool/data/subvol-124-disk-0
rpool/data/subvol-126-disk-0  7.59G  24.4G  7.59G  /rpool/data/subvol-126-disk-0
rpool/data/subvol-127-disk-0  1.58G  2.42G  1.58G  /rpool/data/subvol-127-disk-0
rpool/data/subvol-128-disk-0   776M  7.24G   776M  /rpool/data/subvol-128-disk-0
rpool/data/subvol-129-disk-0  1.22G  2.78G  1.22G  /rpool/data/subvol-129-disk-0
rpool/data/subvol-130-disk-0  14.3G  4.94G  14.3G  /rpool/data/subvol-130-disk-0
rpool/data/subvol-131-disk-0  1.57G  8.43G  1.57G  /rpool/data/subvol-131-disk-0
rpool/data/vm-100-disk-0      17.4G   635G  17.4G  -
rpool/data/vm-110-disk-0        68K   635G    68K  -
rpool/data/vm-110-disk-1      5.49G   635G  5.49G  -
rpool/data/vm-116-disk-0       100K   635G   100K  -
rpool/data/vm-116-disk-1      18.2G   635G  18.2G  -
rpool/data/vm-116-disk-2        64K   635G    64K  -
rpool/data/vm-117-disk-0       108K   635G   108K  -
rpool/data/vm-117-disk-1      33.6G   635G  33.6G  -
rpool/data/vm-117-disk-2        64K   635G    64K  -
rpool/data/vm-125-disk-0      9.76G   635G  9.76G  -
rpool/var-lib-vz              13.5G   635G  13.5G  /var/lib/vz
root@pve:~#

Code:
root@pve:~# pct config 123
arch: amd64
cores: 4
description: <div align='center'><a href='https://Helper-Scripts.com' target='_blank' rel='noopener noreferrer'><img src='https://raw.githubusercontent.com/tteck/Proxmox/main/misc/images/logo-81x112.png'/></a>%0A%0A  # Docker LXC%0A%0A  <a href='https://ko-fi.com/proxmoxhelperscripts'><img src='https://img.shields.io/badge/&#x2615;-Buy me a coffee-blue' /></a>%0A  </div>%0A
dev0: /dev/net/tun
features: fuse=1,nesting=1
hostname: docker
memory: 14000
nameserver: 192.168.1.172
net0: name=eth0,bridge=vmbr0,gw=192.168.1.1,hwaddr=BC:24:11:6A:95:02,ip=192.168.1.29/24,type=veth
onboot: 1
ostype: debian
parent: trakt_fix
rootfs: local-zfs:subvol-123-disk-1,size=45G
searchdomain: rlvd.duckdns.org
swap: 4096
tags: proxmox-helper-scripts
root@pve:~#
 
look at
rpool/data/subvol-123-disk-1 45.2G 3.56G 41.4G /rpool/data/subvol-123-disk-1

rootfs: local-zfs:subvol-123-disk-1,size=45G
 
You mean the 45.2G vs 45G? I assume that 0.2 is space used by ZFS snapshots?
I increased the disk today, either way it is weird that it works 2-3-4-5 restores and then it refuses to boot.