LXC Container Fails to Start After Proxmox Update

prof3c1

New Member
Jun 29, 2023
10
0
1
After a recent Proxmox update, my LXC container (ID 109, running Plex) fails to start. I attempted to restore from a backup, but the issue persists. Below are the debug logs:

Code:
lxc-start: 109: ../src/lxc/sync.c: sync_wait: 34 An error occurred in another process (expected sequence number 7)
lxc-start: 109: ../src/lxc/start.c: __lxc_start: 2114 Failed to spawn container "109"
lxc-start: 109: ../src/lxc/tools/lxc_start.c: lxc_start_main: 307 The container failed to start
lxc-start: 109: ../src/lxc/tools/lxc_start.c: lxc_start_main: 312 Additional information can be obtained by setting the --logfile and --logpriority options

audit: type=1400 audit(1738537113.057:204): apparmor="STATUS" operation="profile_load" profile="/usr/bin/lxc-start" name="lxc-109_</var/lib/lxc>" pid=34055 comm="apparmor_parser"
audit: type=1400 audit(1738537114.632:205): apparmor="STATUS" operation="profile_remove" profile="/usr/bin/lxc-start" name="lxc-109_</var/lib/lxc>" pid=34119 comm="apparmor_parser"
...

lxc-attach: 109: ../src/lxc/attach.c: get_attach_context: 406 Connection refused - Failed to get init pid
lxc-attach: 109: ../src/lxc/attach.c: lxc_attach: 1470 Connection refused - Failed to get attach context

Code:
arch: amd64
cores: 4
dev0: /dev/dri/card1,gid=44
dev1: /dev/dri/renderD128,gid=104
features: keyctl=1,nesting=1
hostname: plex
memory: 4096
mp0: USB--Backup:109/vm-109-disk-0.raw,mp=/home/plex,size=400G
net0: name=eth0,bridge=vmbr0,hwaddr=BC:24:11:A7:50:E6,ip=dhcp,type=veth
onboot: 0
ostype: ubuntu
rootfs: local-lvm:vm-109-disk-0,size=8G
swap: 512
tags: plex
unprivileged: 1


Any assistance or suggestions to resolve this issue would be appreciated. The problem persists even after restoring the container from a backup.
 
I general I can say there is no lxc start problem on pve 8.3.3 with kernel 6.8.12-7 and 6.8.12-8 when migrating lxc on cluster hosts.
Try "pct start 109" in pve host console which may give further/better error message as when started be webui.
 
Last edited:
I general I can say there os no lxc start problem on pve 8.3.3 with kernel 6.8.12-7 and 6.8.12-8 when migrating lxc on cluster hosts.
Try "pct start 109" in pve host console which may give further/better error message as when started be webui.
Hello,

Same Error :
Code:
pct start 109
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LC_CTYPE = "UTF-8",
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
sync_wait: 34 An error occurred in another process (expected sequence number 7)
__lxc_start: 2114 Failed to spawn container "109"
startup for container '109' failed
 
Mmh, what about "strace pct start 109" ?
[
openat(AT_FDCWD, "/dev/urandom", O_RDONLY|O_CLOEXEC) = 3
read(3, "\253\34\242M", 4) = 4
close(3) = 0
openat(AT_FDCWD, "/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3
newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=3048928, ...}, AT_EMPTY_PATH) = 0
mmap(NULL, 3048928, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7244cb400000
close(3) = 0
openat(AT_FDCWD, "/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 3
newfstatat(3, "", {st_mode=S_IFREG|0644, st_size=2996, ...}, AT_EMPTY_PATH) = 0
read(3, "# Locale name alias data base.\n#"..., 4096) = 2996
read(3, "", 4096) = 0
close(3) = 0
openat(AT_FDCWD, "/usr/lib/locale/UTF-8/LC_CTYPE", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
fcntl(0, F_SETFD, 0) = 0
ioctl(0, TCGETS, {c_iflag=ICRNL|IXON|IXANY|IMAXBEL|IUTF8, c_oflag=NL0|CR0|TAB0|BS0|VT0|FF0|OPOST|ONLCR, c_cflag=B9600|CS8|CREAD, c_lflag=ISIG|ICANON|ECHO|ECHOE|IEXTEN|ECHOCTL|ECHOKE|PENDIN, ...}) = 0
lseek(0, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek)
fcntl(1, F_SETFD, 0) = 0
ioctl(1, TCGETS, {c_iflag=ICRNL|IXON|IXANY|IMAXBEL|IUTF8, c_oflag=NL0|CR0|TAB0|BS0|VT0|FF0|OPOST|ONLCR, c_cflag=B9600|CS8|CREAD, c_lflag=ISIG|ICANON|ECHO|ECHOE|IEXTEN|ECHOCTL|ECHOKE|PENDIN, ...}) = 0
lseek(1, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek)
fcntl(2, F_SETFD, 0) = 0
ioctl(2, TCGETS, {c_iflag=ICRNL|IXON|IXANY|IMAXBEL|IUTF8, c_oflag=NL0|CR0|TAB0|BS0|VT0|FF0|OPOST|ONLCR, c_cflag=B9600|CS8|CREAD, c_lflag=ISIG|ICANON|ECHO|ECHOE|IEXTEN|ECHOCTL|ECHOKE|PENDIN, ...}) = 0
lseek(2, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek)
write(2, "perl: warning: Setting locale fa"..., 38perl: warning: Setting locale failed.
) = 38
write(2, "perl: warning: Please check that"..., 55perl: warning: Please check that your locale settings:
) = 55
write(2, "\tLANGUAGE = (unset),\n", 21 LANGUAGE = (unset),
) = 21
write(2, "\tLC_ALL = (unset),\n", 19 LC_ALL = (unset),
) = 19
write(2, "\tLC_CTYPE = \"UTF-8\",\n", 21 LC_CTYPE = "UTF-8",
) = 21
write(2, "\tLANG = \"en_US.UTF-8\"\n", 22 LANG = "en_US.UTF-8"
) = 22
write(2, " are supported and installed "..., 48 are supported and installed on your system.
) = 48
write(2, "perl: warning: Falling back to a"..., 66perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
) = 66
brk(0x5e26a1991000) = 0x5e26a1991000
readlink("/proc/self/exe", "/usr/bin/perl", 4095) = 13
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/5.36.0/x86_64-linux-gnu-thread-multi", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/5.36.0", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/x86_64-linux-gnu-thread-multi", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/site_perl/5.36.0/x86_64-linux-gnu-thread-multi", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/site_perl/5.36.0", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/site_perl/x86_64-linux-gnu-thread-multi", 0x7fffb2d380f0, 0) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/sbin/pct", O_RDONLY|O_CLOEXEC) = 3
fcntl(3, F_GETFD) = 0x1 (flags FD_CLOEXEC)
ioctl(3, TCGETS, 0x7fffb2d37fe0) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(3, 0, SEEK_CUR) = 0
newfstatat(3, "", {st_mode=S_IFREG|0755, st_size=101, ...}, AT_EMPTY_PATH) = 0
getuid() = 0
geteuid() = 0
getgid() = 0
getegid() = 0
rt_sigaction(SIGCHLD, NULL, {sa_handler=SIG_DFL, sa_mask=[], sa_flags=0}, 8) = 0
read(3, "#!/usr/bin/perl -T\n\nuse strict;\n"..., 8192) = 101
newfstatat(AT_FDCWD, "/etc/perl/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/etc/perl/strict.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/strict.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/strict.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/strict.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/strict.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/strict.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/strict.pm", {st_mode=S_IFREG|0644, st_size=1606, ...}, 0) = 0
openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/strict.pm", O_RDONLY|O_CLOEXEC) = 4
ioctl(4, TCGETS, 0x7fffb2d37860) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(4, 0, SEEK_CUR) = 0
read(4, "package strict;\n\n$strict::VERSIO"..., 8192) = 1606
brk(0x5e26a19b2000) = 0x5e26a19b2000
lseek(4, 1605, SEEK_SET) = 1605
lseek(4, 0, SEEK_CUR) = 1605
close(4) = 0
newfstatat(AT_FDCWD, "/etc/perl/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/etc/perl/warnings.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/warnings.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/warnings.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/warnings.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/warnings.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/warnings.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/warnings.pm", {st_mode=S_IFREG|0644, st_size=29669, ...}, 0) = 0
openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/warnings.pm", O_RDONLY|O_CLOEXEC) = 4
ioctl(4, TCGETS, 0x7fffb2d37860) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(4, 0, SEEK_CUR) = 0
read(4, "# -*- buffer-read-only: t -*-\n# "..., 8192) = 8192
read(4, "..11,57]\n 'layer'\t\t\t\t=> \"\\x00"..., 8192) = 8192
read(4, "00\\x00\\x00\\x20\\x00\\x00\\x00\\x00\\x"..., 8192) = 8192
brk(0x5e26a19d3000) = 0x5e26a19d3000
read(4, "(empty import list or after a lo"..., 8192) = 5093
brk(0x5e26a19f6000) = 0x5e26a19f6000
lseek(4, 29654, SEEK_SET) = 29654
lseek(4, 0, SEEK_CUR) = 29654
close(4) = 0
newfstatat(AT_FDCWD, "/etc/perl/PVE/CLI/pct.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/etc/perl/PVE/CLI/pct.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/PVE/CLI/pct.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/PVE/CLI/pct.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/PVE/CLI/pct.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/PVE/CLI/pct.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/PVE/CLI/pct.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/PVE/CLI/pct.pm", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/PVE/CLI/pct.pmc", 0x7fffb2d37aa0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/PVE/CLI/pct.pm", {st_mode=S_IFREG|0644, st_size=32042, ...}, 0) = 0
openat(AT_FDCWD, "/usr/share/perl5/PVE/CLI/pct.pm", O_RDONLY|O_CLOEXEC) = 4
ioctl(4, TCGETS, 0x7fffb2d37860) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(4, 0, SEEK_CUR) = 0
read(4, "package PVE::CLI::pct;\n\nuse stri"..., 8192) = 8192
newfstatat(AT_FDCWD, "/etc/perl/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/etc/perl/Fcntl.pm", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/Fcntl.pm", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/Fcntl.pm", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/Fcntl.pm", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/Fcntl.pm", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Fcntl.pmc", 0x7fffb2d373a0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Fcntl.pm", {st_mode=S_IFREG|0644, st_size=2100, ...}, 0) = 0
openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Fcntl.pm", O_RDONLY|O_CLOEXEC) = 5
ioctl(5, TCGETS, 0x7fffb2d37160) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(5, 0, SEEK_CUR) = 0
read(5, "package Fcntl;\n\nuse strict;\n\nuse"..., 8192) = 2100
newfstatat(AT_FDCWD, "/etc/perl/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/etc/perl/Exporter.pm", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/lib/x86_64-linux-gnu/perl/5.36.0/Exporter.pm", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/local/share/perl/5.36.0/Exporter.pm", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl5/5.36/Exporter.pm", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/share/perl5/Exporter.pm", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Exporter.pmc", 0x7fffb2d36ca0, 0) = -1 ENOENT (No such file or directory)
newfstatat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Exporter.pm", {st_mode=S_IFREG|0644, st_size=2336, ...}, 0) = 0
openat(AT_FDCWD, "/usr/lib/x86_64-linux-gnu/perl-base/Exporter.pm", O_RDONLY|O_CLOEXEC) = 6
ioctl(6, TCGETS, 0x7fffb2d36a60) = -1 ENOTTY (Inappropriate ioctl for device)
 
Inappropriate ioctl for device --> First outcommend your mp0 line in the lxc 109.conf file and try to start the VM with pct start 109 again "solo".
If that does *NOT* work have an empty dir on pve host, maybe /net, and "mount -o loop </path/to/vm-109-disk-0> /net" (/dev/pve/vm-109-disk-0 ?),
does it mount and is shown by "df" ?
 
Last edited:
Inappropriate ioctl for device --> First outcommend your mp0 line in the lxc 109.conf file and try to start the VM with pct start 109 again "solo".
If that does *NOT* work have an empty dir on pve host, maybe /net, and "mount -o loop </path/to/vm-109-disk-0> /net" (/dev/pve/vm-109-disk-0 ?),
does it mount and is shown by "df" ?
Still the same and yes it mount ..
 
Create new LXC and copy your data from loop mounted LXC to new LXC, then use your new LXC again with your mp0 line.
When all fine remove LXC 109.