Containers wont start after restart

Ivica

Member
Dec 27, 2017
4
0
6
25
Hello

This is our system
Code:
cat /etc/debian_version
9.3

Code:
pveversion  -v
proxmox-ve: 5.1-32 (running kernel: 4.10.15-1-pve)
pve-manager: 5.1-41 (running version: 5.1-41/0b958203)
pve-kernel-4.13.4-1-pve: 4.13.4-26
pve-kernel-4.13.13-2-pve: 4.13.13-32
pve-kernel-4.10.15-1-pve: 4.10.15-15
libpve-http-server-perl: 2.0-8
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-19
qemu-server: 5.0-18
pve-firmware: 2.0-3
libpve-common-perl: 5.0-25
libpve-guest-common-perl: 2.0-14
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-17
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-3
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-5
pve-container: 2.0-18
pve-firewall: 3.0-5
pve-ha-manager: 2.0-4
ksm-control-daemon: not correctly installed
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.1-2
lxcfs: 2.0.8-1
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.3-pve1~bpo9

Starting node via proxmox returns

TASK ERROR: missing 'arch' - internal error at /usr/share/perl5/PVE/LXC.pm line 356.

Start node manually in command line with loggin
Code:
 lxc-start -n 101 -F -lDEBUG -o lxc-101.log
The configuration file contains legacy configuration keys.
Please update your configuration file!
lxc-start: 101: conf.c: run_buffer: 438 Script exited with status 2.
lxc-start: 101: start.c: lxc_init: 651 Failed to run lxc.hook.pre-start for container "101".
lxc-start: 101: start.c: __lxc_start: 1444 Failed to initialize container "101".
lxc-start: 101: tools/lxc_start.c: main: 371 The container failed to start.
lxc-start: 101: tools/lxc_start.c: main: 375 Additional information can be obtained by setting the --logfile and --logpriority options.

Log file


Code:
 lxc-start 101 20171227090530.658 INFO     lxc_start_ui - tools/lxc_start.c:main:280 - using rcfile /var/lib/lxc/101/config
      lxc-start 101 20171227090530.658 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver AppArmor
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for reject_force_umount action 0(kill).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for reject_force_umount action 0(kill).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .[all].
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .kexec_load errno 1.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for kexec_load action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for kexec_load action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .open_by_handle_at errno 1.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for open_by_handle_at action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for open_by_handle_at action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .init_module errno 1.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for init_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for init_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .finit_module errno 1.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for finit_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for finit_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .delete_module errno 1.
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for delete_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for delete_module action 327681(errno).
      lxc-start 101 20171227090530.658 INFO     lxc_seccomp - seccomp.c:parse_config_v2:624 - Merging in the compat Seccomp ctx into the main one.
      lxc-start 101 20171227090530.658 INFO     lxc_conf - conf.c:run_script_argv:457 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "101", config section "lxc".
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.monitor.unshare = 1
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.rootfs = /var/lib/lxc/101/rootfs
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.type is deprecated and was renamed to lxc.net.INDEX.type
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.network.veth.pair = veth101i0
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.hwaddr is deprecated and was renamed to lxc.net.INDEX.hwaddr
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.name is deprecated and was renamed to lxc.net.INDEX.name
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.type is deprecated and was renamed to lxc.net.INDEX.type
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.network.veth.pair = veth101i1
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.hwaddr is deprecated and was renamed to lxc.net.INDEX.hwaddr
.
      lxc-start 101 20171227090530.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.name is deprecated and was renamed to lxc.net.INDEX.name
.
      lxc-start 101 20171227090530.897 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: unable to detect OS distribution
.
      lxc-start 101 20171227090530.902 ERROR    lxc_conf - conf.c:run_buffer:438 - Script exited with status 2.
      lxc-start 101 20171227090530.902 ERROR    lxc_start - start.c:lxc_init:651 - Failed to run lxc.hook.pre-start for container "101".
      lxc-start 101 20171227090530.902 ERROR    lxc_start - start.c:__lxc_start:1444 - Failed to initialize container "101".
      lxc-start 101 20171227090530.902 ERROR    lxc_start_ui - tools/lxc_start.c:main:371 - The container failed to start.
      lxc-start 101 20171227090530.902 ERROR    lxc_start_ui - tools/lxc_start.c:main:375 - Additional information can be obtained by setting the --logfile and --logpriority options.
      lxc-start 101 20171227092813.852 INFO     lxc_start_ui - tools/lxc_start.c:main:280 - using rcfile /var/lib/lxc/101/config
      lxc-start 101 20171227092813.852 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver AppArmor
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for reject_force_umount action 0(kill).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for reject_force_umount action 0(kill).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:276 - Setting Seccomp rule to reject force umounts.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .[all].
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .kexec_load errno 1.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for kexec_load action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for kexec_load action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .open_by_handle_at errno 1.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for open_by_handle_at action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for open_by_handle_at action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .init_module errno 1.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for init_module action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for init_module action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .finit_module errno 1.
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for finit_module action 327681(errno).
      lxc-start 101 20171227092813.852 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for finit_module action 327681(errno).
      lxc-start 101 20171227092813.853 INFO     lxc_seccomp - seccomp.c:parse_config_v2:435 - processing: .delete_module errno 1.
      lxc-start 101 20171227092813.853 INFO     lxc_seccomp - seccomp.c:parse_config_v2:610 - Adding native rule for delete_module action 327681(errno).
      lxc-start 101 20171227092813.853 INFO     lxc_seccomp - seccomp.c:parse_config_v2:614 - Adding compat rule for delete_module action 327681(errno).
      lxc-start 101 20171227092813.853 INFO     lxc_seccomp - seccomp.c:parse_config_v2:624 - Merging in the compat Seccomp ctx into the main one.
      lxc-start 101 20171227092813.853 INFO     lxc_conf - conf.c:run_script_argv:457 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "101", config section "lxc".
      lxc-start 101 20171227092814.893 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.monitor.unshare = 1
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.rootfs = /var/lib/lxc/101/rootfs
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.type is deprecated and was renamed to lxc.net.INDEX.type
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.network.veth.pair = veth101i0
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.hwaddr is deprecated and was renamed to lxc.net.INDEX.hwaddr
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.name is deprecated and was renamed to lxc.net.INDEX.name
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.type is deprecated and was renamed to lxc.net.INDEX.type
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - unable to parse config: lxc.network.veth.pair = veth101i1
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.hwaddr is deprecated and was renamed to lxc.net.INDEX.hwaddr
.
      lxc-start 101 20171227092814.894 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: vm 101 - lxc.network.name is deprecated and was renamed to lxc.net.INDEX.name
.
      lxc-start 101 20171227092814.919 DEBUG    lxc_conf - conf.c:run_buffer:429 - Script /usr/share/lxc/hooks/lxc-pve-prestart-hook 101 lxc pre-start with output: unable to detect OS distribution
.
      lxc-start 101 20171227092814.969 ERROR    lxc_conf - conf.c:run_buffer:438 - Script exited with status 2.
      lxc-start 101 20171227092814.969 ERROR    lxc_start - start.c:lxc_init:651 - Failed to run lxc.hook.pre-start for container "101".
      lxc-start 101 20171227092814.969 ERROR    lxc_start - start.c:__lxc_start:1444 - Failed to initialize container "101".
      lxc-start 101 20171227092814.970 ERROR    lxc_start_ui - tools/lxc_start.c:main:371 - The container failed to start.
      lxc-start 101 20171227092814.970 ERROR    lxc_start_ui - tools/lxc_start.c:main:375 - Additional information can be obtained by setting the --logfile and --logpriority options.

apt-get update && apt-get dist-upgrade returns that there is nothing to upgrade.

Any idea what is happening and how to fix it?

Thank you in advance
 
apt-get update && apt-get dist-upgrade returns that there is nothing to upgrade.

Any idea what is happening and how to fix it?

Thank you in advance

You have to configure a update repository.

Purchase a subscription key or use the pve-no-subscription repository.
 
From /etc/apt/sources.list.d remove pve-enterprise.list
then apt update && apt dist-upgrade
 
It looks like the problem is when you upgrade proxmox and lxc but configuration stay's on old and deprecated code.

We created one container with new code and then copied code to old configuration files, aka we manually change conf to look like new ones.

After that containers were able to start again.

Not sure why did you expect for an upgrade and distro upgrade to change old code in configuration files.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!