After updates, LXCs not working

fantaxp7

Renowned Member
Dec 28, 2012
20
0
66
Hello,

I ran updates this morning and rebooted my server. I noticed the services I have on them stopped working and the console on proxmox webui do not work as they should, no login prompt. You can type but nothing happens.

The console looks just like the second image on this post. https://forum.proxmox.com/threads/console-seems-to-have-broken-on-5-2-7.46396/#post-235593 As you can see I attempted what fixed his issue but did not fix mine.

Thanks
 
What distribution are you running?

Can you enter the container with:

Code:
pct enter CTID
 
What distribution are you running?

Can you enter the container with:

Code:
pct enter CTID
Hello,
Just tested, yes pct enter works.

The LXCs are:

Distributor ID: Ubuntu
Description: Ubuntu 14.04.5 LTS
Release: 14.04

Thanks
 
Can you press enter a few times on the Web UI Console? Sometimes it has no output on the serial console in the beginning and you need to press enter to get the login prompt.

If that doesn't work, check if you can reach the containers in the network. If not reachable, then we will have to look at some logs in the container to see what's going on.
 
Can you press enter a few times on the Web UI Console? Sometimes it has no output on the serial console in the beginning and you need to press enter to get the login prompt.

If that doesn't work, check if you can reach the containers in the network. If not reachable, then we will have to look at some logs in the container to see what's going on.

I've tried hitting enter a number of times. I can type away as well, but it's not at a login prompt or anything.

I've noticed the network is off. I was not able to reach the web interface for some services run. So I changed from DHCP to Static in network config on the webui, didn't fix.

Then after you mentioned to try pct enter, I checked settings and they still look off, as if maybe an interface disappeared?

root@nzbget:/# ifconfig
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:16 errors:0 dropped:0 overruns:0 frame:0
TX packets:16 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1440 (1.4 KB) TX bytes:1440 (1.4 KB)
 
What says your network config? It looks like there's no eth interface running.

Can you post:
* cat /var/log/syslog
* ip link
* journalctl -xe

Also your container config, in /etc/pve/lxc/CTID.conf
 
  • Like
Reactions: fantaxp7
What says your network config? It looks like there's no eth interface running.

Can you post:
* cat /var/log/syslog
* ip link
* journalctl -xe

Also your container config, in /etc/pve/lxc/CTID.conf

Sorry, but what is the best way to post all of this? Quite a bit of info.

Also yes appears like the eth0 disappeared. Just one note, there is a kvm running fine still.

to start here is container config

Code:
sys36  /etc/pve/lxc # cat /etc/pve/lxc/36101.conf
arch: amd64
cores: 2
hostname: nzbget
memory: 512
net0: name=eth0,bridge=vmbr0,gw=172.30.11.2,hwaddr=7A:46:9F:4E:D5:76,ip=172.30.11.39/24,type=veth
ostype: ubuntu
rootfs: lxc:subvol-36101-disk-0,size=10G
swap: 512
lxc.mount.entry: /ht  ht  none bind,create=dir,optional 0 0
lxc.mount.entry: /movies  movies  none bind,create=dir,optional 0 0
sys36  /etc/pve/lxc #
 
Ok thanks. The syslog is quite large and says too big to post. Some redundant messages there on a usb mount that I am aware of.


ip link

Code:
sys36  ~ #  ip link 
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000 
   link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 
2: eno1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
   link/ether 00:25:90:f3:8d:0a brd ff:ff:ff:ff:ff:ff 
3: rename3: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
   link/ether 00:25:90:f3:8d:0b brd ff:ff:ff:ff:ff:ff 
4: rename4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
   link/ether 00:25:90:f3:8d:0c brd ff:ff:ff:ff:ff:ff 
5: rename5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
   link/ether 00:25:90:f3:8d:0d brd ff:ff:ff:ff:ff:ff 
6: enp130s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP mode DEFAULT group default qlen 1000 
   link/ether 90:e2:ba:01:f0:92 brd ff:ff:ff:ff:ff:ff 
7: enp130s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 
   link/ether 90:e2:ba:01:f0:93 brd ff:ff:ff:ff:ff:ff 
8: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
   link/ether 90:e2:ba:01:f0:92 brd ff:ff:ff:ff:ff:ff 
22: veth36125i0@if21: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000 
   link/ether fe:98:d6:98:49:24 brd ff:ff:ff:ff:ff:ff link-netnsid 6 
23: tap36777i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc fq_codel master vmbr0v267 state UNKNOWN mode DEFAULT group default qlen 1
000 
   link/ether 4e:95:83:92:82:f2 brd ff:ff:ff:ff:ff:ff 
24: vmbr0v267: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000 
   link/ether 90:e2:ba:01:f0:92 brd ff:ff:ff:ff:ff:ff 
25: enp130s0f0.267@enp130s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0v267 state UP mode DEFAULT group default qlen 
1000 
   link/ether 90:e2:ba:01:f0:92 brd ff:ff:ff:ff:ff:ff 
26: tap36777i1: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc fq_codel master vmbr0 state UNKNOWN mode DEFAULT group default qlen 1000 
   link/ether 12:07:54:f0:83:9e brd ff:ff:ff:ff:ff:ff 
46: veth36103i0@if45: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:ee:1f:64:dd:9a brd ff:ff:ff:ff:ff:ff link-netnsid 1 
48: veth36104i0@if47: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:65:c4:58:6e:17 brd ff:ff:ff:ff:ff:ff link-netnsid 2 
50: veth36105i0@if49: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:b0:01:2f:55:7a brd ff:ff:ff:ff:ff:ff link-netnsid 3 
52: veth36106i0@if51: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:16:ba:44:f6:87 brd ff:ff:ff:ff:ff:ff link-netnsid 4 
54: veth36107i0@if53: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:1a:8a:e1:a5:18 brd ff:ff:ff:ff:ff:ff link-netnsid 5 
64: veth36101i0@if63: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue master vmbr0 state LOWERLAYERDOWN mode DEFAULT group default qlen
1000 
   link/ether fe:78:55:ff:25:68 brd ff:ff:ff:ff:ff:ff link-netnsid 7 
74: veth36000i0@if73: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000 
   link/ether 5a:5c:ee:f7:3b:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0

journalctl -xe


Code:
sys36  ~ # journalctl -xe 
Jan 15 09:25:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
-- Subject: Unit dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device has failed 
-- Defined-By: systemd 
-- Support: https://www.debian.org/support 
-- 
-- Unit dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device has failed. 
-- 
-- The result is timeout. 
Jan 15 09:25:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
-- Subject: Unit media-usb5.mount has failed 
-- Defined-By: systemd 
-- Support: https://www.debian.org/support 
-- 
-- Unit media-usb5.mount has failed. 
-- 
-- The result is dependency. 
Jan 15 09:25:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 09:25:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2 
Jan 15 09:25:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2 
Jan 15 09:25:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
-- Subject: Unit dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device has failed 
-- Defined-By: systemd 
-- Support: https://www.debian.org/support 
-- 
-- Unit dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device has failed. 
-- 
-- The result is timeout. 
Jan 15 09:25:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
-- Subject: Unit media-usb4.mount has failed 
-- Defined-By: systemd 
-- Support: https://www.debian.org/support 
-- 
-- Unit media-usb4.mount has failed. 
-- 
-- The result is dependency. 
Jan 15 09:25:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 09:25:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2 
lines 3156-3192/3192 (END)
 
Here is is broken in two parts.

Code:
Jan 15 08:31:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:31:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:31:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:31:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:31:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:31:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:31:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:31:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:31:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:31:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:31:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:31:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:31:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:31:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:32:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:32:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:33:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:33:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:33:01 sys36 CRON[10394]: (root) CMD (/fbc/bin/pve/pve-fbc-misc.sh  #   getfbc done here) 
Jan 15 08:33:01 sys36 root: /fbc/bin/pve/pve-fbc-misc.sh start 
Jan 15 08:33:01 sys36 root: /fbc/bin/getfbc Acquired lock using /tmp/getfbc, running 
Jan 15 08:33:01 dnsmasq[6235]: query[A] fbcadmin.fantinibakery.com from 127.0.0.1 
Jan 15 08:33:01 dnsmasq[6235]: /fbc/dns/hosts.extra fbcadmin.fantinibakery.com is 10.1.3.5 
Jan 15 08:33:01 dnsmasq[6235]: query[AAAA] fbcadmin.fantinibakery.com from 127.0.0.1 
Jan 15 08:33:01 dnsmasq[6235]: config fbcadmin.fantinibakery.com is NODATA-IPv6 
Jan 15 08:33:01 dnsmasq[6235]: query[PTR] 5.3.1.10.in-addr.arpa from 127.0.0.1 
Jan 15 08:33:01 dnsmasq[6235]: /fbc/dns/hosts.extra 10.1.3.5 is fbcadmin.fantinibakery.com 
Jan 15 08:33:03 sys36 root: /fbc/bin/getfbc start 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:33:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:33:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:33:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:33:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:33:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:33:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:33:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:33:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:33:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:33:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:33:59 sys36 root: /fbc/bin/getfbc end 
Jan 15 08:33:59 sys36 root: /fbc/bin/getfbc Finished ,  lock directory /tmp/getfbc removed. 
Jan 15 08:33:59 sys36 root: /fbc/bin/pve/pve-fbc-misc.sh end 
Jan 15 08:34:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:34:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:34:21 dnsmasq[6235]: query[SRV] _http._tcp.apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config _http._tcp.apt-cacher.fantinibakery.com is NXDOMAIN 
Jan 15 08:34:21 dnsmasq[6235]: query[SRV] _http._tcp.apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config _http._tcp.apt-cacher.fantinibakery.com is NXDOMAIN 
Jan 15 08:34:21 dnsmasq[6235]: query[SRV] _http._tcp.apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config _http._tcp.apt-cacher.fantinibakery.com is NXDOMAIN 
Jan 15 08:34:21 dnsmasq[6235]: query[SRV] _http._tcp.apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config _http._tcp.apt-cacher.fantinibakery.com is NXDOMAIN 
Jan 15 08:34:21 dnsmasq[6235]: query[A] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: /fbc/dns/hosts.extra apt-cacher.fantinibakery.com is 10.1.3.8 
Jan 15 08:34:21 dnsmasq[6235]: query[AAAA] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config apt-cacher.fantinibakery.com is NODATA-IPv6 
Jan 15 08:34:21 dnsmasq[6235]: query[A] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: /fbc/dns/hosts.extra apt-cacher.fantinibakery.com is 10.1.3.8 
Jan 15 08:34:21 dnsmasq[6235]: query[AAAA] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config apt-cacher.fantinibakery.com is NODATA-IPv6 
Jan 15 08:34:21 dnsmasq[6235]: query[A] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: /fbc/dns/hosts.extra apt-cacher.fantinibakery.com is 10.1.3.8 
Jan 15 08:34:21 dnsmasq[6235]: query[AAAA] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config apt-cacher.fantinibakery.com is NODATA-IPv6 
Jan 15 08:34:21 dnsmasq[6235]: query[A] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: /fbc/dns/hosts.extra apt-cacher.fantinibakery.com is 10.1.3.8 
Jan 15 08:34:21 dnsmasq[6235]: query[AAAA] apt-cacher.fantinibakery.com from 127.0.0.1 
Jan 15 08:34:21 dnsmasq[6235]: config apt-cacher.fantinibakery.com is NODATA-IPv6 
Jan 15 08:35:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:35:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:35:01 sys36 CRON[16141]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:35:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:35:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:35:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:35:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:35:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:35:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:35:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:35:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:35:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:35:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:36:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:36:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:37:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:37:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:37:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:37:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:37:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:37:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:37:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:37:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:37:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:37:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:37:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:37:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:38:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:38:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:39:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:39:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:39:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:39:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:39:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:39:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:39:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:39:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:39:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:39:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:39:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:39:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:40:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:40:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:41:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:41:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:41:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:41:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:41:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:41:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:41:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:41:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:41:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:41:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:41:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:41:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:42:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:42:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:43:00 sys36 systemd[1]: Starting Proxmox VE replication runner... 
Jan 15 08:43:00 sys36 systemd[1]: Started Proxmox VE replication runner. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start timed out. 
Jan 15 08:43:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device. 
Jan 15 08:43:30 sys36 systemd[1]: Dependency failed for /media/usb5. 
Jan 15 08:43:30 sys36 systemd[1]: media-usb5.mount: Job media-usb5.mount/start failed with result 'dependency'. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-8331a989\x2d1003\x2d4afb\x2d971d\x2d32d275d7b740.device: Job dev-disk-by\x2duuid-8331a989\x2
d1003\x2d4afb\x2d971d\x2d32d275d7b740.device/start failed with result 'timeout'. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start timed out. 
Jan 15 08:43:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device. 
Jan 15 08:43:30 sys36 systemd[1]: Dependency failed for /media/usb4. 
Jan 15 08:43:30 sys36 systemd[1]: media-usb4.mount: Job media-usb4.mount/start failed with result 'dependency'. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-3c366c46\x2d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device: Job dev-disk-by\x2duuid-3c366c46\x2
d831b\x2d40e1\x2dba80\x2d4f05bfa3cd38.device/start failed with result 'timeout'. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start timed out. 
Jan 15 08:43:30 sys36 systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device. 
Jan 15 08:43:30 sys36 systemd[1]: Dependency failed for /media/usb2. 
Jan 15 08:43:30 sys36 systemd[1]: media-usb2.mount: Job media-usb2.mount/start failed with result 'dependency'. 
Jan 15 08:43:30 sys36 systemd[1]: dev-disk-by\x2duuid-6555458e\x2dd123\x2d4937\x2da045\x2d66461882b477.device: Job dev-disk-by\x2duuid-6555458e\x2
dd123\x2d4937\x2da045\x2d66461882b477.device/start failed with result 'timeout'.
 
Hello,

I downgraded to lxc-pve_3.0.2+pve1-5_amd64.deb and my lxc's are now working.

I also noticed that a debian stretch lxc I have was running this whole time. Perhaps ubuntu 14 is the issue.

Thanks
 
Sorry, I forgot to mention. The syslog and journal entries are only relevant *while* the CT is being started. Can you send the relevant bits while the CT starts?

Also, we need 'ip link' from the CT and not the host.

Glad that the package downgrade solved the issue, but we would like to understand why this happens and hopefully provide a fix.
 
Okay so with *privileged* 14.04 containers I can reproduce this. A bisect revealed an lxc commit which causes no functional change but simply removes an unnecessary mount entry which seems to confuse upstart in some way.

Considering the age and soon-to-be-EOL-ness of 14.04 I recommend moving away from it on the one hand.
Or, if absolutely required, use a VM (or at least an unprivileged container).
 
  • Like
Reactions: fantaxp7
Update: That said, the change seems mostly about mount point cleanliness, so there's a chance it'll at least be temporarily reverted, as the issue description[1] doesn't seem to mention any actual breakage. (Otherwise it may become configurable. But my recommendation about moving to unprivileged containers or even VMs for such old systems still stands.)

[1] https://github.com/lxc/lxc/issues/2602
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!