I've tried upgrading a Fedora LXC from v40 to v41, but it fails to start, or rather it starts but does nothing. The Proxmox host is updated in full, so should be the latest-and-greatest as of writing.
Anyone else seeing this, or can point at what's going wrong?
Manually starting the container:
Anyone else seeing this, or can point at what's going wrong?
Code:
root@pve:~# pveversion
pve-manager/8.3.3/f157a38b211595d6 (running kernel: 6.8.12-7-pve)Manually starting the container:
Code:
root@pve:~# /usr/bin/lxc-start -F -n 207
systemd 256.11-1.fc41 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP -GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT +LIBARCHIVE)
Detected virtualization lxc.
Detected architecture x86-64.
Welcome to Fedora Linux 41 (Container Image)!
bpf-restrict-fs: BPF LSM hook not enabled in the kernel, BPF LSM not supported.
Read-only bind remount failed, ignoring: Permission denied
Queued start job for default target graphical.target.
[ OK ] Created slice system-container\x2dgetty.slice - Slice /system/container-getty.
[ OK ] Created slice system-modprobe.slice - Slice /system/modprobe.
[ OK ] Created slice system-sshd\x2dkeygen.slice - Slice /system/sshd-keygen.
[ OK ] Created slice user.slice - User and Session Slice.
[ OK ] Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[ OK ] Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
[ OK ] Reached target cryptsetup.target - Local Encrypted Volumes.
[ OK ] Reached target integritysetup.target - Local Integrity Protected Volumes.
[ OK ] Reached target paths.target - Path Units.
[ OK ] Reached target remote-cryptsetup.target - Remote Encrypted Volumes.
[ OK ] Reached target remote-fs.target - Remote File Systems.
[ OK ] Reached target slices.target - Slice Units.
[ OK ] Reached target swap.target - Swaps.
[ OK ] Reached target veritysetup.target - Local Verity Protected Volumes.
[ OK ] Listening on systemd-coredump.socket - Process Core Dump Socket.
[ OK ] Listening on systemd-creds.socket - Credential Encryption/Decryption.
[ OK ] Listening on systemd-initctl.socket - initctl Compatibility Named Pipe.
[ OK ] Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[ OK ] Listening on systemd-journald.socket - Journal Sockets.
[ OK ] Listening on systemd-networkd.socket - Network Service Netlink Socket.
[ OK ] Listening on systemd-oomd.socket - Userspace Out-Of-Memory (OOM) Killer Socket.
[ OK ] Listening on systemd-userdbd.socket - User Database Manager Socket.
Mounting dev-mqueue.mount - POSIX Message Queue File System...
tmp.mount: Directory /tmp to mount over is not empty, mounting anyway.
Mounting tmp.mount - Temporary Directory /tmp...
Starting systemd-journald.service - Journal Service...
Starting systemd-network-generator.service - Generate network units from Kernel command line...
Starting systemd-oomd.service - Userspace Out-Of-Memory (OOM) Killer...
systemd-network-generator.service: Failed to set up credentials: Protocol error
systemd-network-generator.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-network-generator: Protocol error
systemd-journald.service: Failed to set up credentials: Protocol error
systemd-journald.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-journald: Protocol error
Starting systemd-remount-fs.service - Remount Root and Kernel File Systems...
Starting systemd-sysctl.service - Apply Kernel Variables...
Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully...
Starting systemd-udev-load-credentials.service - Load udev Rules from Credentials...
dev-mqueue.mount: Mount process exited, code=exited, status=32/n/a
dev-mqueue.mount: Failed with result 'exit-code'.
[FAILED] Failed to mount dev-mqueue.mount - POSIX Message Queue File System.
See 'systemctl status dev-mqueue.mount' for details.
tmp.mount: Mount process exited, code=exited, status=32/n/a
tmp.mount: Failed with result 'exit-code'.
[FAILED] Failed to mount tmp.mount - Temporary Directory /tmp.
See 'systemctl status tmp.mount' for details.
systemd-journald.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-sysctl.service: Failed to set up credentials: Protocol error
systemd-sysctl.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-sysctl: Protocol error
systemd-tmpfiles-setup-dev-early.service: Failed to set up credentials: Protocol error
systemd-tmpfiles-setup-dev-early.service: Failed at step CREDENTIALS spawning systemd-tmpfiles: Protocol error
systemd-network-generator.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-network-generator.service: Failed with result 'exit-code'.
systemd-udev-load-credentials.service: Failed to set up credentials: Protocol error
systemd-udev-load-credentials.service: Failed at step CREDENTIALS spawning udevadm: Protocol error
[FAILED] Failed to start systemd-network-generator.service - Generate network units from Kernel command line.
See 'systemctl status systemd-network-generator.service' for details.
[ OK ] Finished systemd-remount-fs.service - Remount Root and Kernel File Systems.
[ OK ] Finished systemd-sysctl.service - Apply Kernel Variables.
systemd-tmpfiles-setup-dev-early.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-tmpfiles-setup-dev-early.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully.
See 'systemctl status systemd-tmpfiles-setup-dev-early.service' for details.
systemd-udev-load-credentials.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-udev-load-credentials.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-udev-load-credentials.service - Load udev Rules from Credentials.
See 'systemctl status systemd-udev-load-credentials.service' for details.
systemd-journald.service: Scheduled restart job, restart counter is at 1.
[ OK ] Reached target network-pre.target - Preparation for Network.
Starting systemd-journald.service - Journal Service...
Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev...
Starting systemd-userdbd.service - User Database Manager...
systemd-journald.service: Failed to set up credentials: Protocol error
systemd-journald.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-journald: Protocol error
systemd-tmpfiles-setup-dev.service: Failed to set up credentials: Protocol error
systemd-tmpfiles-setup-dev.service: Failed at step CREDENTIALS spawning systemd-tmpfiles: Protocol error
systemd-journald.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-tmpfiles-setup-dev.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-tmpfiles-setup-dev.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev.
See 'systemctl status systemd-tmpfiles-setup-dev.service' for details.
systemd-journald.service: Scheduled restart job, restart counter is at 2.
[ OK ] Reached target local-fs-pre.target - Preparation for Local File Systems.
[ OK ] Reached target local-fs.target - Local File Systems.
[ OK ] Listening on systemd-bootctl.socket - Boot Entries Service Socket.
[ OK ] Listening on systemd-sysext.socket - System Extension Image Management.
Starting systemd-boot-update.service - Automatic Boot Loader Update...
Starting systemd-journald.service - Journal Service...
Starting systemd-networkd.service - Network Configuration...
[ OK ] Started systemd-userdbd.service - User Database Manager.
systemd-journald.service: Failed to set up credentials: Protocol error
systemd-journald.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-journald: Protocol error
systemd-journald.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-journald.service: Scheduled restart job, restart counter is at 3.
Starting systemd-journald.service - Journal Service...
[ OK ] Finished systemd-boot-update.service - Automatic Boot Loader Update.
[ OK ] Started systemd-oomd.service - Userspace Out-Of-Memory (OOM) Killer.
systemd-networkd.service: Failed to set up credentials: Protocol error
systemd-networkd.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-networkd: Protocol error
systemd-journald.service: Failed to set up credentials: Protocol error
systemd-journald.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-journald: Protocol error
systemd-networkd.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-networkd.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-networkd.service - Network Configuration.
See 'systemctl status systemd-networkd.service' for details.
[DEPEND] Dependency failed for systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd.
systemd-networkd-persistent-storage.service: Job systemd-networkd-persistent-storage.service/start failed with result 'dependency'.
[DEPEND] Dependency failed for systemd-networkd-wait-online.service - Wait for Network to be Configured.
systemd-networkd-wait-online.service: Job systemd-networkd-wait-online.service/start failed with result 'dependency'.
systemd-journald.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-networkd.service: Scheduled restart job, restart counter is at 1.
systemd-journald.service: Scheduled restart job, restart counter is at 4.
Starting systemd-journald.service - Journal Service...
Starting systemd-networkd.service - Network Configuration...
systemd-journald.service: Failed to set up credentials: Protocol error
systemd-journald.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-journald: Protocol error
systemd-journald.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-journald.service: Scheduled restart job, restart counter is at 5.
systemd-journald.service: Start request repeated too quickly.
systemd-journald.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journald.service - Journal Service.
See 'systemctl status systemd-journald.service' for details.
systemd-journald.socket: Failed with result 'service-start-limit-hit'.
systemd-journald-dev-log.socket: Failed with result 'service-start-limit-hit'.
systemd-journal-flush.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
Starting systemd-journal-flush.service - Flush Journal to Persistent Storage...
systemd-networkd.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
systemd-networkd.service: Failed to set up credentials: Protocol error
systemd-networkd.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-networkd: Protocol error
systemd-networkd.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-networkd.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-networkd.service - Network Configuration.
See 'systemctl status systemd-networkd.service' for details.
[DEPEND] Dependency failed for systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd.
systemd-networkd-persistent-storage.service: Job systemd-networkd-persistent-storage.service/start failed with result 'dependency'.
systemd-networkd.service: Scheduled restart job, restart counter is at 2.
Starting systemd-networkd.service - Network Configuration...
systemd-journal-flush.service: Main process exited, code=exited, status=1/FAILURE
systemd-journal-flush.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-journal-flush.service - Flush Journal to Persistent Storage.
See 'systemctl status systemd-journal-flush.service' for details.
Starting systemd-tmpfiles-setup.service - Create System Files and Directories...
systemd-tmpfiles-setup.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
systemd-tmpfiles-setup.service: Failed to set up credentials: Protocol error
systemd-tmpfiles-setup.service: Failed at step CREDENTIALS spawning systemd-tmpfiles: Protocol error
systemd-networkd.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
systemd-tmpfiles-setup.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-tmpfiles-setup.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-tmpfiles-setup.service - Create System Files and Directories.
See 'systemctl status systemd-tmpfiles-setup.service' for details.
systemd-networkd.service: Failed to set up credentials: Protocol error
systemd-networkd.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-networkd: Protocol error
Starting systemd-update-utmp.service - Record System Boot/Shutdown in UTMP...
systemd-networkd.service: Main process exited, code=exited, status=243/CREDENTIALS
systemd-networkd.service: Failed with result 'exit-code'.
[FAILED] Failed to start systemd-networkd.service - Network Configuration.
See 'systemctl status systemd-networkd.service' for details.
[DEPEND] Dependency failed for systemd-networkd-persistent-storage.service - Enable Persistent Storage in systemd-networkd.
systemd-networkd-persistent-storage.service: Job systemd-networkd-persistent-storage.service/start failed with result 'dependency'.
systemd-networkd.service: Scheduled restart job, restart counter is at 3.
systemd-update-utmp.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
Starting systemd-networkd.service - Network Configuration...
systemd-networkd.service: Failed to connect stdout to the journal socket, ignoring: Connection refused
[ OK ] Finished systemd-update-utmp.service - Record System Boot/Shutdown in UTMP.
[ OK ] Reached target sysinit.target - System Initialization.
[ OK ] Started logrotate.timer - Daily rotation of log files.
[ OK ] Started systemd-tmpfiles-clean.timer - Daily Cleanup of Temporary Directories.
[ OK ] Reached target timers.target - Timer Units.
systemd-networkd.service: Failed to set up credentials: Protocol error
systemd-networkd.service: Failed at step CREDENTIALS spawning /usr/lib/systemd/systemd-networkd: Protocol error
[ OK ] Listening on dbus.socket - D-Bus System Message Bus Socket.
[ OK ] Listening on sshd-unix-local.socket - OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local).
[ OK ] Listening on systemd-hostnamed.socket - Hostname Service Socket.
[ OK ] Reached target sockets.target - Socket Units.
[ OK ] Reached target basic.target - Basic System.
...
Many other things continue to fail with the same errors.