Cannot upgrade - udev (241-7~deb10u7) is stuck

Steini84

Member
Aug 6, 2015
2
0
21
Hi,

I was trying to upgrade from 6.3 to 6.4 with apt-get update && apt-get dist-upgrade yesterday, but now I have given up and wanted to see if anyone had any idea what I could try next ? :)

At the end of the upgrade I get dependency problems which I cannot solve. It appears that udev is broken in my install and If I try to reboot in this state the machine does not come back up. I had to ZFS rollback to get the system back in a booting state, but retrying the upgrade gives the same result.

Currently the dashboard says I’m on "Virtual Environment 6.4-6" and I think the only packages I have manually installed are Syncoid/Sanoid & a check_mk client

The main problems seems to be with restarting the udev service and I see this error:
May 18 08:26:33 proxmox systemd-udevd[11677]: Failed to touch /run/udev/queue: No such file or directory

Here is the output of the apt-get dist-upgrade
Code:
root@proxmox:~# apt-get update
Hit:1 http://ftp.is.debian.org/debian buster InRelease
Hit:2 http://download.proxmox.com/debian/pve buster InRelease
Hit:3 http://ftp.is.debian.org/debian buster-updates InRelease
Hit:4 http://security.debian.org buster/updates InRelease
Reading package lists... Done
root@proxmox:~# apt-get dist-upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
7 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Setting up udev (241-7~deb10u7) ...
Job for systemd-udevd.service failed.
See "systemctl status systemd-udevd.service" and "journalctl -xe" for details.
invoke-rc.d: initscript udev, action "restart" failed.
● systemd-udevd.service - udev Kernel Device Manager
   Loaded: loaded (/lib/systemd/system/systemd-udevd.service; static; vendor preset: enabled)
   Active: activating (start) since Tue 2021-05-18 08:14:53 GMT; 6ms ago
     Docs: man:systemd-udevd.service(8)
           man:udev(7)
 Main PID: 25924 ((md-udevd))
    Tasks: 1
   Memory: 128.0K
   CGroup: /system.slice/systemd-udevd.service
           └─25924 (md-udevd)

May 18 08:14:53 proxmox systemd[1]: Starting udev Kernel Device Manager...
dpkg: error processing package udev (--configure):
 installed udev package post-installation script subprocess returned error exit status 1
dpkg: dependency problems prevent configuration of libpve-storage-perl:
 libpve-storage-perl depends on udev; however:
  Package udev is not configured yet.

dpkg: error processing package libpve-storage-perl (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-container:
 pve-container depends on libpve-storage-perl (>= 6.3-8); however:
  Package libpve-storage-perl is not configured yet.

dpkg: error processing package pve-container (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-kernel-helper:
 pve-kernel-helper depends on udev; however:
  Package udev is not configured yet.

dpkg: error processing package pve-kernel-helper (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-manager:
 pve-manager depends on libpve-storage-perl (>= 6.3-6); however:
  Package libpve-storage-perl is not configured yet.
 pve-manager depends on pve-container (>= 2.0-21); however:
  Package pve-container is not configured yet.

dpkg: error processing package pve-manager (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of qemu-server:
 qemu-server depends on libpve-storage-perl (>= 6.3-8); however:
  Package libpve-storage-perl is not configured yet.

dpkg: error processing package qemu-server (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on pve-kernel-helper; however:
  Package pve-kernel-helper is not configured yet.
 proxmox-ve depends on pve-manager; however:
  Package pve-manager is not configured yet.
 proxmox-ve depends on qemu-server; however:
  Package qemu-server is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent processing triggers for pve-ha-manager:
 pve-ha-manager depends on pve-container; however:
  Package pve-container is not configured yet.
 pve-ha-manager depends on qemu-server (>= 6.0-15); however:
  Package qemu-server is not configured yet.

dpkg: error processing package pve-ha-manager (--configure):
 dependency problems - leaving triggers unprocessed
Errors were encountered while processing:
 udev
 libpve-storage-perl
 pve-container
 pve-kernel-helper
 pve-manager
 qemu-server
 proxmox-ve
 pve-ha-manager
E: Sub-process /usr/bin/dpkg returned an error code (1)

Here is my sources.lst file
Code:
root@proxmox:~# cat /etc/apt/sources.list
deb http://ftp.is.debian.org/debian buster main contrib

deb http://ftp.is.debian.org/debian buster-updates main contrib

# security updates
deb http://security.debian.org buster/updates main contrib

# PVE pve-no-subscription repository provided by proxmox.com,
# NOT recommended for production use
deb http://download.proxmox.com/debian/pve buster pve-no-subscription

And here is the output from systemd
Code:
root@proxmox:~# systemctl status udev.service
● systemd-udevd.service - udev Kernel Device Manager
   Loaded: loaded (/lib/systemd/system/systemd-udevd.service; static; vendor preset: enabled)
   Active: activating (start) since Tue 2021-05-18 08:17:53 GMT; 1min 1s ago
     Docs: man:systemd-udevd.service(8)
           man:udev(7)
 Main PID: 31032 (systemd-udevd)
    Tasks: 1
   Memory: 2.0M
   CGroup: /system.slice/systemd-udevd.service
           └─31032 /lib/systemd/systemd-udevd

May 18 08:18:14 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:24 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:31 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:31 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:31 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:31 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:32 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:32 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:33 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory
May 18 08:18:33 proxmox systemd-udevd[31032]: Failed to touch /run/udev/queue: No such file or directory

Some lines from journalctl:
Code:
May 18 12:25:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd[1]: Starting Proxmox VE replication runner...
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd[1]: pvesr.service: Succeeded.
May 18 12:26:00 proxmox systemd[1]: Started Proxmox VE replication runner.
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:00 proxmox systemd-udevd[28503]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:26:11 proxmox systemd[1]: systemd-udevd.service: Start operation timed out. Terminating.
May 18 12:26:11 proxmox systemd[1]: systemd-udevd.service: Failed with result 'timeout'.
May 18 12:26:11 proxmox systemd[1]: Failed to start udev Kernel Device Manager.
May 18 12:26:11 proxmox systemd[1]: systemd-udevd.service: Service has no hold-off time (RestartSec=0), scheduling restart.
May 18 12:26:11 proxmox systemd[1]: systemd-udevd.service: Scheduled restart job, restart counter is at 35.
May 18 12:26:11 proxmox systemd[1]: Stopped udev Kernel Device Manager.
May 18 12:26:11 proxmox systemd[1]: Starting udev Kernel Device Manager...
May 18 12:26:11 proxmox systemd-udevd[30484]: Failed to parse kernel command line, ignoring: No such file or directory
May 18 12:26:11 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd[1]: Starting Proxmox VE replication runner...
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd[1]: pvesr.service: Succeeded.
May 18 12:27:00 proxmox systemd[1]: Started Proxmox VE replication runner.
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:00 proxmox systemd-udevd[30484]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:27:41 proxmox systemd[1]: systemd-udevd.service: Start operation timed out. Terminating.
May 18 12:27:41 proxmox systemd[1]: systemd-udevd.service: Failed with result 'timeout'.
May 18 12:27:41 proxmox systemd[1]: Failed to start udev Kernel Device Manager.
May 18 12:27:41 proxmox systemd[1]: systemd-udevd.service: Service has no hold-off time (RestartSec=0), scheduling restart.
May 18 12:27:41 proxmox systemd[1]: systemd-udevd.service: Scheduled restart job, restart counter is at 36.
May 18 12:27:41 proxmox systemd[1]: Stopped udev Kernel Device Manager.
May 18 12:27:41 proxmox systemd[1]: Starting udev Kernel Device Manager...
May 18 12:27:42 proxmox systemd-udevd[32458]: Failed to parse kernel command line, ignoring: No such file or directory
May 18 12:27:42 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd[1]: Starting Proxmox VE replication runner...
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd[1]: pvesr.service: Succeeded.
May 18 12:28:00 proxmox systemd[1]: Started Proxmox VE replication runner.
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory
May 18 12:28:00 proxmox systemd-udevd[32458]: Failed to touch /run/udev/queue: No such file or directory

root@proxmox:~# uname -a Linux proxmox 5.4.78-2-pve #1 SMP PVE 5.4.78-2 (Thu, 03 Dec 2020 14:26:17 +0100) x86_64 GNU/Linux

Thanks
 
Last edited:
I fixed it with a horrible hack. I manually commented out
invoke-rc.d udev start & invoke-rc.d udev restart from /var/lib/dpkg/info/udev.postinst and let the install finish.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!