[SOLVED] Update gone wrong

houya

New Member
Nov 20, 2024
5
1
3
Hi everyone!

Running Proxmox VE 8.2.8, I launched an upgrade via the web GUI. Something went wrong when installing proxmox-kernel-6.8.8-4
After showing errors (see above), the console was unresponsive. The web GUI was unreachable (time out). I had to poweroff the server.

Reboot did not go to the end and I had to power off again.
Booting to recovery mode suggested doing a manual fsck. I did it and some orphan nodes were fixed. The reboot still hang up before the end.

So, in grub, I chose to boot with kernel 6.8.12-3 instead of 6.8.12-4. This time, everything went the right way. The VM's are running and the web GUI is working.

What should I do now?
Do I have to remove some files (which ones?) and try to upgrade again?


Bash:
Starting system upgrade: apt-get dist-upgrade

Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  proxmox-kernel-6.8.12-1-pve-signed proxmox-kernel-6.8.8-4-pve-signed
Use 'apt autoremove' to remove them.
The following NEW packages will be installed:
  proxmox-kernel-6.8.12-4-pve-signed
The following packages will be upgraded:
  base-files bsdextrautils bsdutils btrfs-progs curl distro-info-data eject fdisk
  iputils-ping libarchive13 libblkid1 libc-bin libc-l10n libc6 libcurl3-gnutls
  libcurl4 libfdisk1 libglib2.0-0 libmount1 libmpg123-0 libnghttp2-14
  libnss-systemd libnss3 libpam-systemd libpve-common-perl libpve-rs-perl
  libpve-storage-perl libpython3.11-minimal libpython3.11-stdlib libsmartcols1
  libsqlite3-0 libssl3 libsystemd-shared libsystemd0 libudev1 libuuid1 locales
  mount novnc-pve openssl proxmox-archive-keyring proxmox-backup-client
  proxmox-backup-file-restore proxmox-kernel-6.8 proxmox-widget-toolkit
  pve-container pve-docs pve-manager pve-qemu-kvm python3.11 python3.11-minimal
  qemu-server sqlite3 systemd systemd-boot systemd-boot-efi systemd-sysv udev
  util-linux util-linux-extra
60 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 192 MB of archives.
After this operation, 579 MB of additional disk space will be used.
Do you want to continue? [Y/n] Y
Get:1 http://security.debian.org bookworm-security/main amd64 libarchive13 amd64 3.6.2-1+deb12u2 [343 kB]
Get:2 http://ftp.us.debian.org/debian bookworm/main amd64 base-files amd64 12.4+deb12u8 [70.9 kB]
Get:3 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-rs-perl amd64 0.8.11 [2723 kB]
Get:4 http://security.debian.org bookworm-security/main amd64 libmpg123-0 amd64 1.31.2-1+deb12u1 [147 kB]
Get:5 http://ftp.us.debian.org/debian bookworm/main amd64 bsdutils amd64 1:2.38.1-5+deb12u2 [94.5 kB]
Get:6 http://ftp.us.debian.org/debian bookworm/main amd64 libc6 amd64 2.36-9+deb12u9 [2757 kB]
Get:7 http://security.debian.org bookworm-security/main amd64 libnss3 amd64 2:3.87.1-1+deb12u1 [1331 kB]
Get:8 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-common-perl all 8.2.8 [118 kB]
Get:9 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-backup-client amd64 3.2.8-1 [3245 kB]
Get:10 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-backup-file-restore amd64 3.2.8-1 [3236 kB]
Get:11 http://ftp.us.debian.org/debian bookworm/main amd64 libsmartcols1 amd64 2.38.1-5+deb12u2 [107 kB]
Get:12 http://ftp.us.debian.org/debian bookworm/main amd64 util-linux-extra amd64 2.38.1-5+deb12u2 [111 kB]
Get:13 http://ftp.us.debian.org/debian bookworm/main amd64 util-linux amd64 2.38.1-5+deb12u2 [1176 kB]
Get:14 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 libpve-storage-perl all 8.2.6 [140 kB]
Get:15 http://ftp.us.debian.org/debian bookworm/main amd64 libc-bin amd64 2.36-9+deb12u9 [608 kB]
Get:16 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 novnc-pve all 1.5.0-1 [508 kB]
Get:17 http://ftp.us.debian.org/debian bookworm/main amd64 mount amd64 2.38.1-5+deb12u2 [134 kB]
Get:18 http://ftp.us.debian.org/debian bookworm/main amd64 libnss-systemd amd64 252.31-1~deb12u1 [163 kB]
Get:19 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-archive-keyring all 3.1 [6008 B]
Get:20 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-kernel-6.8.12-4-pve-signed amd64 6.8.12-4 [103 MB]
Get:21 http://ftp.us.debian.org/debian bookworm/main amd64 libblkid1 amd64 2.38.1-5+deb12u2 [147 kB]
Get:22 http://ftp.us.debian.org/debian bookworm/main amd64 libmount1 amd64 2.38.1-5+deb12u2 [165 kB]
Get:23 http://ftp.us.debian.org/debian bookworm/main amd64 libssl3 amd64 3.0.15-1~deb12u1 [2025 kB]
Get:24 http://ftp.us.debian.org/debian bookworm/main amd64 systemd-boot amd64 252.31-1~deb12u1 [100 kB]
Get:25 http://ftp.us.debian.org/debian bookworm/main amd64 systemd-boot-efi amd64 252.31-1~deb12u1 [112 kB]
Get:26 http://ftp.us.debian.org/debian bookworm/main amd64 libpam-systemd amd64 252.31-1~deb12u1 [225 kB]
Get:27 http://ftp.us.debian.org/debian bookworm/main amd64 systemd amd64 252.31-1~deb12u1 [3036 kB]
Get:28 http://ftp.us.debian.org/debian bookworm/main amd64 libsystemd-shared amd64 252.31-1~deb12u1 [1693 kB]
Get:29 http://ftp.us.debian.org/debian bookworm/main amd64 systemd-sysv amd64 252.31-1~deb12u1 [42.5 kB]
Get:30 http://ftp.us.debian.org/debian bookworm/main amd64 libuuid1 amd64 2.38.1-5+deb12u2 [28.7 kB]
Get:31 http://ftp.us.debian.org/debian bookworm/main amd64 libfdisk1 amd64 2.38.1-5+deb12u2 [193 kB]
Get:32 http://ftp.us.debian.org/debian bookworm/main amd64 libsystemd0 amd64 252.31-1~deb12u1 [332 kB]
Get:33 http://ftp.us.debian.org/debian bookworm/main amd64 python3.11 amd64 3.11.2-6+deb12u4 [573 kB]
Get:34 http://ftp.us.debian.org/debian bookworm/main amd64 libpython3.11-stdlib amd64 3.11.2-6+deb12u4 [1797 kB]
Get:35 http://ftp.us.debian.org/debian bookworm/main amd64 python3.11-minimal amd64 3.11.2-6+deb12u4 [2066 kB]
Get:36 http://ftp.us.debian.org/debian bookworm/main amd64 libpython3.11-minimal amd64 3.11.2-6+deb12u4 [815 kB]
Get:37 http://ftp.us.debian.org/debian bookworm/main amd64 sqlite3 amd64 3.40.1-2+deb12u1 [353 kB]
Get:38 http://ftp.us.debian.org/debian bookworm/main amd64 libsqlite3-0 amd64 3.40.1-2+deb12u1 [839 kB]
Get:39 http://ftp.us.debian.org/debian bookworm/main amd64 udev amd64 252.31-1~deb12u1 [1688 kB]
Get:40 http://ftp.us.debian.org/debian bookworm/main amd64 libudev1 amd64 252.31-1~deb12u1 [109 kB]
Get:41 http://ftp.us.debian.org/debian bookworm/main amd64 fdisk amd64 2.38.1-5+deb12u2 [141 kB]
Get:42 http://ftp.us.debian.org/debian bookworm/main amd64 iputils-ping amd64 3:20221126-1+deb12u1 [47.2 kB]
Get:43 http://ftp.us.debian.org/debian bookworm/main amd64 libc-l10n all 2.36-9+deb12u9 [677 kB]
Get:44 http://ftp.us.debian.org/debian bookworm/main amd64 locales all 2.36-9+deb12u9 [3904 kB]
Get:45 http://ftp.us.debian.org/debian bookworm/main amd64 bsdextrautils amd64 2.38.1-5+deb12u2 [86.8 kB]
Get:46 http://ftp.us.debian.org/debian bookworm/main amd64 btrfs-progs amd64 6.2-1+deb12u1 [754 kB]
Get:47 http://ftp.us.debian.org/debian bookworm/main amd64 libnghttp2-14 amd64 1.52.0-1+deb12u2 [73.0 kB]
Get:48 http://ftp.us.debian.org/debian bookworm/main amd64 curl amd64 7.88.1-10+deb12u8 [315 kB]
Get:49 http://ftp.us.debian.org/debian bookworm/main amd64 libcurl4 amd64 7.88.1-10+deb12u8 [390 kB]
Get:50 http://ftp.us.debian.org/debian bookworm/main amd64 distro-info-data all 0.58+deb12u3 [6272 B]
Get:51 http://ftp.us.debian.org/debian bookworm/main amd64 eject amd64 2.38.1-5+deb12u2 [48.0 kB]
Get:52 http://ftp.us.debian.org/debian bookworm/main amd64 libcurl3-gnutls amd64 7.88.1-10+deb12u8 [385 kB]
Get:53 http://ftp.us.debian.org/debian bookworm/main amd64 libglib2.0-0 amd64 2.74.6-2+deb12u4 [1400 kB]
Get:54 http://ftp.us.debian.org/debian bookworm/main amd64 openssl amd64 3.0.15-1~deb12u1 [1427 kB]
Get:55 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-kernel-6.8 all 6.8.12-4 [10.6 kB]
Get:56 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 proxmox-widget-toolkit all 4.3.0 [218 kB]
Get:57 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-container all 5.2.1 [140 kB]
Get:58 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-docs all 8.2.4 [15.6 MB]
Get:59 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-qemu-kvm amd64 9.0.2-4 [29.2 MB]
Ign:59 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-qemu-kvm amd64 9.0.2-4
Get:60 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 qemu-server amd64 8.2.6 [281 kB]
Get:61 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-manager amd64 8.2.8 [544 kB]
Get:59 http://download.proxmox.com/debian/pve bookworm/pve-no-subscription amd64 pve-qemu-kvm amd64 9.0.2-4 [29.2 MB]
Fetched 185 MB in 7min 6s (435 kB/s)                                                
Reading changelogs... Done
Extracting templates from packages: 100%
Preconfiguring packages ...
(Reading database ... 76798 files and directories currently installed.)
Preparing to unpack .../base-files_12.4+deb12u8_amd64.deb ...
Unpacking base-files (12.4+deb12u8) over (12.4+deb12u7) ...
Setting up base-files (12.4+deb12u8) ...
Installing new version of config file /etc/debian_version ...
(Reading database ... 76798 files and directories currently installed.)
Preparing to unpack .../bsdutils_1%3a2.38.1-5+deb12u2_amd64.deb ...
Unpacking bsdutils (1:2.38.1-5+deb12u2) over (1:2.38.1-5+deb12u1) ...
Setting up bsdutils (1:2.38.1-5+deb12u2) ...
(Reading database ... 76798 files and directories currently installed.)
Preparing to unpack .../libc6_2.36-9+deb12u9_amd64.deb ...
Unpacking libc6:amd64 (2.36-9+deb12u9) over (2.36-9+deb12u8) ...
Setting up libc6:amd64 (2.36-9+deb12u9) ...
(Reading database ... 76798 files and directories currently installed.)
Preparing to unpack .../libsmartcols1_2.38.1-5+deb12u2_amd64.deb ...
Unpacking libsmartcols1:amd64 (2.38.1-5+deb12u2) over (2.38.1-5+deb12u1) ...
Setting up libsmartcols1:amd64 (2.38.1-5+deb12u2) ...
(Reading database ... 76798 files and directories currently installed.)
......................................................................................................

........................ a lot of preparing and unpacking ..................
.....................................................................................................

Preparing to unpack .../23-proxmox-archive-keyring_3.1_all.deb ...
Unpacking proxmox-archive-keyring (3.1) over (3.0) ...
Selecting previously unselected package proxmox-kernel-6.8.12-4-pve-signed.
Preparing to unpack .../24-proxmox-kernel-6.8.12-4-pve-signed_6.8.12-4_amd64.deb ...
Unpacking proxmox-kernel-6.8.12-4-pve-signed (6.8.12-4) ...
Preparing to unpack .../25-proxmox-kernel-6.8_6.8.12-4_all.deb ...
Unpacking proxmox-kernel-6.8 (6.8.12-4) over (6.8.12-3) ...
Preparing to unpack .../26-proxmox-widget-toolkit_4.3.0_all.deb ...
Unpacking proxmox-widget-toolkit (4.3.0) over (4.2.4) ...
Preparing to unpack .../27-pve-container_5.2.1_all.deb ...
Unpacking pve-container (5.2.1) over (5.2.0) ...
Preparing to unpack .../28-pve-docs_8.2.4_all.deb ...
Unpacking pve-docs (8.2.4) over (8.2.3) ...
Preparing to unpack .../29-pve-qemu-kvm_9.0.2-4_amd64.deb ...
Unpacking pve-qemu-kvm (9.0.2-4) over (9.0.2-3) ...
Preparing to unpack .../30-qemu-server_8.2.6_amd64.deb ...
Unpacking qemu-server (8.2.6) over (8.2.4) ...
Preparing to unpack .../31-pve-manager_8.2.8_amd64.deb ...
Unpacking pve-manager (8.2.8) over (8.2.7) ...
Setting up proxmox-backup-file-restore (3.2.8-1) ...
Updating file-restore initramfs...
14134 blocks
Setting up systemd-boot-efi:amd64 (252.31-1~deb12u1) ...
Setting up systemd-sysv (252.31-1~deb12u1) ...
Setting up proxmox-widget-toolkit (4.3.0) ...
Setting up libc-l10n (2.36-9+deb12u9) ...
Setting up libmpg123-0:amd64 (1.31.2-1+deb12u1) ...
Setting up bsdextrautils (2.38.1-5+deb12u2) ...
Setting up libarchive13:amd64 (3.6.2-1+deb12u2) ...
Setting up libglib2.0-0:amd64 (2.74.6-2+deb12u4) ...
No schema files found: doing nothing.
Setting up distro-info-data (0.58+deb12u3) ...
Setting up btrfs-progs (6.2-1+deb12u1) ...
Setting up libsqlite3-0:amd64 (3.40.1-2+deb12u1) ...
Setting up proxmox-kernel-6.8.12-4-pve-signed (6.8.12-4) ...
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/initramfs-tools 6.8.12-4-pve /boot/vmlinuz-6.8.12-4-pve
update-initramfs: Generating /boot/initrd.img-6.8.12-4-pve
/usr/sbin/mkinitramfs: 273: rm: Input/output error
/usr/sbin/mkinitramfs: 273: rm: Input/output error
/usr/sbin/mkinitramfs: 273: rm: Input/output error
/usr/sbin/mkinitramfs: 273: rm: Input/output error
/usr/sbin/update-initramfs: 143: mv: Input/output error
run-parts: /etc/kernel/postinst.d/initramfs-tools exited with return code 126
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/proxmox-kernel-6.8.12-4-pve-signed.postinst line 20.
dpkg: error processing package proxmox-kernel-6.8.12-4-pve-signed (--configure):
 installed proxmox-kernel-6.8.12-4-pve-signed package post-installation script subprocess returned error exit status 2
dpkg: unrecoverable fatal error, aborting:
 failed to open diversions file: Input/output error
E: Sub-process /usr/bin/dpkg returned an error code (2)
W: Problem unlinking the file /var/cache/apt/pkgcache.bin - pkgDPkgPM::Go (30: Read-only file system)
error reading cached package status in '/var/lib/pve-manager/pkgupdates' - can't open '/var/lib/pve-manager/pkgupdates' - Input/output error

Can't locate AptPkg/Config.pm in @INC (you may need to install the AptPkg::Config module) (@INC contains: /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.36.0 /usr/local/share/perl/5.36.0 /usr/lib/x86_64-linux-gnu/perl5/5.36 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl-base /usr/lib/x86_64-linux-gnu/perl/5.36 /usr/share/perl/5.36 /usr/local/lib/site_perl) at /usr/lib/x86_64-linux-gnu/perl5/5.36/AptPkg/hash.pm line 20, <DATA> line 960.
BEGIN failed--compilation aborted, <DATA> line 960.
 
Hello @houya welcome to the forum.

update-initramfs: Generating /boot/initrd.img-6.8.12-4-pve
/usr/sbin/mkinitramfs: 273: rm: Input/output error
This error means that while installing the kernel 6.8.12-4-pve PVE couldn't write to or read from the system disk.

I would check the disk health and the cables. Maybe do a SMART test.
 
Thanks for your reply.
The SMART status is OK and fsck does not find anything wrong.

Can something go wrong again if I use autoremove and try another dist-upgrade?
 
Does your system have a separate /boot partition? Maybe it is broken or out of space.
No separate partition.
This is a very basic configuration:

Code:
Device       Start        End    Sectors   Size Type
/dev/sdb1       34       2047       2014  1007K BIOS boot
/dev/sdb2     2048    2099199    2097152     1G EFI System
/dev/sdb3  2099200 1953525134 1951425935 930.5G Linux LVM
 
Everything is back to normal.
This fixed the issue:

dpkg --configure -a

The server is now using 6.8.12-4-pve
 
  • Like
Reactions: UdoB

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!