Failure during upgrade from 6 -> 7 (kernel issues)

[TaphoonFM]

I just wanted to upgrade a node from pve 6 to 7. Unfortunately I started the upgrade in the Web-Shell (shame on me) and lost connection just when it was almost finished. last thing i saw was the question about making changes to grub. The update then was blocked and I could not finish. I rebooted the machine.

Now I get these errors when I try to run apt dist-upgrade again:

root@node02:~# apt dist-upgrade
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Calculating upgrade... Done
The following packages were automatically installed and are no longer required:
  dctrl-tools g++-10 libstdc++-10-dev libtiff5 libwebp6 linux-compiler-gcc-10-x86 linux-headers-5.10.0-26-amd64 linux-headers-5.10.0-26-common linux-kbuild-5.10 pve-headers telnet
Use 'apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
7 not fully installed or removed.
After this operation, 0 B of additional disk space will be used.
Do you want to continue? [Y/n] y
Setting up proxmox-kernel-6.2.16-15-pve (6.2.16-15) ...
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/dkms 6.2.16-15-pve /boot/vmlinuz-6.2.16-15-pve
dkms: running auto installation service for kernel 6.2.16-15-pve.
Sign command: /lib/modules/6.2.16-15-pve/build/scripts/sign-file
Signing key: /var/lib/dkms/mok.key
Public certificate (MOK): /var/lib/dkms/mok.pub

Building module:
Cleaning build area...(bad exit status: 2)
make -j56 KERNELRELEASE=6.2.16-15-pve all KPVER=6.2.16-15-pve....(bad exit status: 2)
Error! Bad return status for module build on kernel: 6.2.16-15-pve (x86_64)
Consult /var/lib/dkms/kernel-mft-dkms/4.17.0/build/make.log for more information.
Error! One or more modules failed to install during autoinstall.
Refer to previous errors for more information.
dkms: autoinstall for kernel: 6.2.16-15-pve failed!
run-parts: /etc/kernel/postinst.d/dkms exited with return code 11
Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/proxmox-kernel-6.2.16-15-pve.postinst line 20.
dpkg: error processing package proxmox-kernel-6.2.16-15-pve (--configure):
 installed proxmox-kernel-6.2.16-15-pve package post-installation script subprocess returned error exit status 2
Setting up linux-headers-6.1.0-13-amd64 (6.1.55-1) ...
/etc/kernel/header_postinst.d/dkms:
dkms: running auto installation service for kernel 6.1.0-13-amd64.
Sign command: /usr/lib/linux-kbuild-6.1/scripts/sign-file
Signing key: /var/lib/dkms/mok.key
Public certificate (MOK): /var/lib/dkms/mok.pub

Building module:
Cleaning build area...(bad exit status: 2)
make -j56 KERNELRELEASE=6.1.0-13-amd64 all KPVER=6.1.0-13-amd64....(bad exit status: 2)
Error! Bad return status for module build on kernel: 6.1.0-13-amd64 (x86_64)
Consult /var/lib/dkms/kernel-mft-dkms/4.17.0/build/make.log for more information.
Error! One or more modules failed to install during autoinstall.
Refer to previous errors for more information.
dkms: autoinstall for kernel: 6.1.0-13-amd64 failed!
run-parts: /etc/kernel/header_postinst.d/dkms exited with return code 11
Failed to process /etc/kernel/header_postinst.d at /var/lib/dpkg/info/linux-headers-6.1.0-13-amd64.postinst line 11.
dpkg: error processing package linux-headers-6.1.0-13-amd64 (--configure):
 installed linux-headers-6.1.0-13-amd64 package post-installation script subprocess returned error exit status 1
dpkg: dependency problems prevent configuration of linux-headers-amd64:
 linux-headers-amd64 depends on linux-headers-6.1.0-13-amd64 (= 6.1.55-1); however:
  Package linux-headers-6.1.0-13-amd64 is not configured yet.

dpkg: error processing package linux-headers-amd64 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of proxmox-kernel-6.2:
 proxmox-kernel-6.2 depends on proxmox-kernel-6.2.16-15-pve; however:
  Package proxmox-kernel-6.2.16-15-pve is not configured yet.

dpkg: error processing package proxmox-kernel-6.2 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of proxmox-default-kernel:
 proxmox-default-kernel depends on proxmox-kernel-6.2; however:
  Package proxmox-kernel-6.2 is not configured yet.

dpkg: error processing package proxmox-default-kernel (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of pve-kernel-6.2:
 pve-kernel-6.2 depends on proxmox-kernel-6.2; however:
  Package proxmox-kernel-6.2 is not configured yet.

dpkg: error processing package pve-kernel-6.2 (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of proxmox-ve:
 proxmox-ve depends on proxmox-default-kernel; however:
  Package proxmox-default-kernel is not configured yet.

dpkg: error processing package proxmox-ve (--configure):
 dependency problems - leaving unconfigured
Errors were encountered while processing:
 proxmox-kernel-6.2.16-15-pve
 linux-headers-6.1.0-13-amd64
 linux-headers-amd64
 proxmox-kernel-6.2
 proxmox-default-kernel
 pve-kernel-6.2
 proxmox-ve
E: Sub-process /usr/bin/dpkg returned an error code (1)

The Webview of the instance is showing me the following information:
Linux 5.15.126-1-pve #1 SMP PVE 5.15.126-1 (2023-10-03T17:24Z)
pve-manager/8.0.4/d258a813cfa6b390

How can I solve this kernel issue and install the latest supported kernel?

Any help is very much appreciated!

 

[Moayad]

Hi,

Did you tried `dpkg --configure -a` or `apt install -f` commands?

 

[fiona]

Hi,

Consult /var/lib/dkms/kernel-mft-dkms/4.17.0/build/make.log for more information.

this dkms module is likely not compatible with new kernels. But there should be a built-in module so you probably don't even need it. See this thread for another report: https://forum.proxmox.com/threads/update-von-7-auf-8-fehlgeschlagen.129327/post-566409

After that's working, I'd also suggest to remove the linux-headers-6.1.0-13-amd64 as that's not related to the Proxmox kernel and likely a left-over from the original Debian installation.

 

[TaphoonFM]

Hi,

this dkms module is likely not compatible with new kernels. But there should be a built-in module so you probably don't even need it. See this thread for another report: https://forum.proxmox.com/threads/update-von-7-auf-8-fehlgeschlagen.129327/post-566409

After that's working, I'd also suggest to remove the linux-headers-6.1.0-13-amd64 as that's not related to the Proxmox kernel and likely a left-over from the original Debian installation.

Thanks for the link. The issue was caused by a module that I had installed for a Mellanox QSFP module. Since I dont need this anymore, I was able to remove this package and the kernels could be built successfully. Now up and running, thanks!