[SOLVED] Cannot boot into new kernel after upgrade to 6.5 (PVE 8.1.3)

[eyeless77]

Hi all,

I tried to upgrade my hypervisor just as usual by apt update and apt dist-upgrade followed by reboot commands. This was a minor upgrade from 8.0.x to 8.1. But the server didn't boot up. After connecting to KVM console I've noticed that it's stuck on boot.

I had some kernel versions installed and tried to boot into different kernels. I couldn't boot into 6.x kernels anymore: 6.5 was stuck at RPCbind Server Activation Socket step, and the previous kernel 6.2 ended with Kernel Panic. The only version I could boot into was 5.15.108.1, all VMs are up and running, and the PVE version is shown as 8.1.3 in GUI. After some investigation I figured out that the /boot partition was 100% full and this means that I had a corrupt kernel upgrade.

I tried to do the following steps.
1. apt autoremove
2. apt --fix-broken install
3. update-grub
4. update-initramfs -u

But no luck after reboot, I cannot boot into 6.5/6.2 kernel. I tried to reinstall 6.2 kernel:
1. apt reinstall pve-kernel-6.2.16-3-pve
2. update-grub
3. update-initramfs -u

Can anyone give some advice how can I correctly upgrade to 6.5 from 5.15 kernel?

 

[eyeless77]

Some screenshots with 6.5 stuck on boot (quiet).



And regular one:

 

[eyeless77]

One more thing I tried:

- Remove all 6.2/6.5 kernels with apt remove proxmox-kernel-6.xx.x-pve
- Install them from scratch: apt install proxmox-kernel-6.5.11-5-pve, apt install proxmox-kernel-6.2.16-19-pve.

Now I've got the following grub menu:



But I'm still unable to boot into 6.2.16-19 or 6.5.11-5 kernels. The screenshot below is for 6.5 kernel boot attempt:




But I can only boot into 5.15 kernel.

 

[newuser123]

eyeless - any traction on this issue?
I ran into a similar issue last night - can't boot at all, says it's missing an initram file, and then completely freezes.

Open ears for anything that you tried to do, to fix your issue.

Many thanks.

 

[eyeless77]

What I've done.
1. Used this script inside 5.15 kernel (https://github.com/jordanhillis/pvekclean.git) with flags pvekclean -rn to remove all kernels except 5.15 and 6.5
2. Installed latest kernel 6.5.11-6-pve with apt dist-upgrade

The KVM console is still unresponsive, but the host boots at least.

 

[newuser123]

What I've done.
1. Used this script inside 5.15 kernel (https://github.com/jordanhillis/pvekclean.git) with flags pvekclean -rn to remove all kernels except 5.15 and 6.5
2. Installed latest kernel 6.5.11-6-pve with apt dist-upgrade

The KVM console is still unresponsive, but the host boots at least.

Thanks a lot brother, will try this