Opt-in Linux 6.5 Kernel with ZFS 2.2 for Proxmox VE 8 available on test & no-subscription

Hang on 'loading initial ramdisk' also apply to Dell T140. It does not seem to be a network issue (only)
 
DELL T140

lspci -nnk | grep -i broadcom
01:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] [1000:005f] (rev 02)
05:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
05:00.1 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
 
I remember an error with an early 5.15 Kernel which prevents booting the Dell T140 because of an 'could not import rpool' error. it was a problem with the disk controller on this device.
 
New kernel today on T340 :
6.5.11-7 -> Hang
6.2.16-20 -> Boot OK
That was obvious, because 6.5.11-6 -> 6.5.11-7 reactivated the simplefb (simple framebuffer) and didn't change anything about the Dell Problem.
I have 4 Dells with old kernel which i cannot reboot via SSH at the moment. I am on tenterhooks.

Next time if a big update is on line, i will skip the update for a month. Lesson learned.
 
Last edited:
Saved my day. I tried another boot-tool command i do not remember which told me, the given kernel did not exist. pinning worked.

Code:
# proxmox-boot-tool kernel list
Manually selected kernels:
None.

Automatically selected kernels:
6.2.16-19-pve
6.5.11-6-pve


# proxmox-boot-tool kernel pin 6.2.16-19-pve
Set kernel '6.2.16-19-pve' in /etc/kernel/proxmox-boot-pin.
Refresh the actual boot ESPs now? [yN] y
Running hook script 'proxmox-auto-removal'..
Running hook script 'zz-proxmox-boot'..
Re-executing '/etc/kernel/postinst.d/zz-proxmox-boot' in new private mount namespace..
No /etc/kernel/cmdline found - falling back to /proc/cmdline
Copying and configuring kernels on /dev/disk/by-uuid/77AA-F55C
        Copying kernel 6.2.16-19-pve
        Copying kernel 6.5.11-6-pve
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.5.11-6-pve
Found initrd image: /boot/initrd.img-6.5.11-6-pve
Found linux image: /boot/vmlinuz-6.2.16-19-pve
Found initrd image: /boot/initrd.img-6.2.16-19-pve
done
Copying and configuring kernels on /dev/disk/by-uuid/77AB-5C55
        Copying kernel 6.2.16-19-pve
        Copying kernel 6.5.11-6-pve
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.5.11-6-pve
Found initrd image: /boot/initrd.img-6.5.11-6-pve
Found linux image: /boot/vmlinuz-6.2.16-19-pve
Found initrd image: /boot/initrd.img-6.2.16-19-pve
done
 
Dell PowerEdge R240, dual port BCM5720.
Kernel 6.2.16 boots ok
Kernel 6.5.11-7 (or also 6.5.11-6) hangs at boot.
Last message on the screen is "EFI stub: Loaded initrd from command line option"

I've updated:
BIOS from 2.10.1 to 2.15.1
Broadcom NetXtreme from FFV22.00.6 bc 5720-v1.39 to FFV22.61.8
but still 6.5.11-x does not boot
 
Last edited:
Kernel 6.5.11-7 and Adaptec ASR8805:
aacraid: Outstanding commands on
aacraid: Host bus reset request. SCSI hang ?

Kernel 6.2.16-20 no problems...
 
Just to toss some additional data in this thread, I did a fresh install of Proxmox VE 8.1 from ISO on a Dell R740, and had no issues during the install, nor after applying all updates.

Code:
root@test-r740-pve:~#  lspci -nnk | grep -i broadcom
01:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:4120]
01:00.1 Ethernet controller [0200]: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:165f]
        Subsystem: Broadcom Inc. and subsidiaries NetXtreme BCM5720 Gigabit Ethernet PCIe [14e4:4120]
18:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] [1000:005f] (rev 02)
19:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries BCM57412 NetXtreme-E 10Gb RDMA Ethernet Controller [14e4:16d6] (rev 01)
        Subsystem: Broadcom Inc. and subsidiaries NetXtreme E-Series Advanced Dual-port 10Gb SFP+ Ethernet Network Daughter Card [14e4:4120]
19:00.1 Ethernet controller [0200]: Broadcom Inc. and subsidiaries BCM57412 NetXtreme-E 10Gb RDMA Ethernet Controller [14e4:16d6] (rev 01)
        Subsystem: Broadcom Inc. and subsidiaries NetXtreme E-Series Advanced Dual-port 10Gb SFP+ Ethernet Network Daughter Card [14e4:4120]
86:00.0 Ethernet controller [0200]: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller [14e4:16d7] (rev 01)
        Subsystem: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller [14e4:4141]
86:00.1 Ethernet controller [0200]: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller [14e4:16d7] (rev 01)
        Subsystem: Broadcom Inc. and subsidiaries BCM57414 NetXtreme-E 10Gb/25Gb RDMA Ethernet Controller [14e4:4141]

Code:
root@test-r740-pve:~# uname -a
Linux test-r740-pve 6.5.11-7-pve #1 SMP PREEMPT_DYNAMIC PMX 6.5.11-7 (2023-12-05T09:44Z) x86_64 GNU/Linux

All of the latest firmware from Dell is applied to this system as well.

edit: adding more details about the network hardware

Code:
root@test-r740-pve:~# ethtool -i eno3
driver: tg3
version: 6.5.11-7-pve
firmware-version: FFV22.31.6 bc 5720-v1.39
expansion-rom-version:  
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no
 
Last edited:
I'm in the process of testing out Proxmox in a libvirt / kvm instance. I didn't see anyone specifically calling this setup out, but I had to add `simplefb` to the initramfs modules as mentioned earlier to get a working display.

I don't see a bug at https://bugzilla.proxmox.com/buglist.cgi?quicksearch=simplefb. Is there somewhere better to subscribe to know when it's fixed?
It was fixed in current 6.5.11-7 (or maybe 6.5.11-6) as far as i know.
If you install 8.1 from ISO, you have to update kernel first, because ISO is shipped with 6.5.11-4. You could install 8.0 and update directly to kernel 6.5.11-7.