Thanks! - hmm that's odd - the other report in our bugzilla seems to have issues with Intel's X810 NICs
any chance you have a test system where you could see if the potential BIOS (and especially NIC-firmware if available) upgrade changes anything?
It just so happens that this server also has Intel E810 based NIC's (Both 25G and 100G). They are working great with the ice drivers. Moving data as we speak over the E810 NIC's on the 5.15.74-1-pve kernel. ..
root@gppctestprox:~# lspci | grep Ethernet
11:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)
11:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)
13:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
13:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
28:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
28:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
37:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
37:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
37:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
37:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
45:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
45:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
53:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)
53:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-XXV for SFP (rev 02)
I just found another gen10 560 that we have which also has the BCM57810 10 Gigabit card, but it doesn't have any of the Intel E810 cards. Its booting fine on the newer kernel.
I never actually removed the BCM57810 card, I simply tested on a server that doesn't have that card and assumed it was the issue.
Starting to think its actually a issue with the E810 cards and newer kernels. These E810 cards are brand new, firmware looks to be new as well.
Hoping to get into the office soon and ill pull the E810 cards and see what happens. It would certainly make more sense than the BCM57810 cards.