E810 NIC don't work on 5.15.107-2-pve kernel with large CPU number

niko-lay

Member
Jun 11, 2022
2
0
6
Hello
I just received new hardware to build new PVE cluster and I faced an issue with intel E810 driver (ice). As i googled, this issue related only system with large CPU number.
Here is error
Code:
[258314.532279] ice 0000:63:00.1: The DDP package was successfully loaded: ICE OS Default Package version 1.3.30.0
[258314.533037] ice 0000:63:00.1: not enough device MSI-X vectors. requested = 257, available = 256
[258314.533560] ice 0000:63:00.1: ice_init_interrupt_scheme failed: -34
[258314.544696] ice: probe of 0000:63:00.1 failed with error -5

And CPU on server
Code:
# lscpu
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   48 bits physical, 48 bits virtual
CPU(s):                          256
On-line CPU(s) list:             0-251
Off-line CPU(s) list:            252-255
Thread(s) per core:              1
Core(s) per socket:              64
Socket(s):                       2
NUMA node(s):                    2
Vendor ID:                       AuthenticAMD
CPU family:                      25
Model:                           1
Model name:                      AMD EPYC 7713 64-Core Processor

# uname -a
Linux pm01 5.15.107-2-pve #1 SMP PVE 5.15.107-2 (2023-05-10T09:10Z) x86_64 GNU/Linux

Now I found a temporary fix, just limited number of CPUs with `maxxpus=252` in grub params and driver loaded successfully.

Here is corresponding bug with fix in ubuntu kernels https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2012335

I guess this fix should be ported to pve kernels too.

Upd: tested with pve kernel 6.2 and ice driver successfully loads
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!