Hello
I just received new hardware to build new PVE cluster and I faced an issue with intel E810 driver (ice). As i googled, this issue related only system with large CPU number.
Here is error
And CPU on server
Now I found a temporary fix, just limited number of CPUs with `maxxpus=252` in grub params and driver loaded successfully.
Here is corresponding bug with fix in ubuntu kernels https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2012335
I guess this fix should be ported to pve kernels too.
Upd: tested with pve kernel 6.2 and ice driver successfully loads
I just received new hardware to build new PVE cluster and I faced an issue with intel E810 driver (ice). As i googled, this issue related only system with large CPU number.
Here is error
Code:
[258314.532279] ice 0000:63:00.1: The DDP package was successfully loaded: ICE OS Default Package version 1.3.30.0
[258314.533037] ice 0000:63:00.1: not enough device MSI-X vectors. requested = 257, available = 256
[258314.533560] ice 0000:63:00.1: ice_init_interrupt_scheme failed: -34
[258314.544696] ice: probe of 0000:63:00.1 failed with error -5And CPU on server
Code:
# lscpu
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
Address sizes: 48 bits physical, 48 bits virtual
CPU(s): 256
On-line CPU(s) list: 0-251
Off-line CPU(s) list: 252-255
Thread(s) per core: 1
Core(s) per socket: 64
Socket(s): 2
NUMA node(s): 2
Vendor ID: AuthenticAMD
CPU family: 25
Model: 1
Model name: AMD EPYC 7713 64-Core Processor
# uname -a
Linux pm01 5.15.107-2-pve #1 SMP PVE 5.15.107-2 (2023-05-10T09:10Z) x86_64 GNU/LinuxNow I found a temporary fix, just limited number of CPUs with `maxxpus=252` in grub params and driver loaded successfully.
Here is corresponding bug with fix in ubuntu kernels https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2012335
I guess this fix should be ported to pve kernels too.
Upd: tested with pve kernel 6.2 and ice driver successfully loads
Last edited: