[SOLVED] Very high latency with Intel i226-v NICs

Feb 23, 2022
12
3
23
Belgium
G'day

Since we started dist-upgrading multiple PVE single node instances from 8 to 9 (various kernel versions), we noticed the Intel i226-v NIC's experiencing very high latency (15-1000 ms). On PVE version 8 we did not experience any latency with these NIC's
We ruled out the possibility of being a external networking issue by testing with multiple different setups (servers switches firewalls).
Our current test setup were this issue occurs:
  • 6.17.9-1-pve
  • pve-manager/9.1.6
  • Supermicro X13SCW-F motherboard with Intel Xeon E-2488 CPU
  • I226-T4 Quad 2.5G RJ45 PCI Card
  • Debian 12 VM with qemu-guest-tools enabled and installed (net0: virtio,bridge=vmbr1)
These NIC's are configured to be part of a group which is being used by the VM's where we notice this issue:
Code:
auto vmbr1
iface vmbr1 inet static
        bridge-ports enp8s0 enp9s0 enp10s0 enp11s0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
Note that only one of these ports is currently up.

Any input on resolving this issue would mean a lot to us.
 
Issue persists with a bare-metal debian 13 installation instead of PVE.
issue does not occur on a freakin bare-metal Windows 11 install.

These two tests were done on the same machine so we can exclude a hardware issue as well.
 
Disabling VT-D in bios resolved this issue

This is the same as disabling IOMMU, correct? Which won't be an acceptable workaround for many users.

Yet another trash NIC from Intel who have been releasing terrible buggy NICs in the consumer segment for many years at this point :(

Is there any workaround for i226-V which does not involve disabling IOMMU?