massive packet loss on network interface

[fjleon]

I just bought a mini pc, the pulcro.io turnkey two, which is based on intel N150 and comes with dual 2.5g I226-V (rev 04) network interfaces. it comes with proxmox already installed (9.06) and I just updated via apt update and now it has 9.1.1.

I am not sure, but I believe that after the update (which includes kernel 6.17.2-2-pve) i started to experience massive packet loss on the ethernet interface (i am only using the first one, which gets its IP via dhcp)

even something as simple as pinging a device in my local lan gets 30%-60% packet loss. I have tried both new and proven old network cables.

Curiously ethtool is showing that duplex mode is unknown and auto negotiation is off:

root@proxmox:~# ethtool vmbr0
Settings for vmbr0:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 1000Mb/s
Duplex: Unknown! (255)
Auto-negotiation: off
Port: Other
PHYAD: 0
Transceiver: internal
Link detected: yes

Comparing to my raspberry pi on the exact same network, same switch:

Supported ports: [ TP MII ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Half 1000baseT/Full
Supported pause frame use: Transmit-only
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Half 1000baseT/Full
Advertised pause frame use: Transmit-only
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Link partner advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Link partner advertised pause frame use: Symmetric
Link partner advertised auto-negotiation: Yes
Link partner advertised FEC modes: Not reported
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
master-slave cfg: preferred slave
master-slave status: slave
Port: Twisted Pair
PHYAD: 1
Transceiver: external
MDI-X: Unknown
netlink error: Operation not permitted
Link detected: yes

root@proxmox:~# lspci
00:00.0 Host bridge: Intel Corporation Alder Lake-N Processor Host Bridge/DRAM Registers
00:02.0 VGA compatible controller: Intel Corporation Alder Lake-N [Intel Graphics]
00:0d.0 USB controller: Intel Corporation Alder Lake-N Thunderbolt 4 USB Controller
00:14.0 USB controller: Intel Corporation Alder Lake-N PCH USB 3.2 xHCI Host Controller
00:14.2 RAM memory: Intel Corporation Alder Lake-N PCH Shared SRAM
00:16.0 Communication controller: Intel Corporation Alder Lake-N PCH HECI Controller
00:17.0 SATA controller: Intel Corporation Alder Lake-N SATA AHCI Controller
00:1a.0 SD Host controller: Intel Corporation Alder Lake-N eMMC Controller
00:1c.0 PCI bridge: Intel Corporation Alder Lake-N PCI Express Root Port #3
00:1c.3 PCI bridge: Intel Corporation Alder Lake-N PCI Express Root Port #4
00:1c.6 PCI bridge: Intel Corporation Alder Lake-N PCI Express Root Port #7
00:1f.0 ISA bridge: Intel Corporation Alder Lake-N PCH eSPI Controller
00:1f.3 Multimedia audio controller: Intel Corporation Alder Lake-N PCH High Definition Audio Controller
00:1f.4 SMBus: Intel Corporation Alder Lake-N SMBus
00:1f.5 Serial bus controller: Intel Corporation Alder Lake-N SPI (flash) Controller
01:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
02:00.0 Ethernet controller: Intel Corporation Ethernet Controller I226-V (rev 04)
03:00.0 Network controller: Intel Corporation Wireless 3165 (rev 81)

root@proxmox:~# lsmod
Module Size Used by
veth 40960 0
tcp_diag 12288 0
inet_diag 32768 1 tcp_diag
ebtable_filter 12288 0
ebtables 45056 1 ebtable_filter
ip_set 61440 0
ip6table_raw 12288 0
iptable_raw 12288 0
ip6table_filter 12288 0
ip6_tables 32768 2 ip6table_filter,ip6table_raw
iptable_filter 12288 0
nf_tables 360448 0
softdog 12288 2
bonding 245760 0
tls 147456 1 bonding
sunrpc 786432 1
nfnetlink_log 24576 1
binfmt_misc 24576 1
snd_hda_codec_intelhdmi 24576 1
snd_hda_codec_alc662 20480 1
snd_hda_codec_realtek_lib 65536 1 snd_hda_codec_alc662
snd_hda_codec_generic 102400 2 snd_hda_codec_alc662,snd_hda_codec_realtek_lib
snd_hda_intel 61440 0
snd_sof_pci_intel_tgl 12288 0
snd_sof_pci_intel_cnl 20480 1 snd_sof_pci_intel_tgl
snd_sof_intel_hda_generic 36864 2 snd_sof_pci_intel_tgl,snd_sof_pci_intel_cnl
soundwire_intel 81920 1 snd_sof_intel_hda_generic
snd_sof_intel_hda_sdw_bpt 20480 1 soundwire_intel
xe 3567616 0
snd_sof_intel_hda_common 180224 4 snd_sof_intel_hda_sdw_bpt,snd_sof_intel_hda_generic,snd_sof_pci_intel_tgl,snd_sof_pci_intel_cnl
snd_soc_hdac_hda 20480 1 snd_sof_intel_hda_common
snd_sof_intel_hda_mlink 45056 4 snd_sof_intel_hda_sdw_bpt,soundwire_intel,snd_sof_intel_hda_common,snd_sof_intel_hda_generic
snd_sof_intel_hda 24576 2 snd_sof_intel_hda_common,snd_sof_intel_hda_generic
snd_hda_codec_hdmi 57344 1 snd_hda_codec_intelhdmi
soundwire_cadence 49152 1 soundwire_intel
snd_sof_pci 24576 3 snd_sof_intel_hda_generic,snd_sof_pci_intel_tgl,snd_sof_pci_intel_cnl
snd_sof_xtensa_dsp 12288 1 snd_sof_intel_hda_generic
snd_sof 380928 6 snd_sof_intel_hda_sdw_bpt,snd_sof_pci,snd_sof_intel_hda_common,snd_sof_intel_hda_generic,snd_sof_intel_hda,snd_sof_pci_intel_cnl
snd_sof_utils 16384 1 snd_sof
gpu_sched 65536 1 xe
snd_soc_acpi_intel_match 139264 3 snd_sof_intel_hda_generic,snd_sof_pci_intel_tgl,snd_sof_pci_intel_cnl
drm_gpuvm 49152 1 xe
snd_soc_acpi_intel_sdca_quirks 12288 1 snd_soc_acpi_intel_match
drm_gpusvm_helper 36864 1 xe
soundwire_generic_allocation 20480 1 soundwire_intel
snd_soc_acpi 16384 2 snd_soc_acpi_intel_match,snd_sof_intel_hda_generic
drm_ttm_helper 16384 1 xe
drm_exec 12288 2 drm_gpuvm,xe
soundwire_bus 1175552 3 soundwire_intel,soundwire_generic_allocation,soundwire_cadence
drm_suballoc_helper 16384 1 xe
snd_soc_sdca 81920 2 snd_soc_acpi_intel_sdca_quirks,soundwire_bus
hid 258048 1 snd_soc_sdca
crc8 12288 1 soundwire_cadence
intel_rapl_msr 20480 0
snd_soc_avs 208896 0
intel_rapl_common 49152 1 intel_rapl_msr
snd_soc_hda_codec 24576 1 snd_soc_avs
snd_hda_ext_core 32768 7 snd_sof_intel_hda_sdw_bpt,snd_soc_avs,snd_soc_hda_codec,snd_sof_intel_hda_common,snd_soc_hdac_hda,snd_sof_intel_hda_mlink,snd_sof_intel_hda
snd_hda_codec 196608 10 snd_hda_codec_generic,snd_soc_avs,snd_hda_codec_hdmi,snd_soc_hda_codec,snd_hda_intel,snd_hda_codec_alc662,snd_hda_codec_realtek_lib,snd_soc_hdac_hda,snd_sof_intel_hda,snd_hda_codec_intelhdmi
x86_pkg_temp_thermal 16384 0
snd_hda_core 131072 13 snd_hda_codec_generic,snd_soc_avs,snd_hda_codec_hdmi,snd_soc_hda_codec,snd_hda_intel,snd_hda_codec_alc662,snd_hda_ext_core,snd_hda_codec,snd_sof_intel_hda_common,snd_hda_codec_realtek_lib,snd_soc_hdac_hda,snd_sof_intel_hda,snd_hda_codec_intelhdmi
intel_powerclamp 24576 0
iwlmvm 753664 0
snd_intel_dspcfg 45056 5 snd_soc_avs,snd_hda_intel,snd_sof,snd_sof_intel_hda_common,snd_sof_intel_hda_generic
snd_intel_sdw_acpi 16384 2 snd_intel_dspcfg,snd_sof_intel_hda_generic
coretemp 20480 0
snd_hwdep 24576 1 snd_hda_codec
mac80211 1646592 1 iwlmvm
snd_soc_core 376832 7 snd_soc_avs,snd_soc_hda_codec,soundwire_intel,snd_sof,snd_soc_sdca,snd_sof_intel_hda_common,snd_soc_hdac_hda
btusb 77824 0
kvm_intel 532480 0
snd_compress 32768 2 snd_soc_avs,snd_soc_core
btrtl 32768 1 btusb
libarc4 12288 1 mac80211
i915 4485120 1
btintel 69632 1 btusb
ac97_bus 12288 1 snd_soc_core
snd_pcm_dmaengine 20480 1 snd_soc_core
btbcm 24576 1 btusb
kvm 1376256 1 kvm_intel
snd_pcm 188416 14 snd_soc_avs,snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec,soundwire_intel,snd_sof,snd_soc_sdca,snd_sof_intel_hda_common,snd_compress,snd_sof_intel_hda_generic,snd_soc_core,snd_sof_utils,snd_hda_core,snd_pcm_dmaengine
mei_pxp 16384 0
mei_hdcp 28672 0
btmtk 28672 1 btusb
iwlwifi 585728 1 iwlmvm
cmdlinepart 16384 0
irqbypass 16384 1 kvm
polyval_clmulni 12288 0
ghash_clmulni_intel 12288 0
aesni_intel 94208 0
rapl 20480 0
snd_timer 53248 1 snd_pcm
drm_buddy 28672 2 xe,i915
spi_nor 163840 0
bluetooth 995328 6 btrtl,btmtk,btintel,btbcm,btusb
ttm 118784 3 drm_ttm_helper,xe,i915
pcspkr 12288 0
snd 135168 12 snd_hda_codec_generic,snd_hda_codec_hdmi,snd_hwdep,snd_hda_intel,snd_hda_codec,snd_sof,snd_soc_sdca,snd_timer,snd_hda_codec_realtek_lib,snd_compress,snd_soc_core,snd_pcm
intel_cstate 20480 0
ee1004 16384 0
cfg80211 1343488 3 iwlmvm,iwlwifi,mac80211
wmi_bmof 12288 0
soundcore 16384 1 snd
mtd 98304 3 spi_nor,cmdlinepart
mei_me 53248 2
drm_display_helper 274432 2 xe,i915
cec 94208 3 drm_display_helper,xe,i915
rc_core 73728 1 cec
intel_pmc_core 135168 0
mei 172032 5 mei_hdcp,mei_pxp,mei_me
i2c_algo_bit 16384 2 xe,i915
igen6_edac 28672 0
sch_fq_codel 24576 9
pmt_telemetry 16384 1 intel_pmc_core
pmt_discovery 16384 1 pmt_telemetry
pmt_class 20480 2 pmt_telemetry,pmt_discovery
intel_pmc_ssram_telemetry 16384 1 intel_pmc_core
intel_vsec 24576 3 intel_pmc_ssram_telemetry,pmt_telemetry,xe
acpi_tad 20480 0
acpi_pad 184320 0
mac_hid 12288 0
zfs 6344704 6
spl 151552 1 zfs
vhost_net 32768 0
vhost 69632 1 vhost_net
vhost_iotlb 16384 1 vhost
tap 28672 1 vhost_net
efi_pstore 12288 0
nfnetlink 20480 5 nf_tables,ip_set,nfnetlink_log
dmi_sysfs 20480 0
ip_tables 32768 2 iptable_filter,iptable_raw
x_tables 57344 7 ebtables,ip6table_filter,ip6table_raw,iptable_filter,ip6_tables,iptable_raw,ip_tables
autofs4 57344 2
btrfs 2023424 0
blake2b_generic 24576 0
xor 24576 1 btrfs
raid6_pq 122880 1 btrfs
dm_thin_pool 94208 1
dm_persistent_data 114688 1 dm_thin_pool
dm_bio_prison 24576 1 dm_thin_pool
dm_bufio 53248 1 dm_persistent_data
sdhci_pci 98304 0
xhci_pci 24576 0
sdhci_uhs2 32768 1 sdhci_pci
xhci_hcd 389120 1 xhci_pci
ahci 49152 4
sdhci 94208 2 sdhci_uhs2,sdhci_pci
spi_intel_pci 12288 0
i2c_i801 36864 0
cqhci 40960 1 sdhci_pci
igc 200704 0
spi_intel 32768 1 spi_intel_pci
i2c_mux 12288 1 i2c_i801
libahci 53248 1 ahci
i2c_smbus 20480 1 i2c_i801
video 77824 2 xe,i915
wmi 28672 2 video,wmi_bmof

auto lo
iface lo inet loopback

iface enp2s0 inet manual

iface enp1s0 inet manual

auto vmbr1
iface vmbr1 inet static
address 192.168.68.1/24
bridge-ports enp2s0
bridge-stp off
bridge-fd 0
#Internal Proxmox Network

auto vmbr0
iface vmbr0 inet dhcp
bridge-ports enp1s0
bridge-stp off
bridge-fd 0
#Default Network

iface wlp3s0 inet manual

is there anything I can do to fix this?

 

[fjleon]

ping from raspberry pi to proxmox is absurdly high, going as high as 105 ms (although no packet loss). not sure if proxmox has a very sensitive latency expectation and will show timeout if the ping is too high

 

[fjleon]

i have tried two more kernels, including 6.14 and 6.8, yet issue persists

 

[fjleon]

i reimaged the entire thing again - pulcro.io provides a nfs partclone reimaging feature. updated everything again, and no packet loss or large ping responses so far

 

[fjleon]

well, issue started again this morning. i left the computer off overnight. I will try live booting ubuntu from usb to see if the issue happens on other distros

 

[fjleon]

i may be a victim of a bad i226-v firmware. currently asking the manufacturer of the mini pc to avoid voiding the warranty

 

[louie1961]

I would wipe the device and install Proxmox from ISO. Who knows what funky error they may have introduced. Could be a heat issue. I don't know if it has a cover you can open? I might also be tempted to try different memory if you have any laying around.

 

[fjleon]

it's not proxmox. i live booted latest ubuntu LTS and same issue. then i removed the cable, and plugged it to the second network interface on the mini pc, then everything started to work. unplugged back to put on the first interface, kept working fine. I believe it's a bug with the intel i226-v firmware

 

[fjleon]

manufacturer sent me firmware "2023" and I had "2017". just flashed and will test through all day

 

[Ericmann]

The massive packet loss and "Duplex: Unknown! (255)" / "Auto-negotiation: off" on your Intel I226-V (igc driver) with Proxmox 9.1.1/kernel 6.17.2-2-pve stem from known igc driver issues in recent kernels, exacerbated by bridge (vmbr0) reporting and negotiation failures.

Immediate Fixes​

Check the physical interface (enp1s0) directly with ethtool enp1s0—it likely shows similar issues. Force settings temporarily:
ethtool -s enp1s0 speed 1000 duplex full autoneg off
Then ifdown vmbr0 && ifup vmbr0 and test ping loss. Make persistent by adding to /etc/network/interfaces under the enp1s0 stanza:
pre-up /usr/sbin/ethtool -s enp1s0 speed 1000 duplex full autoneg off

Driver/Kernel Workarounds​

• Boot an older kernel (e.g., 6.8 or 6.5 series if available via pve-efiboot-tool list and select at GRUB). I226-V stability improves pre-6.11+.
• Disable powersave: tuned-adm profile powers-nic or edit /etc/tuned/powersave/net to enforce 1000/full, then reboot.
• Update igc firmware if mismatched (ethtool -i enp1s0); check BIOS for NIC updates on pulcro.io Turnkey Two.

Diagnostics​

Run dmesg | grep -i igc for errors, ethtool -S enp1s0 for RX/TX drops, and ping -c 1000 <LAN IP> post-fixes. If persists, test enp2s0 swapped into vmbr0. This matches ongoing Proxmox forum reports for your exact hardware/kernel.

 

[fjleon]

it was definitely a firmware and not a kernel issue, since i could repro on any kernel (and distro) before getting the 2023 firmware from the manufacturer. it's been running fine since the update