Intel I225-V Rev03 lost connection suddenly

[zlwu]

root@pve:~# pveversion -v
proxmox-ve: 7.3-1 (running kernel: 5.15.74-1-pve)
pve-manager: 7.3-3 (running version: 7.3-3/c3928077)
pve-kernel-helper: 7.3-1
pve-kernel-5.15: 7.2-14
pve-kernel-5.15.74-1-pve: 5.15.74-1
ceph-fuse: 15.2.16-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.3
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-5
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.3-1
libpve-guest-common-perl: 4.2-3
libpve-http-server-perl: 4.1-5
libpve-storage-perl: 7.3-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.3.1-1
proxmox-backup-file-restore: 2.3.1-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.0-1
proxmox-widget-toolkit: 3.5.3
pve-cluster: 7.3-1
pve-container: 4.4-2
pve-docs: 7.3-1
pve-edk2-firmware: 3.20220526-1
pve-firewall: 4.2-7
pve-firmware: 3.6-1
pve-ha-manager: 3.5.1
pve-i18n: 2.8-1
pve-qemu-kvm: 7.1.0-4
pve-xtermjs: 4.16.0-1
qemu-server: 7.3-1
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+2
vncterm: 1.7-1
zfsutils-linux: 2.1.6-pve1

There are 4 Intel I225-V (rev 03) ethernet ports, the 4th one (enp4s0) is configured as vmbr0 bridge to several virtual machines and also connects to a 2.5G lan switch.

root@pve:~# lspci
00:00.0 Host bridge: Intel Corporation Device 4e24
00:02.0 VGA compatible controller: Intel Corporation Device 4e61 (rev 01)
00:04.0 Signal processing controller: Intel Corporation Device 4e03
00:14.0 USB controller: Intel Corporation Device 4ded (rev 01)
00:14.2 RAM memory: Intel Corporation Device 4def (rev 01)
00:16.0 Communication controller: Intel Corporation Device 4de0 (rev 01)
00:17.0 SATA controller: Intel Corporation Device 4dd3 (rev 01)
00:1c.0 PCI bridge: Intel Corporation Device 4dbc (rev 01)
00:1c.5 PCI bridge: Intel Corporation Device 4dbd (rev 01)
00:1c.6 PCI bridge: Intel Corporation Device 4dbe (rev 01)
00:1c.7 PCI bridge: Intel Corporation Device 4dbf (rev 01)
00:1f.0 ISA bridge: Intel Corporation Device 4d87 (rev 01)
00:1f.3 Audio device: Intel Corporation Device 4dc8 (rev 01)
00:1f.4 SMBus: Intel Corporation Device 4da3 (rev 01)
00:1f.5 Serial bus controller [0c80]: Intel Corporation Device 4da4 (rev 01)
01:00.0 Ethernet controller: Intel Corporation Ethernet Controller I225-V (rev 03)
02:00.0 Ethernet controller: Intel Corporation Ethernet Controller I225-V (rev 03)
03:00.0 Ethernet controller: Intel Corporation Ethernet Controller I225-V (rev 03)
04:00.0 Ethernet controller: Intel Corporation Ethernet Controller I225-V (rev 03)

After several days running, enp4s0 met a sudden lost and can not recover, here is the syslog:

Dec 15 11:22:15 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Dec 15 11:22:15 pve kernel: vmbr0: port 1(enp4s0) entered disabled state
Dec 15 11:22:19 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Dec 15 11:22:19 pve kernel: vmbr0: port 1(enp4s0) entered blocking state
Dec 15 11:22:19 pve kernel: vmbr0: port 1(enp4s0) entered forwarding state
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Dec 15 11:29:46 pve kernel: vmbr0: port 1(enp4s0) entered disabled state
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: Register Dump
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: Register Name   Value
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: CTRL            181c0641
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: STATUS          40780681
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: CTRL_EXT        10000040
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: MDIC            18017949
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: ICR             00000001
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RCTL            0440803a
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RDH[0-3]        0000003e 0000002d 0000002a 00000024
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RDT[0-3]        0000003d 0000002c 00000029 00000023
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: RDBAH[0-3]      00000000 00000000 00000000 00000000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TCTL            a503f0fa
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TDBAL[0-3]      fffff000 ffffe000 ffffd000 ffffc000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TDBAH[0-3]      00000000 00000000 00000000 00000000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TDH[0-3]        000000f5 00000039 00000051 000000ce
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TDT[0-3]        000000ff 00000039 00000056 000000ce
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Dec 15 11:29:46 pve kernel: igc 0000:04:00.0 enp4s0: Reset adapter
Dec 15 11:29:50 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Dec 15 11:29:50 pve kernel: vmbr0: port 1(enp4s0) entered blocking state
Dec 15 11:29:50 pve kernel: vmbr0: port 1(enp4s0) entered forwarding state
-- Reboot --
Dec 15 11:39:27 pve kernel: Linux version 5.15.74-1-pve (build@proxmox) (gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2) #1 SMP PVE 5.15.74-1 (Mon, 14 Nov 2022 20:17:15 +0100) ()
Dec 15 11:39:27 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.74-1-pve root=/dev/mapper/pve-root ro intel_iommu=on quiet

I'm not sure if it is a hardware or software issue, any clue on it?

 

[sava1e]

Found this topic: I probably do have the same issue:
When I disconnect the network cable for a few seconds and put it back in, the network is not coming back and I do get the same messages. I tried disable auto negation and eee using ethtool, but no luck. Any clue?

pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
pve kernel: vmbr0: port 1(enp4s0) entered disabled state

 

[fiona]

Hi,

Found this topic: I probably do have the same issue:
When I disconnect the network cable for a few seconds and put it back in, the network is not coming back and I do get the same messages. I tried disable auto negation and eee using ethtool, but no luck. Any clue?

pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
pve kernel: vmbr0: port 1(enp4s0) entered disabled state

please share the output of pveversion -v. Is there more related messages in the system logs or just those two lines?

Similar report, but talking about crashes here: https://forum.proxmox.com/threads/kernel-bug-at-lib-dynamic_queue_limits-c-27.130935

 

[sava1e]

Hi,

please share the output of pveversion -v. Is there more related messages in the system logs or just those two lines?

Similar report, but talking about crashes here: https://forum.proxmox.com/threads/kernel-bug-at-lib-dynamic_queue_limits-c-27.130935

Hi Fiona,

It's just these two lines:
[ 463.424327] igc 0000:07:00.0 enp7s0: NIC Link is Down
[ 463.424564] vmbr0: port 1(enp7s0) entered disabled state

After I plug back in the ethernet connector. The led lights of the network card start lighting up as normal, but nothing happens anymore. No dmesg log, nothing.
Here is the pveversion -v output:

perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
    LANGUAGE = (unset),
    LC_ALL = (unset),
    LC_ADDRESS = "nl_NL.UTF-8",
    LC_NAME = "nl_NL.UTF-8",
    LC_MONETARY = "nl_NL.UTF-8",
    LC_PAPER = "nl_NL.UTF-8",
    LC_IDENTIFICATION = "nl_NL.UTF-8",
    LC_TELEPHONE = "nl_NL.UTF-8",
    LC_MEASUREMENT = "nl_NL.UTF-8",
    LC_TIME = "nl_NL.UTF-8",
    LC_NUMERIC = "nl_NL.UTF-8",
    LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to a fallback locale ("en_US.UTF-8").
proxmox-ve: 8.0.2 (running kernel: 6.2.16-12-pve)
pve-manager: 8.0.4 (running version: 8.0.4/d258a813cfa6b390)
pve-kernel-6.2: 8.0.5
proxmox-kernel-helper: 8.0.3
proxmox-kernel-6.2.16-12-pve: 6.2.16-12
proxmox-kernel-6.2: 6.2.16-12
proxmox-kernel-6.2.16-10-pve: 6.2.16-10
ceph-fuse: 17.2.6-pve1+3
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx4
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.25-pve1
libproxmox-acme-perl: 1.4.6
libproxmox-backup-qemu0: 1.4.0
libproxmox-rs-perl: 0.3.1
libpve-access-control: 8.0.5
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.0.8
libpve-guest-common-perl: 5.0.4
libpve-http-server-perl: 5.0.4
libpve-rs-perl: 0.8.5
libpve-storage-perl: 8.0.2
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve3
novnc-pve: 1.4.0-2
proxmox-backup-client: 3.0.2-1
proxmox-backup-file-restore: 3.0.2-1
proxmox-kernel-helper: 8.0.3
proxmox-mail-forward: 0.2.0
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.0.6
pve-cluster: 8.0.3
pve-container: 5.0.4
pve-docs: 8.0.4
pve-edk2-firmware: 3.20230228-4
pve-firewall: 5.0.3
pve-firmware: 3.8-2
pve-ha-manager: 4.0.2
pve-i18n: 3.0.5
pve-qemu-kvm: 8.0.2-5
pve-xtermjs: 4.16.0-3
qemu-server: 8.0.7
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.1.12-pve1

I will try to boot a linux livecd on this machine and see what happens when I unplug the ethernet connector.

 

[fiona]

Did this issue happen for a while now or only start after a recent kernel upgrade?

 

[sava1e]

Did this issue happen for a while now or only start after a recent kernel upgrade?

Hi Fiona, it's a new build so it runs just for a few weeks now. I still have to try a livecd to see if it's related to the proxmox configuration or if it's a kernel (module) issue.

 

[sava1e]

I got an update on this issue:
I booted the xubuntu 23.04 livecd. (also on the 6.2 kernel as proxmox)
I tried physically disconnecting and reconnecting the ethernet cable. The link came up again. Then I installed powertop on the livecd and ran powertop --auto-tune. After I did the same physical connect / disconnect sequence and it never came up again.
The last dmesg was

igc 0000:04:00.0 enp4s0: NIC Link is Down

Edit: I can confirm the powersaving feature is the issue. I disabled the powertop --auto-tune command and all works fine now. I will have a look at my power usage without powertop first.
If it's a lot higher I might enable powertop again with excluding the i225v power saving (if that's possible)

edit 2:
It looks like the power management can be controlled using:
/sys/class/net/enp7s0/power/runtime_enabled

 

[maltej]

Hi,

could you please explain it in detail how to test the "disable" power saving and how to make it persistant?

I have a N100M Board from Asrock with an additional I225-V 2.5G Ethernet card. If there is heavy traffic, it enters "blocking state". But it also happens without heavy traffic randomly.

The error message is quite the same

Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Dump
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Name   Value
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL            081c0641
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: STATUS          40680683
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL_EXT        10000040
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: MDIC            1805d141
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: ICR             000000c1
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RCTL            0440803a
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDH[0-3]        00000039 000000b5 00000099 00000042
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDT[0-3]        00000038 000000b4 00000098 00000041
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAL[0-3]      0c9c0000 0c9c3000 0c9c6000 0c9c9000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TCTL            a503f0fa
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAL[0-3]      0c95e000 0c963000 0c968000 0c96d000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDH[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDT[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Reset adapter
Oct 13 09:40:46 pve kernel: vmbr0: port 1(enp1s0) entered disabled state
Oct 13 09:40:50 pve kernel: igc 0000:01:00.0 enp1s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered blocking state
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered forwarding state

Thanks

 

[sava1e]

Hi,

could you please explain it in detail how to test the "disable" power saving and how to make it persistant?

I have a N100M Board from Asrock with an additional I225-V 2.5G Ethernet card. If there is heavy traffic, it enters "blocking state". But it also happens without heavy traffic randomly.

The error message is quite the same

Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Dump
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Name   Value
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL            081c0641
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: STATUS          40680683
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL_EXT        10000040
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: MDIC            1805d141
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: ICR             000000c1
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RCTL            0440803a
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDH[0-3]        00000039 000000b5 00000099 00000042
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDT[0-3]        00000038 000000b4 00000098 00000041
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAL[0-3]      0c9c0000 0c9c3000 0c9c6000 0c9c9000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TCTL            a503f0fa
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAL[0-3]      0c95e000 0c963000 0c968000 0c96d000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDH[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDT[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Reset adapter
Oct 13 09:40:46 pve kernel: vmbr0: port 1(enp1s0) entered disabled state
Oct 13 09:40:50 pve kernel: igc 0000:01:00.0 enp1s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered blocking state
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered forwarding state

Thanks

Enable powersavings:
echo 'auto' > '/sys/bus/pci/devices/0000:01:00.0/power/control';

Disable powersavings
echo 'on' > '/sys/bus/pci/devices/0000:01:00.0/power/control';

 

[maltej]

Hi,


and thanks for your help.

Sadly, when doing

cat /sys/bus/pci/devices/0000:01:00.0/power/control

it already says "on". Strange, but I never expected that "on" means power saving off...

So, as it was already disabled, i come along this post:
https://forums.debian.net/viewtopic.php?t=154175

with

ethtool --show-eee enp1s0

i get

EEE settings for enp1s0:
        EEE status: disabled
        Tx LPI: disabled
        Supported EEE link modes:  Not reported
        Advertised EEE link modes:  Not reported
        Link partner advertised EEE link modes:  Not reported

So, its also disabled.

So:
- i will try to connect the controller to another Switch (right now i use a 10G Mikrotik Switch). I just want to know if this error also appears
- i havent found a BIOS entry like power saving
- i will use the onboad ethernet to see if its a proxmox/mainboard/... issue

Anyone has any further ideas?

Malte

 

[sava1e]

@maltej Things you could try:
update the bios if you haven't done it yet
disable devices you don't need: i.e. sound chip / sata ports etc
check power savings on the pcie bus

 

[fiona]

Hi,

Hi,

could you please explain it in detail how to test the "disable" power saving and how to make it persistant?

I have a N100M Board from Asrock with an additional I225-V 2.5G Ethernet card. If there is heavy traffic, it enters "blocking state". But it also happens without heavy traffic randomly.

The error message is quite the same

Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Dump
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Register Name   Value
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL            081c0641
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: STATUS          40680683
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: CTRL_EXT        10000040
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: MDIC            1805d141
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: ICR             000000c1
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RCTL            0440803a
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDH[0-3]        00000039 000000b5 00000099 00000042
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDT[0-3]        00000038 000000b4 00000098 00000041
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAL[0-3]      0c9c0000 0c9c3000 0c9c6000 0c9c9000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TCTL            a503f0fa
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAL[0-3]      0c95e000 0c963000 0c968000 0c96d000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDH[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TDT[0-3]        0000000e 000000bf 000000f0 0000009e
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Oct 13 09:40:46 pve kernel: igc 0000:01:00.0 enp1s0: Reset adapter
Oct 13 09:40:46 pve kernel: vmbr0: port 1(enp1s0) entered disabled state
Oct 13 09:40:50 pve kernel: igc 0000:01:00.0 enp1s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered blocking state
Oct 13 09:40:50 pve kernel: vmbr0: port 1(enp1s0) entered forwarding state

Thanks

what kernel version are you using? In proxmox-kernel-6.2.16-16-pve there were a few fixes related to igc, so you could try upgrading to that if you haven't already: https://forum.proxmox.com/threads/a...-dynamic_queue_limits-c-27.132138/post-595571