Random Network cuts - PCIe link lost

[Sraaronrock]

Hello everyone,

My first post here

I'm experiencing random network losses on one of my Proxmox nodes and I'm struggling to identify the root cause. The issue appears intermittently, the node suddenly loses network connectivity and then recovers after restart. This happens multiple times per week, like every 3-4 days.

Here is what I have checked so far:

1. Reviewed system logs during the outages (see below).
2. Updated Proxmox to the latest available kernel.
3. Updated the server BIOS.
4. I added this parameter to the grub: GRUB_CMDLINE_LINUX_DEFAULT="quiet splash pcie_port_pm=off pcie_aspm.policy=performance"
5. No changes in the network configuration prior to the issue appearing.

Despite all this, the problem persists.

Environment details:

• Proxmox version: pve-manager/9.1.5/80cf92a64bef6889 (running kernel: 6.17.4-2-pve)
• NIC info and motherboard: Manufacturer: ASRockRack Product Name: B650D4U Version: 4.01

sudo lshw -class network -short
H/W path Device Class Description
===================================================================
/0/100/2.1/0/1/0 enp6s0 network I210 Gigabit Network Connection

Relevant logs:
Feb 04 21:08:35 ns3269081 kernel: igb 0000:06:00.0 enp6s0: PCIe link lost
Feb 04 21:08:35 ns3269081 kernel: ------------[ cut here ]------------
Feb 04 21:08:35 ns3269081 kernel: igb: Failed to read reg 0xc030!
Feb 04 21:08:35 ns3269081 kernel: WARNING: CPU: 8 PID: 990538 at drivers/net/ethernet/intel/igb/igb_main.c:724 igb_rd32.cold+0x3a/0x46 [igb]
Feb 04 21:08:35 ns3269081 kernel: Modules linked in: xt_MASQUERADE xt_mark rpcsec_gss_krb5 auth_rpcgss nfsv4 nfs lockd grace netfs veth xt_comment xt_set ip_set_hash_net xt_recent ebtable_filter ebtables ip6table_raw iptable_raw sctp ip6_udp_tunnel udp_tunnel ip_set ip6table_nat iptable_nat nf_nat softdog nf_tables >
Feb 04 21:08:35 ns3269081 kernel: snd_hda_core snd_amd_acpi_mach snd_intel_dspcfg snd_acp_legacy_common snd_intel_sdw_acpi snd_pci_acp6x snd_hwdep kvm acpi_ipmi snd_pci_acp5x irqbypass snd_rn_pci_acp3x snd_pcm polyval_clmulni ipmi_si snd_timer ghash_clmulni_intel snd_acp_config ipmi_devintf aesni_intel snd_soc_acpi>
Feb 04 21:08:35 ns3269081 kernel: CPU: 8 UID: 0 PID: 990538 Comm: kworker/8:0 Tainted: P O 6.17.4-2-pve #1 PREEMPT(voluntary)
Feb 04 21:08:35 ns3269081 kernel: Tainted: [P]=PROPRIETARY_MODULE, [O]=OOT_MODULE
Feb 04 21:08:35 ns3269081 kernel: Hardware name: AsrockRack B650D4U/B650D4U, BIOS 21.06.OV06 08/18/2025
Feb 04 21:08:35 ns3269081 kernel: Workqueue: events igb_watchdog_task [igb]
Feb 04 21:08:35 ns3269081 kernel: RIP: 0010:igb_rd32.cold+0x3a/0x46 [igb]
Feb 04 21:08:35 ns3269081 kernel: Code: c0 49 89 44 24 08 e8 8a d8 a6 f9 49 8b bc 24 28 ff ff ff e8 fd a0 41 fa 84 c0 74 15 89 de 48 c7 c7 08 02 84 c0 e8 cb 58 b6 f9 <0f> 0b e9 18 c6 fd ff e9 13 c6 fd ff 0f b6 d0 be 00 00 04 00 48 c7
Feb 04 21:08:35 ns3269081 kernel: RSP: 0018:ffffccafe35efd80 EFLAGS: 00010246
Feb 04 21:08:35 ns3269081 kernel: RAX: 0000000000000000 RBX: 000000000000c030 RCX: 0000000000000000
Feb 04 21:08:35 ns3269081 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Feb 04 21:08:35 ns3269081 kernel: RBP: ffffccafe35efd90 R08: 0000000000000000 R09: 0000000000000000
Feb 04 21:08:35 ns3269081 kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff8b0ec19b4fd8
Feb 04 21:08:35 ns3269081 kernel: R13: 0000000000000000 R14: 0000000000000000 R15: ffff8b0ec007b3c0
Feb 04 21:08:35 ns3269081 kernel: FS: 0000000000000000(0000) GS:ffff8b1e20f86000(0000) knlGS:0000000000000000
Feb 04 21:08:35 ns3269081 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 04 21:08:35 ns3269081 kernel: CR2: 000000c70b0c7000 CR3: 0000000110e22000 CR4: 0000000000f50ef0
Feb 04 21:08:35 ns3269081 kernel: PKRU: 55555554
Feb 04 21:08:35 ns3269081 kernel: Call Trace:
Feb 04 21:08:35 ns3269081 kernel: <TASK>
Feb 04 21:08:35 ns3269081 kernel: igb_update_stats+0x9b/0x850 [igb]
Feb 04 21:08:35 ns3269081 kernel: igb_watchdog_task+0xbb/0x480 [igb]
Feb 04 21:08:35 ns3269081 kernel: ? psi_avgs_work+0x64/0xe0
Feb 04 21:08:35 ns3269081 kernel: process_one_work+0x188/0x370
Feb 04 21:08:35 ns3269081 kernel: worker_thread+0x33a/0x480
Feb 04 21:08:35 ns3269081 kernel: ? __pfx_worker_thread+0x10/0x10
Feb 04 21:08:35 ns3269081 kernel: kthread+0x108/0x220
Feb 04 21:08:35 ns3269081 kernel: ? __pfx_kthread+0x10/0x10
Feb 04 21:08:35 ns3269081 kernel: ret_from_fork+0x205/0x240
Feb 04 21:08:35 ns3269081 kernel: ? __pfx_kthread+0x10/0x10
Feb 04 21:08:35 ns3269081 kernel: ret_from_fork_asm+0x1a/0x30
Feb 04 21:08:35 ns3269081 kernel: </TASK>
Feb 04 21:08:35 ns3269081 kernel: ---[ end trace 0000000000000000 ]---
Feb 04 21:08:39 ns3269081 kernel: igb 0000:06:00.0 enp6s0: NETDEV WATCHDOG: CPU: 10: transmit queue 0 timed out 5101 ms
Feb 04 21:08:39 ns3269081 kernel: igb 0000:06:00.0 enp6s0: Reset adapter
Feb 04 21:08:40 ns3269081 kernel: vmbr0: port 1(enp6s0) entered disabled state

Has anyone experienced similar random network drops or has suggestions on what else I could check? Any guidance would be greatly appreciated.

Thanks in advance!