I have recently upgraded from proxmox 7.4 (kernel 6.2) to 8.0. I had no issues prior to the upgrade, and while not performing a speedtest, there are no issues.
When running speedtests from my main workstation (1.75Gbps pipe) my main pc loses connectivity (but the link is up) with the following being displayed in Proxmox:
My setup is relatively simple:
Typical multi-nic ChangWang box with 6x i226
multiple ports in an OVS bridge includingthe workstation launching the test, going through OpnSense in transparent mode (VM with a NIC in the same bridge). The WAN is an i226 with passthrough, to OpnSense.
I noticed similar threads, but all were focused around the realtek drivers, and kernel 5.15 vs 6.2. In my case, I had kernel 6.2 with 7.4 as with 8.0, and with intel NICs (igc).
Any idea what could be the cause?
When running speedtests from my main workstation (1.75Gbps pipe) my main pc loses connectivity (but the link is up) with the following being displayed in Proxmox:
Code:
Jul 10 08:27:17 proxmox kernel: ------------[ cut here ]------------
Jul 10 08:27:17 proxmox kernel: NETDEV WATCHDOG: enp6s0 (igc): transmit queue 0 timed out
Jul 10 08:27:17 proxmox kernel: WARNING: CPU: 9 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x23a/0x250
Jul 10 08:27:17 proxmox kernel: Modules linked in: tcp_diag inet_diag nf_conntrack_netlink xt_nat xt_tcpudp xt_conntrack nft_chain_nat xt_MASQUERADE xfrm_user xfrm_algo xt_addrtype nft_compat overlay cmac nls_utf8 cifs cifs_arc4 rdma_cm iw_cm ib_cm ib_core cifs_md4 fscache netfs veth ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter scsi_transport_iscsi nf_tables nfnetlink_cttimeout bonding tls openvswitch nsh nf_conncount nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 softdog sunrpc nfnetlink_log nfnetlink binfmt_misc snd_hda_codec_hdmi snd_sof_pci_intel_tgl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_soc_hdac_hda snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi soundwire_bus snd_soc_core snd_compress ac97_bus x86_pkg_temp_thermal snd_pcm_dmaengine intel_powerclamp i915 snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi
Jul 10 08:27:17 proxmox kernel: kvm_intel drm_buddy ttm snd_hda_codec drm_display_helper kvm snd_hda_core crct10dif_pclmul polyval_clmulni cec polyval_generic snd_hwdep processor_thermal_device_pci ghash_clmulni_intel rc_core processor_thermal_device mei_pxp mei_hdcp sha512_ssse3 processor_thermal_rfim snd_pcm drm_kms_helper aesni_intel processor_thermal_mbox snd_timer processor_thermal_rapl cmdlinepart i2c_algo_bit intel_rapl_msr crypto_simd pmt_telemetry syscopyarea snd spi_nor mei_me pmt_class cryptd intel_rapl_common sysfillrect int3400_thermal intel_hid rapl intel_cstate pcspkr wmi_bmof soundcore mtd ee1004 sysimgblt mei int340x_thermal_zone intel_vsec igen6_edac acpi_pad sparse_keymap acpi_thermal_rel acpi_tad mac_hid zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_net vhost vhost_iotlb tap coretemp vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd drm efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq simplefb
Jul 10 08:27:17 proxmox kernel: uas usb_storage dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c nvme xhci_pci spi_intel_pci xhci_pci_renesas i2c_i801 crc32_pclmul intel_lpss_pci spi_intel i2c_smbus ahci nvme_core intel_lpss xhci_hcd igc libahci idma64 nvme_common video wmi pinctrl_tigerlake
Jul 10 08:27:17 proxmox kernel: CPU: 9 PID: 0 Comm: swapper/9 Tainted: P O 6.2.16-3-pve #1
Jul 10 08:27:17 proxmox kernel: Hardware name: CWWK CW-MBX-AD12/MINIPC-G12, BIOS AD12R20230207 02/08/2023
Jul 10 08:27:17 proxmox kernel: RIP: 0010:dev_watchdog+0x23a/0x250
Jul 10 08:27:17 proxmox kernel: Code: 00 e9 2b ff ff ff 48 89 df c6 05 8a 6f 7d 01 01 e8 6b 08 f8 ff 44 89 f1 48 89 de 48 c7 c7 58 64 c0 ad 48 89 c2 e8 06 ab 30 ff <0f> 0b e9 1c ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00
Jul 10 08:27:17 proxmox kernel: RSP: 0018:ffff9d9c403a0e38 EFLAGS: 00010246
Jul 10 08:27:17 proxmox kernel: RAX: 0000000000000000 RBX: ffff8ce894426000 RCX: 0000000000000000
Jul 10 08:27:17 proxmox kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Jul 10 08:27:17 proxmox kernel: RBP: ffff9d9c403a0e68 R08: 0000000000000000 R09: 0000000000000000
Jul 10 08:27:17 proxmox kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff8ce8944264c8
Jul 10 08:27:17 proxmox kernel: R13: ffff8ce89442641c R14: 0000000000000000 R15: 0000000000000000
Jul 10 08:27:17 proxmox kernel: FS: 0000000000000000(0000) GS:ffff8cf7ffa40000(0000) knlGS:0000000000000000
Jul 10 08:27:17 proxmox kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 10 08:27:17 proxmox kernel: CR2: 000000080123b128 CR3: 00000005f5010000 CR4: 0000000000752ee0
Jul 10 08:27:17 proxmox kernel: PKRU: 55555554
Jul 10 08:27:17 proxmox kernel: Call Trace:
Jul 10 08:27:17 proxmox kernel: <IRQ>
Jul 10 08:27:17 proxmox kernel: ? __pfx_dev_watchdog+0x10/0x10
Jul 10 08:27:17 proxmox kernel: call_timer_fn+0x29/0x160
Jul 10 08:27:17 proxmox kernel: ? __pfx_dev_watchdog+0x10/0x10
Jul 10 08:27:17 proxmox kernel: __run_timers+0x259/0x310
Jul 10 08:27:17 proxmox kernel: run_timer_softirq+0x1d/0x40
Jul 10 08:27:17 proxmox kernel: __do_softirq+0xd6/0x346
Jul 10 08:27:17 proxmox kernel: ? hrtimer_interrupt+0x11f/0x250
Jul 10 08:27:17 proxmox kernel: __irq_exit_rcu+0xa2/0xd0
Jul 10 08:27:17 proxmox kernel: irq_exit_rcu+0xe/0x20
Jul 10 08:27:17 proxmox kernel: sysvec_apic_timer_interrupt+0x92/0xd0
Jul 10 08:27:17 proxmox kernel: </IRQ>
Jul 10 08:27:17 proxmox kernel: <TASK>
Jul 10 08:27:17 proxmox kernel: asm_sysvec_apic_timer_interrupt+0x1b/0x20
Jul 10 08:27:17 proxmox kernel: RIP: 0010:cpuidle_enter_state+0xde/0x6f0
Jul 10 08:27:17 proxmox kernel: Code: 2a 17 53 e8 54 7e 4a ff 8b 53 04 49 89 c7 0f 1f 44 00 00 31 ff e8 82 86 49 ff 80 7d d0 00 0f 85 eb 00 00 00 fb 0f 1f 44 00 00 <45> 85 f6 0f 88 12 02 00 00 4d 63 ee 49 83 fd 09 0f 87 c7 04 00 00
Jul 10 08:27:17 proxmox kernel: RSP: 0018:ffff9d9c401b7e38 EFLAGS: 00000246
Jul 10 08:27:17 proxmox kernel: RAX: 0000000000000000 RBX: ffffbd9c3fc40600 RCX: 0000000000000000
Jul 10 08:27:17 proxmox kernel: RDX: 0000000000000009 RSI: 0000000000000000 RDI: 0000000000000000
Jul 10 08:27:17 proxmox kernel: RBP: ffff9d9c401b7e88 R08: 0000000000000000 R09: 0000000000000000
Jul 10 08:27:17 proxmox kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffae6c33a0
Jul 10 08:27:17 proxmox kernel: R13: 0000000000000004 R14: 0000000000000004 R15: 00002a26a1046e6c
Jul 10 08:27:17 proxmox kernel: ? cpuidle_enter_state+0xce/0x6f0
Jul 10 08:27:17 proxmox kernel: cpuidle_enter+0x2e/0x50
Jul 10 08:27:17 proxmox kernel: do_idle+0x216/0x2a0
Jul 10 08:27:17 proxmox kernel: cpu_startup_entry+0x1d/0x20
Jul 10 08:27:17 proxmox kernel: start_secondary+0x122/0x160
Jul 10 08:27:17 proxmox kernel: secondary_startup_64_no_verify+0xe5/0xeb
Jul 10 08:27:17 proxmox kernel: </TASK>
Jul 10 08:27:17 proxmox kernel: ---[ end trace 0000000000000000 ]---
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: Register Dump
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: Register Name Value
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: CTRL 181c0641
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: STATUS 00680693
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: CTRL_EXT 100000c0
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: MDIC 1805dd01
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: ICR 00000081
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RCTL 0440803a
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RDLEN[0-3] 00001000 00001000 00001000 00001000
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RDH[0-3] 0000008d 000000a3 0000003d 0000006e
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RDT[0-3] 0000008c 000000a2 0000003c 0000006d
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RXDCTL[0-3] 02040808 02040808 02040808 02040808
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RDBAL[0-3] 1153b000 059e0000 1153d000 11541000
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: RDBAH[0-3] 00000001 00000001 00000001 00000001
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TCTL a503f0fa
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TDBAL[0-3] 1447e000 11539000 11119000 099ad000
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TDBAH[0-3] 00000001 00000001 00000001 00000001
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TDLEN[0-3] 00001000 00001000 00001000 00001000
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TDH[0-3] 0000008d 00000057 00000075 00000025
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TDT[0-3] 000000de 00000057 00000075 00000027
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: TXDCTL[0-3] 02100108 02100108 02100108 02100108
Jul 10 08:27:17 proxmox kernel: igc 0000:06:00.0 enp6s0: Reset adapter
Jul 10 08:27:27 proxmox kernel: igc 0000:06:00.0 enp6s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
My setup is relatively simple:
Typical multi-nic ChangWang box with 6x i226
multiple ports in an OVS bridge includingthe workstation launching the test, going through OpnSense in transparent mode (VM with a NIC in the same bridge). The WAN is an i226 with passthrough, to OpnSense.
I noticed similar threads, but all were focused around the realtek drivers, and kernel 5.15 vs 6.2. In my case, I had kernel 6.2 with 7.4 as with 8.0, and with intel NICs (igc).
Any idea what could be the cause?