[SOLVED] Another kernel BUG at lib/dynamic_queue_limits.c:27!

@fweber Haven't tested the new PVE kernel yet, but this did happen this afternoon when I took a nap (yes, alright, I need naps!!)

Code:
Sep 27 15:43:43 pve pvedaemon[992]: <root@pam> successful auth for user 'root@pam'
Sep 27 15:49:05 pve smartd[635]: Device: /dev/sda [SAT], removed ATA device: No such device


***PUT MY LAPTOP TO SLEEP, TOOK A NAP***


Sep 27 15:55:41 pve kernel: ------------[ cut here ]------------
Sep 27 15:55:41 pve kernel: NETDEV WATCHDOG: enp4s0 (igc): transmit queue 0 timed out
Sep 27 15:55:41 pve kernel: WARNING: CPU: 2 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x23a/0x250
Sep 27 15:55:41 pve kernel: Modules linked in: ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter nf_tables bonding tls softdog sunrpc nfnetlink_log binfmt_misc nfnetlink snd_hda_codec_hdmi x86_pkg_temp_thermal intel_powerclamp snd_sof_pci_intel_icl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils coretemp snd_soc_hdac_hda snd_hda_ext_core snd_soc_acpi_intel_match kvm_intel snd_soc_acpi soundwire_bus i915 snd_soc_core snd_compress ac97_bus snd_pcm_dmaengine kvm snd_hda_intel snd_intel_dspcfg drm_buddy snd_intel_sdw_acpi crct10dif_pclmul polyval_generic ttm ghash_clmulni_intel intel_rapl_msr drm_display_helper snd_hda_codec sha512_ssse3 aesni_intel crypto_simd snd_hda_core processor_thermal_device_pci_legacy cec snd_hwdep rc_core processor_thermal_device processor_thermal_rfim snd_pcm cryptd processor_thermal_mbox drm_kms_helper
Sep 27 15:55:41 pve kernel:  intel_cstate processor_thermal_rapl intel_rapl_common cmdlinepart i2c_algo_bit snd_timer syscopyarea spi_nor snd mei_me int340x_thermal_zone sysfillrect pcspkr wmi_bmof mtd soundcore mei sysimgblt intel_soc_dts_iosf acpi_tad acpi_pad mac_hid zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_net vhost vhost_iotlb tap vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd drm efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq simplefb uas usb_storage dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c nvme xhci_pci spi_intel_pci xhci_pci_renesas i2c_i801 crc32_pclmul nvme_core spi_intel i2c_smbus igc nvme_common sdhci_pci xhci_hcd cqhci sdhci video wmi pinctrl_jasperlake
Sep 27 15:55:41 pve kernel: CPU: 2 PID: 0 Comm: swapper/2 Tainted: P           O       6.2.16-14-pve #1
Sep 27 15:55:41 pve kernel: Hardware name: Default string Default string/Default string, BIOS 5.19 11/11/2022
Sep 27 15:55:41 pve kernel: RIP: 0010:dev_watchdog+0x23a/0x250
Sep 27 15:55:41 pve kernel: Code: 00 e9 2b ff ff ff 48 89 df c6 05 ac 5d 7d 01 01 e8 bb 08 f8 ff 44 89 f1 48 89 de 48 c7 c7 90 87 e0 b9 48 89 c2 e8 56 91 30 ff <0f> 0b e9 1c ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00
Sep 27 15:55:41 pve kernel: RSP: 0018:ffffb411c01a0e38 EFLAGS: 00010246
Sep 27 15:55:41 pve kernel: RAX: 0000000000000000 RBX: ffff8ade91f26000 RCX: 0000000000000000
Sep 27 15:55:41 pve kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Sep 27 15:55:41 pve kernel: RBP: ffffb411c01a0e68 R08: 0000000000000000 R09: 0000000000000000
Sep 27 15:55:41 pve kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff8ade91f264c8
Sep 27 15:55:41 pve kernel: R13: ffff8ade91f2641c R14: 0000000000000000 R15: 0000000000000000
Sep 27 15:55:41 pve kernel: FS:  0000000000000000(0000) GS:ffff8adff8100000(0000) knlGS:0000000000000000
Sep 27 15:55:41 pve kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 27 15:55:41 pve kernel: CR2: 000006387c8241fc CR3: 00000001e707a000 CR4: 0000000000352ee0
Sep 27 15:55:41 pve kernel: Call Trace:
Sep 27 15:55:41 pve kernel:  <IRQ>
Sep 27 15:55:41 pve kernel:  ? show_regs+0x6d/0x80
Sep 27 15:55:41 pve kernel:  ? __warn+0x89/0x160
Sep 27 15:55:41 pve kernel:  ? dev_watchdog+0x23a/0x250
Sep 27 15:55:41 pve kernel:  ? report_bug+0x17e/0x1b0
Sep 27 15:55:41 pve kernel:  ? handle_bug+0x46/0x90
Sep 27 15:55:41 pve kernel:  ? exc_invalid_op+0x18/0x80
Sep 27 15:55:41 pve kernel:  ? asm_exc_invalid_op+0x1b/0x20
Sep 27 15:55:41 pve kernel:  ? dev_watchdog+0x23a/0x250
Sep 27 15:55:41 pve kernel:  ? dev_watchdog+0x23a/0x250
Sep 27 15:55:41 pve kernel:  ? __pfx_dev_watchdog+0x10/0x10
Sep 27 15:55:41 pve kernel:  call_timer_fn+0x29/0x160
Sep 27 15:55:41 pve kernel:  ? __pfx_dev_watchdog+0x10/0x10
Sep 27 15:55:41 pve kernel:  __run_timers+0x259/0x310
Sep 27 15:55:41 pve kernel:  run_timer_softirq+0x1d/0x40
Sep 27 15:55:41 pve kernel:  __do_softirq+0xd6/0x346
Sep 27 15:55:41 pve kernel:  ? hrtimer_interrupt+0x11f/0x250
Sep 27 15:55:41 pve kernel:  __irq_exit_rcu+0xa2/0xd0
Sep 27 15:55:41 pve kernel:  irq_exit_rcu+0xe/0x20
Sep 27 15:55:41 pve kernel:  sysvec_apic_timer_interrupt+0x92/0xd0
Sep 27 15:55:41 pve kernel:  </IRQ>
Sep 27 15:55:41 pve kernel:  <TASK>
Sep 27 15:55:41 pve kernel:  asm_sysvec_apic_timer_interrupt+0x1b/0x20
Sep 27 15:55:41 pve kernel: RIP: 0010:native_safe_halt+0xb/0x10
Sep 27 15:55:41 pve kernel: Code: a0 60 65 ba e8 c6 da 7d ff e9 3e ff ff ff cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 90 0f 00 2d 79 b6 37 00 fb f4 <c3> cc cc cc cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66
Sep 27 15:55:41 pve kernel: RSP: 0018:ffffb411c0127de0 EFLAGS: 00000246
Sep 27 15:55:41 pve kernel: RAX: 0000000000004800 RBX: ffff8ade812d2c64 RCX: 0000000000000000
Sep 27 15:55:41 pve kernel: RDX: 0000000000000001 RSI: ffff8ade812d2c00 RDI: 0000000000000001
Sep 27 15:55:41 pve kernel: RBP: ffffb411c0127df0 R08: 0000000000000000 R09: 0000000000000000
Sep 27 15:55:41 pve kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff8ade812d2c64
Sep 27 15:55:41 pve kernel: R13: 0000000000000002 R14: ffffffffba8d6ca0 R15: ffff8adff8100000
Sep 27 15:55:41 pve kernel:  ? acpi_idle_do_entry+0x82/0xc0
Sep 27 15:55:41 pve kernel:  acpi_idle_enter+0xbb/0x180
Sep 27 15:55:41 pve kernel:  cpuidle_enter_state+0x9a/0x6f0
Sep 27 15:55:41 pve kernel:  cpuidle_enter+0x2e/0x50
Sep 27 15:55:41 pve kernel:  do_idle+0x216/0x2a0
Sep 27 15:55:41 pve kernel:  cpu_startup_entry+0x1d/0x20
Sep 27 15:55:41 pve kernel:  start_secondary+0x122/0x160
Sep 27 15:55:41 pve kernel:  secondary_startup_64_no_verify+0xe5/0xeb
Sep 27 15:55:41 pve kernel:  </TASK>
Sep 27 15:55:41 pve kernel: ---[ end trace 0000000000000000 ]---
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: Register Dump
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: Register Name   Value
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: CTRL            181c0641
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: STATUS          00680693
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: CTRL_EXT        10000040
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: MDIC            1805dde1
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: ICR             00000081
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RCTL            0440803a
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RDH[0-3]        00000060 000000f0 0000008e 0000004e
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RDT[0-3]        0000005f 000000ef 0000008d 0000004d
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RDBAL[0-3]      065be000 0650f000 05038000 067cd000
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TCTL            a503f0fa
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TDBAL[0-3]      07d9e000 00eb2000 09eff000 06519000
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TDH[0-3]        00000068 0000008a 00000097 00000054
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TDT[0-3]        00000076 0000008b 00000097 0000005a
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Sep 27 15:55:41 pve kernel: igc 0000:04:00.0 enp4s0: Reset adapter
Sep 27 15:55:41 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Sep 27 15:55:45 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Sep 27 15:55:45 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Sep 27 15:55:45 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Sep 27 15:55:48 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Sep 27 15:55:48 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Sep 27 15:55:50 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Sep 27 15:55:50 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Sep 27 16:17:01 pve CRON[11230]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Sep 27 16:17:01 pve CRON[11231]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Sep 27 16:17:01 pve CRON[11230]: pam_unix(cron:session): session closed for user root
Sep 27 17:07:58 pve pvestatd[963]: auth key pair too old, rotating..
Sep 27 17:17:01 pve CRON[21045]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Sep 27 17:17:01 pve CRON[21046]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Sep 27 17:17:01 pve CRON[21045]: pam_unix(cron:session): session closed for user root
Sep 27 17:55:01 pve kernel: perf: interrupt took too long (2505 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
Sep 27 18:17:01 pve CRON[30829]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Sep 27 18:17:01 pve CRON[30830]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Sep 27 18:17:01 pve CRON[30829]: pam_unix(cron:session): session closed for user root
Sep 27 19:06:38 pve kernel: perf: interrupt took too long (3132 > 3131), lowering kernel.perf_event_max_sample_rate to 63750
Sep 27 19:17:01 pve CRON[40533]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Sep 27 19:17:01 pve CRON[40534]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Sep 27 19:17:01 pve CRON[40533]: pam_unix(cron:session): session closed for user root


***WOKE UP FROM MY NAP, WOKE LAPTOP UP***


Sep 27 19:45:38 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Sep 27 19:45:38 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Sep 27 19:45:38 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Sep 27 19:45:42 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Sep 27 19:45:42 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Sep 27 19:45:42 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Sep 27 19:45:54 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Sep 27 19:45:54 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Sep 27 19:45:54 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Sep 27 19:45:55 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Sep 27 19:45:57 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Sep 27 19:45:57 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Sep 27 19:45:57 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Sep 27 19:45:58 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Sep 27 19:45:58 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Sep 27 19:45:58 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Sep 27 19:47:26 pve pvedaemon[993]: <root@pam> successful auth for user 'root@pam'


***NO ISSUES***

I don't usually get issues when the laptop goes to sleep, only when it wakes up. In this trace, the adapter was reset when I put the laptop to sleep, but Proxmox was fine with it waking up again. This is unusual. As I've only just upgraded to kernel v6.2.16-14-pve I'm going to monitor crashes over the coming week and report back. If no joy, will do re the kernal update linked.
 
With the newest kernel v6.2.16-14-pve I am now getting adapter resets when my laptop goes to sleep and kernel crashes when it wakes up again. It seems to be worse than previous versions, though I do not know whether this has anything to do with the kernel updates themselves.

Earlier today is a good example:
  • Put laptop to sleep, adapter reset.
  • Woke up from sleep, kernel crashes.
Code:
*** TOOK A NAP, PUT LAPTOP TO SLEEP***


Oct 01 17:26:53 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 01 17:26:53 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 01 17:26:53 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 01 17:26:53 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 01 17:26:53 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 01 17:26:53 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state


*** 11 SECONDS LATER, ADAPTER RESETS ***


Oct 01 17:27:04 pve kernel: ------------[ cut here ]------------
Oct 01 17:27:04 pve kernel: NETDEV WATCHDOG: enp4s0 (igc): transmit queue 0 timed out
Oct 01 17:27:04 pve kernel: WARNING: CPU: 3 PID: 0 at net/sched/sch_generic.c:525 dev_watchdog+0x23a/0x250
Oct 01 17:27:04 pve kernel: Modules linked in: ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter nf_tables bonding tls softdog sunrpc binfmt_misc nfnetlink_log nfnetlink snd_hda_codec_hdmi snd_sof_pci_intel_icl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_soc_hdac_hda i915 snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi soundwire_bus snd_soc_core snd_compress x86_pkg_temp_thermal intel_powerclamp coretemp ac97_bus snd_pcm_dmaengine drm_buddy kvm_intel ttm snd_hda_intel drm_display_helper snd_intel_dspcfg snd_intel_sdw_acpi cec kvm snd_hda_codec intel_rapl_msr cmdlinepart rc_core crct10dif_pclmul snd_hda_core polyval_generic ghash_clmulni_intel snd_hwdep processor_thermal_device_pci_legacy sha512_ssse3 drm_kms_helper processor_thermal_device aesni_intel spi_nor snd_pcm processor_thermal_rfim crypto_simd cryptd pcspkr
Oct 01 17:27:04 pve kernel:  intel_cstate processor_thermal_mbox i2c_algo_bit mei_me snd_timer syscopyarea processor_thermal_rapl intel_rapl_common snd sysfillrect int340x_thermal_zone wmi_bmof mtd mei soundcore sysimgblt intel_soc_dts_iosf acpi_tad acpi_pad mac_hid zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_net vhost vhost_iotlb tap vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd drm efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq simplefb uas usb_storage dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c nvme xhci_pci spi_intel_pci i2c_i801 xhci_pci_renesas crc32_pclmul spi_intel i2c_smbus sdhci_pci nvme_core xhci_hcd igc cqhci sdhci nvme_common video wmi pinctrl_jasperlake
Oct 01 17:27:04 pve kernel: CPU: 3 PID: 0 Comm: swapper/3 Tainted: P           O       6.2.16-14-pve #1
Oct 01 17:27:04 pve kernel: Hardware name: Default string Default string/Default string, BIOS 5.19 11/11/2022
Oct 01 17:27:04 pve kernel: RIP: 0010:dev_watchdog+0x23a/0x250
*** SOME LINES CUT TO GET UNDER FORUM WORD LIMITED***
Oct 01 17:27:04 pve kernel: Call Trace:
Oct 01 17:27:04 pve kernel:  <IRQ>
Oct 01 17:27:04 pve kernel:  ? show_regs+0x6d/0x80
Oct 01 17:27:04 pve kernel:  ? __warn+0x89/0x160
Oct 01 17:27:04 pve kernel:  ? dev_watchdog+0x23a/0x250
Oct 01 17:27:04 pve kernel:  ? report_bug+0x17e/0x1b0
Oct 01 17:27:04 pve kernel:  ? irq_work_queue+0x2f/0x70
Oct 01 17:27:04 pve kernel:  ? handle_bug+0x46/0x90
Oct 01 17:27:04 pve kernel:  ? exc_invalid_op+0x18/0x80
Oct 01 17:27:04 pve kernel:  ? asm_exc_invalid_op+0x1b/0x20
Oct 01 17:27:04 pve kernel:  ? dev_watchdog+0x23a/0x250
Oct 01 17:27:04 pve kernel:  ? dev_watchdog+0x23a/0x250
Oct 01 17:27:04 pve kernel:  ? __pfx_dev_watchdog+0x10/0x10
Oct 01 17:27:04 pve kernel:  call_timer_fn+0x29/0x160
Oct 01 17:27:04 pve kernel:  ? __pfx_dev_watchdog+0x10/0x10
Oct 01 17:27:04 pve kernel:  __run_timers+0x259/0x310
Oct 01 17:27:04 pve kernel:  run_timer_softirq+0x1d/0x40
Oct 01 17:27:04 pve kernel:  __do_softirq+0xd6/0x346
Oct 01 17:27:04 pve kernel:  ? hrtimer_interrupt+0x11f/0x250
Oct 01 17:27:04 pve kernel:  __irq_exit_rcu+0xa2/0xd0
Oct 01 17:27:04 pve kernel:  irq_exit_rcu+0xe/0x20
Oct 01 17:27:04 pve kernel:  sysvec_apic_timer_interrupt+0x92/0xd0
Oct 01 17:27:04 pve kernel:  </IRQ>
Oct 01 17:27:04 pve kernel:  <TASK>
Oct 01 17:27:04 pve kernel:  asm_sysvec_apic_timer_interrupt+0x1b/0x20
Oct 01 17:27:04 pve kernel: RIP: 0010:native_safe_halt+0xb/0x10
Oct 01 17:27:04 pve kernel: Code: a0 60 25 84 e8 c6 da 7d ff e9 3e ff ff ff cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 90 0f 00 2d 79 b6 37 00 fb f4 <c3> cc cc cc cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66
*** SOME LINES CUT TO GET UNDER FORUM WORD LIMITED***
Oct 01 17:27:04 pve kernel:  ? acpi_idle_do_entry+0x82/0xc0
Oct 01 17:27:04 pve kernel:  acpi_idle_enter+0xbb/0x180
Oct 01 17:27:04 pve kernel:  cpuidle_enter_state+0x9a/0x6f0
Oct 01 17:27:04 pve kernel:  cpuidle_enter+0x2e/0x50
Oct 01 17:27:04 pve kernel:  do_idle+0x216/0x2a0
Oct 01 17:27:04 pve kernel:  cpu_startup_entry+0x1d/0x20
Oct 01 17:27:04 pve kernel:  start_secondary+0x122/0x160
Oct 01 17:27:04 pve kernel:  secondary_startup_64_no_verify+0xe5/0xeb
Oct 01 17:27:04 pve kernel:  </TASK>
Oct 01 17:27:04 pve kernel: ---[ end trace 0000000000000000 ]---
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: Register Dump
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: Register Name   Value
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: CTRL            181c0641
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: STATUS          00680693
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: CTRL_EXT        10000040
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: MDIC            1805dde1
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: ICR             00000081
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RCTL            0440803a
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RDH[0-3]        000000f2 000000f2 00000038 0000007a
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RDT[0-3]        000000f1 000000f1 00000037 00000079
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RDBAL[0-3]      06146000 06149000 0614c000 0614f000
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TCTL            a503f0fa
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TDBAL[0-3]      06134000 06139000 0613e000 06143000
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TDH[0-3]        00000098 000000bd 00000062 0000009e
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TDT[0-3]        000000b6 000000d9 00000075 000000b4
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Oct 01 17:27:04 pve kernel: igc 0000:04:00.0 enp4s0: Reset adapter
Oct 01 17:27:04 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Oct 01 17:27:06 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Oct 01 17:27:06 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Oct 01 17:52:30 pve systemd[1]: Starting apt-daily.service - Daily apt download activities...
Oct 01 17:52:31 pve systemd[1]: apt-daily.service: Deactivated successfully.
Oct 01 17:52:31 pve systemd[1]: Finished apt-daily.service - Daily apt download activities.
Oct 01 18:17:01 pve CRON[202628]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 01 18:17:01 pve CRON[202629]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 01 18:17:01 pve CRON[202628]: pam_unix(cron:session): session closed for user root


***AWKOKE FROM NAP, WOKE UP LAPTOP ***


Oct 01 19:01:07 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 10 Mbps Full Duplex, Flow Control: RX
Oct 01 19:01:07 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 01 19:01:07 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 01 19:01:08 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 01 19:01:08 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 01 19:01:08 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 01 19:01:10 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Oct 01 19:01:10 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Oct 01 19:01:13 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 01 19:01:13 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 01 19:01:13 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state


***17 SECONDS LATER, KERNEL CRASHES ***


Oct 01 19:17:17 pve kernel: ------------[ cut here ]------------
Oct 01 19:17:17 pve kernel: refcount_t: underflow; use-after-free.
Oct 01 19:17:17 pve kernel: WARNING: CPU: 0 PID: 0 at lib/refcount.c:28 refcount_warn_saturate+0xa3/0x150
Oct 01 19:17:17 pve kernel: Modules linked in: ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter nf_tables bonding tls softdog sunrpc binfmt_misc nfnetlink_log nfnetlink snd_hda_codec_hdmi snd_sof_pci_intel_icl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_sof_utils snd_soc_hdac_hda i915 snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi soundwire_bus snd_soc_core snd_compress x86_pkg_temp_thermal intel_powerclamp coretemp ac97_bus snd_pcm_dmaengine drm_buddy kvm_intel ttm snd_hda_intel drm_display_helper snd_intel_dspcfg snd_intel_sdw_acpi cec kvm snd_hda_codec intel_rapl_msr cmdlinepart rc_core crct10dif_pclmul snd_hda_core polyval_generic ghash_clmulni_intel snd_hwdep processor_thermal_device_pci_legacy sha512_ssse3 drm_kms_helper processor_thermal_device aesni_intel spi_nor snd_pcm processor_thermal_rfim crypto_simd cryptd pcspkr
Oct 01 19:17:17 pve kernel:  intel_cstate processor_thermal_mbox i2c_algo_bit mei_me snd_timer syscopyarea processor_thermal_rapl intel_rapl_common snd sysfillrect int340x_thermal_zone wmi_bmof mtd mei soundcore sysimgblt intel_soc_dts_iosf acpi_tad acpi_pad mac_hid zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_net vhost vhost_iotlb tap vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd drm efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq simplefb uas usb_storage dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c nvme xhci_pci spi_intel_pci i2c_i801 xhci_pci_renesas crc32_pclmul spi_intel i2c_smbus sdhci_pci nvme_core xhci_hcd igc cqhci sdhci nvme_common video wmi pinctrl_jasperlake
Oct 01 19:17:17 pve kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: P        W  O       6.2.16-14-pve #1
Oct 01 19:17:17 pve kernel: Hardware name: Default string Default string/Default string, BIOS 5.19 11/11/2022
Oct 01 19:17:17 pve kernel: RIP: 0010:refcount_warn_saturate+0xa3/0x150
*** SOMELINES CUT TO GET UNDER FORUM WORD LIMITED***
Oct 01 19:17:17 pve kernel: Call Trace:
Oct 01 19:17:17 pve kernel:  <IRQ>
Oct 01 19:17:17 pve kernel:  ? show_regs+0x6d/0x80
Oct 01 19:17:17 pve kernel:  ? __warn+0x89/0x160
Oct 01 19:17:17 pve kernel:  ? refcount_warn_saturate+0xa3/0x150
Oct 01 19:17:17 pve kernel:  ? report_bug+0x17e/0x1b0
Oct 01 19:17:17 pve kernel:  ? irq_work_queue+0x2f/0x70
Oct 01 19:17:17 pve kernel:  ? handle_bug+0x46/0x90
Oct 01 19:17:17 pve kernel:  ? exc_invalid_op+0x18/0x80
Oct 01 19:17:17 pve kernel:  ? asm_exc_invalid_op+0x1b/0x20
Oct 01 19:17:17 pve kernel:  ? refcount_warn_saturate+0xa3/0x150
Oct 01 19:17:17 pve kernel:  ? refcount_warn_saturate+0xa3/0x150
Oct 01 19:17:17 pve kernel:  napi_consume_skb+0x15b/0x180
Oct 01 19:17:17 pve kernel:  igc_poll+0x874/0x17d0 [igc]
Oct 01 19:17:17 pve kernel:  ? update_load_avg+0x82/0x810
Oct 01 19:17:17 pve kernel:  ? enqueue_entity+0x1b4/0x540
Oct 01 19:17:17 pve kernel:  __napi_poll+0x30/0x1f0
Oct 01 19:17:17 pve kernel:  net_rx_action+0x180/0x2d0
Oct 01 19:17:17 pve kernel:  ? __napi_schedule+0x71/0xa0
Oct 01 19:17:17 pve kernel:  __do_softirq+0xd6/0x346
Oct 01 19:17:17 pve kernel:  ? handle_irq_event+0x52/0x80
Oct 01 19:17:17 pve kernel:  ? handle_edge_irq+0xda/0x250
Oct 01 19:17:17 pve kernel:  __irq_exit_rcu+0xa2/0xd0
Oct 01 19:17:17 pve kernel:  irq_exit_rcu+0xe/0x20
Oct 01 19:17:17 pve kernel:  common_interrupt+0xa4/0xb0
Oct 01 19:17:17 pve kernel:  </IRQ>
Oct 01 19:17:17 pve kernel:  <TASK>
Oct 01 19:17:17 pve kernel:  asm_common_interrupt+0x27/0x40
Oct 01 19:17:17 pve kernel: RIP: 0010:native_safe_halt+0xb/0x10
Oct 01 19:17:17 pve kernel: Code: a0 60 25 84 e8 c6 da 7d ff e9 3e ff ff ff cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66 90 0f 00 2d 79 b6 37 00 fb f4 <c3> cc cc cc cc 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 66
*** SOME LINES CUT TO GET UNDER FORUM WORD LIMITED***
Oct 01 19:17:17 pve kernel:  ? acpi_idle_do_entry+0x82/0xc0
Oct 01 19:17:17 pve kernel:  acpi_idle_enter+0xbb/0x180
Oct 01 19:17:17 pve kernel:  cpuidle_enter_state+0x9a/0x6f0
Oct 01 19:17:17 pve kernel:  cpuidle_enter+0x2e/0x50
Oct 01 19:17:17 pve kernel:  do_idle+0x216/0x2a0
Oct 01 19:17:17 pve kernel:  cpu_startup_entry+0x1d/0x20
Oct 01 19:17:17 pve kernel:  rest_init+0xdc/0x100
Oct 01 19:17:17 pve kernel:  ? acpi_enable_subsystem+0xe6/0x2a0
Oct 01 19:17:17 pve kernel:  ? static_key_disable+0x1f/0x30
Oct 01 19:17:17 pve kernel:  arch_call_rest_init+0xe/0x30
Oct 01 19:17:17 pve kernel:  start_kernel+0x6ab/0xb80
Oct 01 19:17:17 pve kernel:  ? load_ucode_intel_bsp+0x3d/0x80
Oct 01 19:17:17 pve kernel:  x86_64_start_kernel+0x102/0x180
Oct 01 19:17:17 pve kernel:  secondary_startup_64_no_verify+0xe5/0xeb
Oct 01 19:17:17 pve kernel:  </TASK>
Oct 01 19:17:17 pve kernel: ---[ end trace 0000000000000000 ]---
Oct 01 19:17:17 pve kernel: ------------[ cut here ]------------
Oct 01 19:17:17 pve kernel: kernel BUG at lib/dynamic_queue_limits.c:27!
-- Reboot --
Oct 01 19:20:02 pve kernel: Linux version 6.2.16-14-pve (build@proxmox) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC PMX 6.2.16-14 (2023-09-19T08:17Z) ()
Oct 01 19:20:02 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.2.16-14-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt

It is clear that Proxmox kernel updates are not helping, so I'm going to see if configuration changes have any effect. The first one I'm thinking about is reverting the IOMMU configuration and converting the passed-through adapter into a paravirtualised adapter instead.

Are there any other configuration changes you think I should try?
 
Last edited:
@tictag may I ask how you are getting those kernel logs?

I am having an issue with my mini router randomly freezing, and I'm wondering if this is the same thing. When you get these kernel crashes, does the machine restart on its own, or what happens?

Mine is still powered on, network lights flashing, but it is completely unresponsive and I have to hard reset it.
 
may I ask how you are getting those kernel logs?

Proxmox > node e.g. 'pve' > System > Syslog

Yes, exactly the same, everything is flashing but completely unresponsive, only resolution is to power-cycle. There's a way to check whether you have the same NIC: type lspci -nn | grep Ethernet at a proxmox shell prompt.
 
I've just noticed Proxmox kernel v6.2.16-15 has been released - going to give this a try first.
 
My output from that command is:

Code:
root@router:~# lspci -nn | grep Ethernet
01:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
02:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
03:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)
04:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I226-V [8086:125c] (rev 04)

I'm having trouble diagnosing mine because I don't get any logs when it hangs, the entire box just seems to freeze and it doesn't get a chance to log anything.
 
Yes, we have the same NIC, probably the same issue, though for me Proxmox does usually log the failure and it's always something to do with this Intel I226-V NIC. I wish I could just replace it, so much heartache.
 
New kernel v6.2.16-15 has not fixed this issue, going to switch to a configuration change troubleshooting strategy. I'll post what I find.

Code:
Oct 08 13:40:34 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 08 13:40:34 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 08 13:40:34 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 08 13:40:38 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 08 13:40:38 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 08 13:40:38 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 08 13:40:48 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Oct 08 13:40:48 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Oct 08 13:40:48 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Oct 08 13:40:49 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Oct 08 13:40:52 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 08 13:40:52 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 08 13:40:52 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 08 13:40:52 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 08 13:40:52 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 08 13:40:52 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 08 13:47:09 pve kernel: ------------[ cut here ]------------
Oct 08 13:47:10 pve kernel: kernel BUG at lib/dynamic_queue_limits.c:27!
-- Reboot --
Oct 08 13:48:55 pve kernel: Linux version 6.2.16-15-pve (build@proxmox) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC PMX 6.2.16-15 (2023-09-28T13:53Z) ()
Oct 08 13:48:55 pve kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.2.16-15-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt
 
Troubleshooting strategy:
  1. Disable IOMMU and the direct pass-through of one of the NIC ports to pfSense.
  2. Revert to one Ethernet connection to the NUC (instead of two) and disable SMBv3 Multichannel support.
  3. Turn off all VMs except pfSense (no NAS, no Ad Guard).
  4. Wipe the hard drive and rebuild everything.
Does the community have any other test ideas I should try?
 
Hi, could you try installing proxmox-kernel-6.2.16-16-pve (which is currently available in pvetest [0]) and see whether the situation improves? This kernel version contains a number of fixes related to the igc module which are not part of earlier versions.

Among other things, it contains the patch I mentioned a few weeks ago, so this might be worth a try:
I did find another kernel patch [1] which apparently fixes a race condition that produce a kernel panic when the link is taken down. This sounds like it could be related to the issue you're seeing and it being a race condition would explain why this only happens sporadically. But unfortunately this is only a guess at this point.

[0] https://pve.proxmox.com/pve-docs/pve-admin-guide.html#sysadmin_test_repo
[1] https://lore.kernel.org/netdev/20230612205208.115292-2-anthony.l.nguyen@intel.com/
 
Last edited:
Updated to proxmox-kernel-6.2.16-18-pve, I'll keep you posted.

Note: there was a ton of other updates, for both Debian and Proxmox - I didn't appear to be able to selectively update i.e. all or nothing.
 
Day 1, during the day Adapter Reset occurs - no crash, though and later resumes from sleep with no issues.

Code:
***LAPTOP GOES TO SLEEP***

Oct 13 13:43:13 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Oct 13 13:43:13 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Oct 13 13:43:13 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Oct 13 13:43:14 pve kernel: vmbr0: port 2(enp4s0) entered disabled state

***LAPTOP WAKES UP ON ITS OWN***

Oct 13 14:14:07 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 14:14:07 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 13 14:14:07 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 13 14:14:07 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 14:14:07 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 13 14:14:07 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 13 14:14:20 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Oct 13 14:14:20 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Oct 13 14:14:20 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: Register Dump
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: Register Name   Value
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: CTRL            181c0641
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: STATUS          00680681
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: CTRL_EXT        10000040
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: MDIC            18017949
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: ICR             00000000
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RCTL            0440803a
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RDH[0-3]        0000000b 00000081 000000a6 000000a0
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RDT[0-3]        0000000a 00000080 000000a5 0000009f
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RXDCTL[0-3]     02040808 02040808 02040808 02040808
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RDBAL[0-3]      09578000 0957b000 0957e000 09581000
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: RDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TCTL            a503f0fa
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TDBAL[0-3]      0952d000 09532000 09538000 0953d000
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TDBAH[0-3]      00000001 00000001 00000001 00000001
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TDLEN[0-3]      00001000 00001000 00001000 00001000
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TDH[0-3]        000000aa 000000db 00000030 000000d3
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TDT[0-3]        000000b0 000000df 00000030 000000d8
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: TXDCTL[0-3]     02100108 02100108 02100108 02100108
Oct 13 14:14:20 pve kernel: igc 0000:05:00.0 enp5s0: Reset adapter

***ADAPTER RESET***

Oct 13 14:17:01 pve CRON[205375]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 13 14:17:01 pve CRON[205376]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 13 14:17:01 pve CRON[205375]: pam_unix(cron:session): session closed for user root
Oct 13 15:17:01 pve CRON[214693]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 13 15:17:01 pve CRON[214694]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 13 15:17:01 pve CRON[214693]: pam_unix(cron:session): session closed for user root
Oct 13 16:17:01 pve CRON[223985]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 13 16:17:01 pve CRON[223986]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 13 16:17:01 pve CRON[223985]: pam_unix(cron:session): session closed for user root

**LAPTOP RESUMES FROM SLEEP***

Oct 13 16:49:23 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 16:49:23 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 13 16:49:23 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state
Oct 13 16:49:26 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 16:49:26 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 13 16:49:26 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 13 16:49:39 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Down
Oct 13 16:49:39 pve kernel: vmbr0: port 3(enp5s0) entered disabled state
Oct 13 16:49:39 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Down
Oct 13 16:49:40 pve kernel: vmbr0: port 2(enp4s0) entered disabled state
Oct 13 16:49:42 pve kernel: igc 0000:05:00.0 enp5s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 16:49:42 pve kernel: vmbr0: port 3(enp5s0) entered blocking state
Oct 13 16:49:42 pve kernel: vmbr0: port 3(enp5s0) entered forwarding state
Oct 13 16:49:42 pve kernel: igc 0000:04:00.0 enp4s0: NIC Link is Up 2500 Mbps Full Duplex, Flow Control: RX/TX
Oct 13 16:49:42 pve kernel: vmbr0: port 2(enp4s0) entered blocking state
Oct 13 16:49:42 pve kernel: vmbr0: port 2(enp4s0) entered forwarding state

***NO ISSUES***

Oct 13 17:09:00 pve pvestatd[958]: auth key pair too old, rotating..
Oct 13 17:13:59 pve systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
Oct 13 17:13:59 pve systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
Oct 13 17:13:59 pve systemd[1]: Finished systemd-tmpfiles-clean.service - Cleanup of Temporary Directories.
Oct 13 17:13:59 pve systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully.
Oct 13 17:17:01 pve CRON[233355]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 13 17:17:01 pve CRON[233356]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 13 17:17:01 pve CRON[233355]: pam_unix(cron:session): session closed for user root
Oct 13 18:17:01 pve CRON[242676]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0)
Oct 13 18:17:01 pve CRON[242677]: (root) CMD (cd / && run-parts --report /etc/cron.hourly)
Oct 13 18:17:01 pve CRON[242676]: pam_unix(cron:session): session closed for user root
Oct 13 19:06:02 pve pvedaemon[988]: <root@pam> successful auth for user 'root@pam'
 
Day 3, laptop put to sleep, woke up automatically, went to sleep automatically and then finally resumed from hibernation sleep - no crashes, no adapter resets.
 
Day 4, laptop put to sleep, woke up automatically, went to sleep automatically and then finally resumed from hibernation sleep - no crashes, no adapter resets.
 
Day 5, put to sleep, laptop did not wake up automatically, resumed from hibernation sleep this morning - no crashes, no adapter resets. This is all looking pretty good for proxmox-kernel-6.2.16-18-pve (famous last words!).
 
  • Like
Reactions: fweber
Day 7, that's a week with no reoccurrence of this issue! I think we can call this one resolved! I hope this fix works for the other thread.

Thank you to all those that contributed to this, and in particular, @fweber .

At last, some stability.
 
Last edited:
  • Like
Reactions: fweber
Great to hear the new kernel seems to have fixed the crashes, thank you for testing and for the update!

One last thing, could you please mark the thread as "Solved"? This should be possible by editing the first post.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!