Panic after 6 to 7 upgrade

jggundin

Active Member
Aug 7, 2019
6
0
41
43
Hello,
After following the official guide steps to upgrade and apparently everything going fine, I rebooted the machine and got this PANIC on dmesg.
May it be a HW related issue?

Code:
[   15.498186] vmbr0: port 1(eno1) entered forwarding state
[   15.498261] IPv6: ADDRCONF(NETDEV_CHANGE): vmbr0: link becomes ready
[   16.435361] FS-Cache: Loaded
[   16.457367] FS-Cache: Netfs 'nfs' registered for caching
[   16.599368] NFS: Registering the id_resolver key type
[   16.599373] Key type id_resolver registered
[   16.599374] Key type id_legacy registered
[   16.714165] kauditd_printk_skb: 2 callbacks suppressed
[   16.714168] audit: type=1400 audit(1626764604.287:14): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="/usr/bin/lxc-start" pid=1870 comm="apparmor_parser"
[   16.729067] audit: type=1400 audit(1626764604.303:15): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default" pid=1877 comm="apparmor_parser"
[   16.729071] audit: type=1400 audit(1626764604.303:16): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-cgns" pid=1877 comm="apparmor_parser"
[   16.729074] audit: type=1400 audit(1626764604.303:17): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-with-mounting" pid=1877 comm="apparmor_parser"
[   16.729093] audit: type=1400 audit(1626764604.303:18): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="lxc-container-default-with-nesting" pid=1877 comm="apparmor_parser"
[   19.662064] nouveau 0000:82:00.0: [drm] Cannot find any crtc or sizes
[   24.630153]  zd0: p1 p2 p3 p4 p5 p6
[   24.643124]  zd16: p1 p2 p3 p4 p5 p6
[   24.670047]  zd32: p1 p2 p3 p4 p5 p6
[   24.680292]  zd48: p1 p2 p3 p4 p5 p6
[   24.719795]  zd112: p1 p2 p3 p4 p5 p6
[   24.729913]  zd128: p1 p2
[   24.736153]  zd144: p1 p2 p3 p4 p5 p6
[   24.747869]  zd160: p1 p2 p3 p4 p5 p6
[   24.796637]  zd256: p1 p2 p3 p4 p5 p6
[   24.805570]  zd288: p1 p2
[   24.819449]  zd304: p1 p2 p3 p4 p5 p6
[   24.836145]  zd320: p1 p2 p3 p4 p5 p6
[   24.846464]  zd336: p1 p2 p3 p4 p5 p6
[   24.857155]  zd352: p1 p2
[   24.868845]  zd368: p1 p2 p3 p4 p5 p6
[   24.884170]  zd384: p1 p2 p3
[   24.902640]  zd432: p1 p2 p3
[   24.913603]  zd448: p1 p2 p3 p4 p5 p6
[   24.920024]  zd464: p1 p2 < p5 >
[   24.975804]  zd576: p1 p2 p3 p4 p5 p6
[   25.008317]  zd672: p1 p2 p3 p4 p5 p6
[   25.020849]  zd688: p1 p2 p3 p4 p5 p6
[   25.038333]  zd704: p1 p2 p3 p4 p5 p6
[   25.042198] VERIFY(avl_find(tree, new_node, &where) == NULL) failed
[   25.042243] PANIC at avl.c:641:avl_add()
[   25.042260] Showing stack for process 2555
[   25.042262] CPU: 45 PID: 2555 Comm: z_livelist_cond Tainted: P           O      5.11.22-2-pve #1
[   25.042265] Hardware name: Supermicro X10DRi/X10DRI-T, BIOS 3.1 09/14/2018
[   25.042267] Call Trace:
[   25.042271]  dump_stack+0x70/0x8b
[   25.042280]  spl_dumpstack+0x29/0x2b [spl]
[   25.042297]  spl_panic+0xd4/0xfc [spl]
[   25.042305]  ? _cond_resched+0x1a/0x50
[   25.042310]  ? slab_pre_alloc_hook.constprop.0+0x96/0xe0
[   25.042317]  ? __kmalloc_node+0x144/0x2b0
[   25.042321]  ? spl_kmem_alloc_impl+0xb5/0x100 [spl]
[   25.042328]  avl_add+0xa1/0xb0 [zavl]
[   25.042333]  dsl_livelist_iterate+0x131/0x1e0 [zfs]
[   25.042448]  bpobj_iterate_blkptrs+0xf6/0x340 [zfs]
[   25.042503]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[   25.042609]  bpobj_iterate_impl+0x26b/0x4e0 [zfs]
[   25.042663]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[   25.042736]  bpobj_iterate_nofree+0x16/0x20 [zfs]
[   25.042789]  dsl_process_sub_livelist+0x70/0xb0 [zfs]
[   25.042864]  ? dsl_deadlist_cache_compare+0x20/0x20 [zfs]
[   25.042952]  spa_livelist_condense_cb+0xb1/0x210 [zfs]
[   25.043059]  zthr_procedure+0x141/0x160 [zfs]
[   25.043178]  ? zrl_is_locked+0x20/0x20 [zfs]
[   25.043295]  thread_generic_wrapper+0x79/0x90 [spl]
[   25.043304]  kthread+0x12f/0x150
[   25.043308]  ? __thread_exit+0x20/0x20 [spl]
[   25.043315]  ? __kthread_bind_mask+0x70/0x70
[   25.043318]  ret_from_fork+0x22/0x30
[   25.048471]  zd720: p1 p2 p3 p4 p5 p6
[   25.573010] L1TF CPU bug present and SMT on, data leak possible. See CVE-2018-3646 and https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/l1tf.html for details.
[   26.047437] device tap2012i0 entered promiscuous mode
[   26.056686] vmbr0: port 2(tap2012i0) entered blocking state
[   26.056690] vmbr0: port 2(tap2012i0) entered disabled state
[   26.056856] vmbr0: port 2(tap2012i0) entered blocking state
[   26.056858] vmbr0: port 2(tap2012i0) entered forwarding state
[   26.085505] HTB: quantum of class 10001 is big. Consider r2q change.

[   26.085505] HTB: quantum of class 10001 is big. Consider r2q change.
[   30.447544] device tap2013i0 entered promiscuous mode
[   30.459153] vmbr0: port 3(tap2013i0) entered blocking state
[   30.459157] vmbr0: port 3(tap2013i0) entered disabled state
[   30.459288] vmbr0: port 3(tap2013i0) entered blocking state
[   30.459290] vmbr0: port 3(tap2013i0) entered forwarding state
[   30.487885] HTB: quantum of class 10001 is big. Consider r2q change.
[   31.953935]  zd752: p1 p2 p3 p4 p5 p6
[   31.959409]  zd768: p1 p2
[   31.964582]  zd784: p1 p2 p3 p4 p5 p6
[   31.975802]  zd800: p1 p2
[   31.982707]  zd816: p1 p2
[   31.992916]  zd832: p1 p2
[   32.000123]  zd848: p1 p2
[   32.008073]  zd864: p1 p2 p3 p4 p5 p6
[   32.018072]  zd880: p1 p2 p3 p4 p5 p6
[   32.023615]  zd896: p1 p2 p3 p4 p5 p6
[   32.034346]  zd912: p1 p2
[   32.041183]  zd928: p1 p2 p3 p4 p5 p6
[   32.050356]  zd944: p1 p2
[   32.061368]  zd960: p1 p2 p3 p4 p5 p6
[   32.075441]  zd976: p1 p2 p3 p4 p5 p6
[   32.103957]  zd1008: p1 p2 p3 p4 p5 p6
[   32.116300]  zd1024: p1 p2 p3 p4 p5 p6
[   32.133344]  zd1040: p1 p2 p3 p4 p5 p6
[   32.148243]  zd1056: p1 p2 p3 p4 p5 p6
[   32.178784]  zd1072: p1 p2
[   32.210526]  zd1088: p1 p2
[   32.235614]  zd1104: p1 p2
[   32.268620]  zd1120: p1 p2 p3 p4 p5 p6
[   32.303757]  zd1136: p1 p2
[   32.336506]  zd1152: p1 p2 p3 p4 p5 p6
[   32.371000]  zd1168: p1 p2
[   32.392059]  zd1184: p1 p2 p3 p4 p5 p6
[   32.411337]  zd1200: p1 p2 p3 p4 p5 p6
[   32.463391]  zd1232: p1 p2 p3 p4 p5 p6
[   32.488786]  zd1248: p1 p2 p3 p4 p5 p6
[   32.548230]  zd1264: p1 p2
[   32.590283]  zd1280: p1 p2
[   32.636450]  zd1296: p1 p2
[   32.673325]  zd1312: p1 p2 p3 p4 p5 p6
[   32.706339]  zd1328: p1 p2 p3 p4 p5 p6
[   32.748876]  zd1344: p1 p2
[   32.790446]  zd1360: p1 p2
[   32.812391]  zd1376: p1 p2 p3 p4 p5 p6
[   32.838764]  zd1392: p1 p2
[   32.861889]  zd1408: p1 p2
[   32.988576]  zd1424: p1 p2 p3 p4 p5 p6
[   33.144672]  zd1440: p1 p2
[  242.624241] INFO: task z_livelist_cond:2555 blocked for more than 120 seconds.
[  242.624282]       Tainted: P           O      5.11.22-2-pve #1
[  242.624301] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  242.624326] task:z_livelist_cond state:D stack:    0 pid: 2555 ppid:     2 flags:0x00004000
[  242.624331] Call Trace:
[  242.624337]  __schedule+0x2ca/0x880
[  242.624346]  schedule+0x4f/0xc0
[  242.624349]  spl_panic+0xfa/0xfc [spl]
[  242.624366]  ? _cond_resched+0x1a/0x50
[  242.624369]  ? slab_pre_alloc_hook.constprop.0+0x96/0xe0
[  242.624378]  ? __kmalloc_node+0x144/0x2b0
[  242.624381]  ? spl_kmem_alloc_impl+0xb5/0x100 [spl]
[  242.624387]  avl_add+0xa1/0xb0 [zavl]
[  242.624393]  dsl_livelist_iterate+0x131/0x1e0 [zfs]
[  242.624535]  bpobj_iterate_blkptrs+0xf6/0x340 [zfs]
[  242.624615]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[  242.624703]  bpobj_iterate_impl+0x26b/0x4e0 [zfs]
[  242.624783]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[  242.624890]  bpobj_iterate_nofree+0x16/0x20 [zfs]
[  242.624967]  dsl_process_sub_livelist+0x70/0xb0 [zfs]
[  242.625057]  ? dsl_deadlist_cache_compare+0x20/0x20 [zfs]
[  242.625160]  spa_livelist_condense_cb+0xb1/0x210 [zfs]
[  242.625257]  zthr_procedure+0x141/0x160 [zfs]
[  242.625359]  ? zrl_is_locked+0x20/0x20 [zfs]
[  242.625460]  thread_generic_wrapper+0x79/0x90 [spl]
[  242.625468]  kthread+0x12f/0x150
[  242.625474]  ? __thread_exit+0x20/0x20 [spl]
[  242.625481]  ? __kthread_bind_mask+0x70/0x70
[  242.625483]  ret_from_fork+0x22/0x30
[  363.456242] INFO: task z_livelist_cond:2555 blocked for more than 241 seconds.
[  363.456311]       Tainted: P           O      5.11.22-2-pve #1
[  363.456353] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[  363.456419] task:z_livelist_cond state:D stack:    0 pid: 2555 ppid:     2 flags:0x00004000
[  363.456439] Call Trace:
[  363.456446]  __schedule+0x2ca/0x880
[  363.456454]  schedule+0x4f/0xc0
[  363.456457]  spl_panic+0xfa/0xfc [spl]
[  363.456473]  ? _cond_resched+0x1a/0x50
[  363.456476]  ? slab_pre_alloc_hook.constprop.0+0x96/0xe0
[  363.456482]  ? __kmalloc_node+0x144/0x2b0
[  363.456485]  ? spl_kmem_alloc_impl+0xb5/0x100 [spl]
[  363.456493]  avl_add+0xa1/0xb0 [zavl]
[  363.456498]  dsl_livelist_iterate+0x131/0x1e0 [zfs]
[  363.456633]  bpobj_iterate_blkptrs+0xf6/0x340 [zfs]
[  363.456730]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[  363.456815]  bpobj_iterate_impl+0x26b/0x4e0 [zfs]
[  363.456893]  ? dsl_deadlist_load_cache+0x230/0x230 [zfs]
[  363.456979]  bpobj_iterate_nofree+0x16/0x20 [zfs]
[  363.457056]  dsl_process_sub_livelist+0x70/0xb0 [zfs]
[  363.457142]  ? dsl_deadlist_cache_compare+0x20/0x20 [zfs]
[  363.457228]  spa_livelist_condense_cb+0xb1/0x210 [zfs]
[  363.457322]  zthr_procedure+0x141/0x160 [zfs]
[  363.457440]  ? zrl_is_locked+0x20/0x20 [zfs]
[  363.457544]  thread_generic_wrapper+0x79/0x90 [spl]
[  363.457552]  kthread+0x12f/0x150
[  363.457557]  ? __thread_exit+0x20/0x20 [spl]
[  363.457565]  ? __kthread_bind_mask+0x70/0x70
[  363.457567]  ret_from_fork+0x22/0x30
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!