BUG: kernel NULL pointer dereference, address: 0000000000000000

ukro

Member
May 16, 2021
69
7
8
36
Cheers, updated from pve6 to pve7 and have this random error 1x in 4-36hours.
This thread seems similar but its not fixed on my HW.
https://forum.proxmox.com/threads/p...error_code-0x0000-no-web-access-no-ssh.96598/
I have web access and no ssh access, my VMs are runnning but the host only network between vms and host are down.
The web access is with errors like grayed out icons and cant shutdown VMs/CTs
The error occured maybe in high IO load of one of the VMs.

FYI: I updated because pve6 have some random errors(didn't want to report) that i thought pve7 would fix


CPU(s)

16 x Intel(R) Core(TM) i7-10700 CPU @ 2.90GHz (1 Socket)
Kernel Version

Linux 5.13.19-2-pve #1 SMP PVE 5.13.19-4 (Mon, 29 Nov 2021 12:10:09 +0100)
PVE Manager Version

pve-manager/7.1-8/5b267f33

Code:
Jan  9 04:11:21 matrix kernel: [10250.198771] BUG: kernel NULL pointer dereference, address: 0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.198796] #PF: supervisor read access in kernel mode
Jan  9 04:11:21 matrix kernel: [10250.198806] #PF: error_code(0x0000) - not-present page
Jan  9 04:11:21 matrix kernel: [10250.198817] PGD 0 P4D 0
Jan  9 04:11:21 matrix kernel: [10250.198825] Oops: 0000 [#1] SMP NOPTI
Jan  9 04:11:21 matrix kernel: [10250.198834] CPU: 5 PID: 757 Comm: arc_prune Tainted: P           O      5.13.19-2-pve #1
Jan  9 04:11:21 matrix kernel: [10250.198849] Hardware name: ASUS System Product Name/PRIME B460M-A, BIOS 1605 04/07/2021
Jan  9 04:11:21 matrix kernel: [10250.198863] RIP: 0010:__list_lru_walk_one+0x9c/0x110
Jan  9 04:11:21 matrix kernel: [10250.198876] Code: 8b 45 d0 e8 36 ef d6 00 83 f8 02 74 58 77 16 85 c0 74 74 8b 03 85 c0 74 7a 48 83 45 c0 01 48 83 6b 28 01 eb b0 83 f8 03 75 2a <49> 8b 07 4d 89 fe 4d 39 fd 74 0c 49 89 c7 49 8b 04 24 48 85 c0 75
Jan  9 04:11:21 matrix kernel: [10250.198906] RSP: 0018:ffffa84cc0897bf0 EFLAGS: 00010246
Jan  9 04:11:21 matrix kernel: [10250.198917] RAX: 0000000000000003 RBX: ffff8f21d9c7eb00 RCX: ffffa84cc0897c78
Jan  9 04:11:21 matrix kernel: [10250.198930] RDX: ffff8f21d9c7eb00 RSI: ffff8f21d9c7eb08 RDI: ffff8f275ef2e588
Jan  9 04:11:21 matrix kernel: [10250.198943] RBP: ffffa84cc0897c30 R08: ffff8f275c0935c0 R09: ffffa84cc0897d58
Jan  9 04:11:21 matrix kernel: [10250.198955] R10: 0000000000000000 R11: 0000000b81d8146c R12: ffffa84cc0897d58
Jan  9 04:11:21 matrix kernel: [10250.198968] R13: ffff8f21d9c7eb08 R14: ffff8f275ef2e608 R15: 0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.198981] FS:  0000000000000000(0000) GS:ffff8f28cf340000(0000) knlGS:0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.198995] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan  9 04:11:21 matrix kernel: [10250.199006] CR2: 0000000000000000 CR3: 00000001b9c10001 CR4: 00000000007726e0
Jan  9 04:11:21 matrix kernel: [10250.199020] PKRU: 55555554
Jan  9 04:11:21 matrix kernel: [10250.199026] Call Trace:
Jan  9 04:11:21 matrix kernel: [10250.199034]  ? ilookup+0x110/0x110
Jan  9 04:11:21 matrix kernel: [10250.199043]  ? ilookup+0x110/0x110
Jan  9 04:11:21 matrix kernel: [10250.199051]  list_lru_walk_one+0x4c/0x70
Jan  9 04:11:21 matrix kernel: [10250.199060]  prune_icache_sb+0x50/0xb0
Jan  9 04:11:21 matrix kernel: [10250.199068]  super_cache_scan+0x169/0x1f0
Jan  9 04:11:21 matrix kernel: [10250.199080]  zfs_prune+0x399/0x440 [zfs]
Jan  9 04:11:21 matrix kernel: [10250.199167]  ? psi_task_switch+0xd2/0x250
Jan  9 04:11:21 matrix kernel: [10250.199180]  ? __switch_to+0x11d/0x460
Jan  9 04:11:21 matrix kernel: [10250.199191]  ? __switch_to_asm+0x36/0x70
Jan  9 04:11:21 matrix kernel: [10250.199204]  zpl_prune_sb+0x35/0x50 [zfs]
Jan  9 04:11:21 matrix kernel: [10250.199267]  arc_prune_task+0x22/0x40 [zfs]
Jan  9 04:11:21 matrix kernel: [10250.199330]  taskq_thread+0x2b7/0x500 [spl]
Jan  9 04:11:21 matrix kernel: [10250.199345]  ? wake_up_q+0xa0/0xa0
Jan  9 04:11:21 matrix kernel: [10250.199704]  ? taskq_thread_spawn+0x60/0x60 [spl]
Jan  9 04:11:21 matrix kernel: [10250.200068]  kthread+0x128/0x150
Jan  9 04:11:21 matrix kernel: [10250.200430]  ? set_kthread_struct+0x50/0x50
Jan  9 04:11:21 matrix kernel: [10250.200785]  ret_from_fork+0x1f/0x30
Jan  9 04:11:21 matrix kernel: [10250.201142] Modules linked in: nfsd auth_rpcgss nfs_acl lockd grace veth tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic softdog intel_rapl_msr intel_rapl_common intel_tcc_cooling snd_sof_pci_intel_cnl snd_sof_intel_hda_common soundwire_intel soundwire_generic_allocation x86_pkg_temp_thermal nfnetlink_log soundwire_cadence intel_powerclamp ppdev snd_sof_intel_hda nfnetlink snd_sof_pci snd_sof_xtensa_dsp snd_sof snd_soc_hdac_hda snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi soundwire_bus ledtrig_audio snd_soc_core kvm_intel snd_compress ac97_bus snd_pcm_dmaengine snd_hda_intel snd_intel_dspcfg zfs(PO) mei_hdcp snd_intel_sdw_acpi kvm zunicode(PO) i915 snd_hda_codec crct10dif_pclmul zzstd(O) ghash_clmulni_intel snd_hda_core aesni_intel zlua(O) snd_hwdep crypto_simd zavl(PO) cryptd snd_pcm icp(PO) drm_kms_helper rapl snd_timer cec eeepc_wmi
Jan  9 04:11:21 matrix kernel: [10250.201174]  snd asus_wmi rc_core soundcore intel_cstate sparse_keymap mxm_wmi wmi_bmof i2c_algo_bit joydev pcspkr ee1004 fb_sys_fops efi_pstore input_leds syscopyarea sysfillrect mei_me sysimgblt mei zcommon(PO) znvpair(PO) spl(O) parport_pc parport vhost_net vhost mac_hid vhost_iotlb acpi_pad tap acpi_tad ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi wireguard curve25519_x86_64 libchacha20poly1305 chacha_x86_64 poly1305_x86_64 libblake2s blake2s_x86_64 libcurve25519_generic libchacha libblake2s_generic ip6_udp_tunnel udp_tunnel nct6775 hwmon_vid coretemp vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio drm sunrpc ip_tables x_tables autofs4 btrfs blake2b_generic xor zstd_compress raid6_pq dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c hid_generic usbkbd uas usbhid usb_storage hid crc32_pclmul r8169 nvme xhci_pci i2c_i801 ahci xhci_pci_renesas i2c_smbus nvme_core realtek xhci_hcd libahci wmi video pinctrl_sunrisepoint
Jan  9 04:11:21 matrix kernel: [10250.207517] CR2: 0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.208009] ---[ end trace 700e123ade4624b3 ]---
Jan  9 04:11:21 matrix kernel: [10250.303829] RIP: 0010:__list_lru_walk_one+0x9c/0x110
Jan  9 04:11:21 matrix kernel: [10250.304337] Code: 8b 45 d0 e8 36 ef d6 00 83 f8 02 74 58 77 16 85 c0 74 74 8b 03 85 c0 74 7a 48 83 45 c0 01 48 83 6b 28 01 eb b0 83 f8 03 75 2a <49> 8b 07 4d 89 fe 4d 39 fd 74 0c 49 89 c7 49 8b 04 24 48 85 c0 75
Jan  9 04:11:21 matrix kernel: [10250.305399] RSP: 0018:ffffa84cc0897bf0 EFLAGS: 00010246
Jan  9 04:11:21 matrix kernel: [10250.305934] RAX: 0000000000000003 RBX: ffff8f21d9c7eb00 RCX: ffffa84cc0897c78
Jan  9 04:11:21 matrix kernel: [10250.306459] RDX: ffff8f21d9c7eb00 RSI: ffff8f21d9c7eb08 RDI: ffff8f275ef2e588
Jan  9 04:11:21 matrix kernel: [10250.306989] RBP: ffffa84cc0897c30 R08: ffff8f275c0935c0 R09: ffffa84cc0897d58
Jan  9 04:11:21 matrix kernel: [10250.307516] R10: 0000000000000000 R11: 0000000b81d8146c R12: ffffa84cc0897d58
Jan  9 04:11:21 matrix kernel: [10250.308033] R13: ffff8f21d9c7eb08 R14: ffff8f275ef2e608 R15: 0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.308555] FS:  0000000000000000(0000) GS:ffff8f28cf340000(0000) knlGS:0000000000000000
Jan  9 04:11:21 matrix kernel: [10250.309084] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan  9 04:11:21 matrix kernel: [10250.309607] CR2: 0000000000000000 CR3: 000000010b1f8005 CR4: 00000000007726e0
Jan  9 04:11:21 matrix kernel: [10250.310147] PKRU: 55555554
Jan  9 04:11:46 matrix kernel: [10276.182809] watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [smbd:2375920]

Code:
root@matrix:~# pveversion --verbose
proxmox-ve: 7.1-1 (running kernel: 5.13.19-2-pve)
pve-manager: 7.1-8 (running version: 7.1-8/5b267f33)
pve-kernel-helper: 7.1-6
pve-kernel-5.13: 7.1-5
pve-kernel-5.4: 6.4-11
pve-kernel-5.13.19-2-pve: 5.13.19-4
pve-kernel-5.4.157-1-pve: 5.4.157-1
pve-kernel-5.4.143-1-pve: 5.4.143-1
pve-kernel-5.4.124-1-pve: 5.4.124-2
pve-kernel-5.4.119-1-pve: 5.4.119-1
pve-kernel-5.4.114-1-pve: 5.4.114-1
pve-kernel-5.4.106-1-pve: 5.4.106-1
pve-kernel-5.4.98-1-pve: 5.4.98-1
pve-kernel-5.4.73-1-pve: 5.4.73-1
ceph-fuse: 14.2.21-1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown: 0.8.36+pve1
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.22-pve2
libproxmox-acme-perl: 1.4.0
libproxmox-backup-qemu0: 1.2.0-1
libpve-access-control: 7.1-5
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.0-14
libpve-guest-common-perl: 4.0-3
libpve-http-server-perl: 4.0-4
libpve-storage-perl: 7.0-15
libqb0: 1.0.5-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 4.0.11-1
lxcfs: 4.0.11-pve1
novnc-pve: 1.3.0-1
proxmox-backup-client: 2.1.2-1
proxmox-backup-file-restore: 2.1.2-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.4-4
pve-cluster: 7.1-3
pve-container: 4.1-3
pve-docs: 7.1-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.3-4
pve-ha-manager: 3.3-1
pve-i18n: 2.6-2
pve-qemu-kvm: 6.1.0-3
pve-xtermjs: 4.12.0-1
qemu-server: 7.1-4
smartmontools: 7.2-pve2
spiceterm: 3.2-2
swtpm: 0.7.0~rc1+2
vncterm: 1.7-1
zfsutils-linux: 2.1.1-pve3
 

Attachments

  • syslog.zip
    839.6 KB · Views: 3
  • host_screen.png
    host_screen.png
    360.5 KB · Views: 9
  • Screenshot_252.png
    Screenshot_252.png
    57.4 KB · Views: 8
  • Screenshot_253.png
    Screenshot_253.png
    62.2 KB · Views: 8
  • Screenshot_254.png
    Screenshot_254.png
    31.7 KB · Views: 7
Last edited:

ukro

Member
May 16, 2021
69
7
8
36
After change of the network adapter from virtio to E1000 the problem went away instantly. For 6 days no errors/problems.
 
Last edited:

tristank

Member
Apr 24, 2020
32
6
13
22
Has this been fixed? Because I think I'm having the same issue on a Z490M Pro4 with a i9-10850K when I'm trying to use SR-IOV with a Intel 82576.

```
[ 480.881090] BUG: kernel NULL pointer dereference, address: 0000000000000008
[ 480.881108] #PF: supervisor read access in kernel mode
[ 480.881119] #PF: error_code(0x0000) - not-present page
```
 

ukro

Member
May 16, 2021
69
7
8
36
Has this been fixed? Because I think I'm having the same issue on a Z490M Pro4 with a i9-10850K when I'm trying to use SR-IOV with a Intel 82576.

```
[ 480.881090] BUG: kernel NULL pointer dereference, address: 0000000000000008
[ 480.881108] #PF: supervisor read access in kernel mode
[ 480.881119] #PF: error_code(0x0000) - not-present page
```
IDK if it was fixed, but i did fix it for myself. The error was when i was using TruenasVM with connected HDD.
After i connect the whole PCI controler(that have the drive) the error disapear (Fingers crossed-its 14days already with 0 errors)
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!