pve 8.2.2 Linux 6.8.4-3 ZFS Problem BUG: kernel NULL pointer dereference

[TobiT]

I have an proxmox Installation with a normal SSD for the system and for the data I have 2 USB connected NVMEs with a RAIDZ1. I updated it yesterday. My ZFS version changed from 2.1.12-pve1 to zfs-2.2.3-pve2. After that I couldn't boot the system anymore. If I disconnect the NVMEs I can boot normally.
If I cannot the USB NVMEs I get the following dmesg:

[30539.450243] usb 4-3: new SuperSpeed Plus Gen 2x1 USB device number 2 using xhci_hcd
[30539.470179] usb 4-3: New USB device found, idVendor=0bda, idProduct=9210, bcdDevice=20.01
[30539.470182] usb 4-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[30539.470183] usb 4-3: Product: RTL9210
[30539.470184] usb 4-3: Manufacturer: Realtek
[30539.470185] usb 4-3: SerialNumber: 012345678904
[30539.472131] usb 4-3: Enable of device-initiated U1 failed.
[30539.472458] usb 4-3: Enable of device-initiated U2 failed.
[30539.483568] usbcore: registered new interface driver usb-storage
[30539.527050] usb 4-3: Enable of device-initiated U1 failed.
[30539.527787] usb 4-3: Enable of device-initiated U2 failed.
[30539.531056] scsi host2: uas
[30539.531108] usbcore: registered new interface driver uas
[30539.534598] scsi 2:0:0:0: Direct-Access     Realtek  RTL9210 NVME     1.00 PQ: 0 ANSI: 6
[30539.567228] sd 2:0:0:0: Attached scsi generic sg0 type 0
[30539.578007] sd 2:0:0:0: [sda] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[30539.579508] sd 2:0:0:0: [sda] Write Protect is off
[30539.579513] sd 2:0:0:0: [sda] Mode Sense: 37 00 00 08
[30539.582705] sd 2:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[30539.583921] sd 2:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[30539.583922] sd 2:0:0:0: [sda] Optimal transfer size 33553920 bytes
[30539.595872]  sda: sda1 sda9
[30539.596162] sd 2:0:0:0: [sda] Attached SCSI disk
[30540.623009] BUG: kernel NULL pointer dereference, address: 0000000000000138
[30540.623079] #PF: supervisor read access in kernel mode
[30540.623120] #PF: error_code(0x0000) - not-present page
[30540.623163] PGD 0 P4D 0
[30540.623180] Oops: 0000 [#1] PREEMPT SMP NOPTI
[30540.623221] CPU: 6 PID: 185215 Comm: txg_sync Tainted: P        W  O       6.8.4-3-pve #1
[30540.623289] Hardware name: Intel(R) Client Systems NUC11PAHi7/NUC11PABi7, BIOS PATGL357.0041.2021.0811.1505 08/11/2021
[30540.623381] RIP: 0010:metaslab_free_concrete+0x4c/0x290 [zfs]
[30540.623616] Code: 48 8b 47 68 48 8b 8f 88 2b 00 00 48 89 45 d0 48 83 f9 3f 0f 87 9f 4f 18 00 49 8b 87 a8 2b 00 00 4c 89 e2 48 d3 ea 48 8b 1c d0 <8b> 83 38 01 00 00 85 c0 0f 85 31 01 00 00 4c 8b 8b b8 00 00 00 4d
[30540.623787] RSP: 0018:ffffaf9c0439f2a8 EFLAGS: 00010203
[30540.623832] RAX: ffff9ae095323000 RBX: 0000000000000000 RCX: 0000000000000022
[30540.623900] RDX: 000000000000400b RSI: 0001002e0e04e800 RDI: ffff9ae08b8d4000
[30540.623965] RBP: ffffaf9c0439f2e0 R08: 0000000000000000 R09: 0000000000000000
[30540.625658] R10: 0000000000000000 R11: 0000000000000000 R12: 0001002e0e04e800
[30540.627349] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9ae08b8d4000
[30540.629050] FS:  0000000000000000(0000) GS:ffff9ae420500000(0000) knlGS:0000000000000000
[30540.630704] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[30540.632614] CR2: 0000000000000138 CR3: 000000013be36005 CR4: 0000000000f70ef0
[30540.632616] PKRU: 55555554
[30540.632617] Call Trace:
[30540.632619]  <TASK>
[30540.640265]  ? show_regs+0x6d/0x80
[30540.640270]  ? __die+0x24/0x80
[30540.640272]  ? page_fault_oops+0x176/0x500
[30540.640276]  ? __dprintf+0x12e/0x1d0 [zfs]
[30540.647266]  ? do_user_addr_fault+0x2f9/0x6b0
[30540.647270]  ? dbuf_redirty+0x2c/0x50 [zfs]
[30540.651906]  ? exc_page_fault+0x83/0x1b0
[30540.653485]  ? asm_exc_page_fault+0x27/0x30
[30540.655796]  ? metaslab_free_concrete+0x4c/0x290 [zfs]
[30540.657574]  metaslab_free_impl+0xc1/0x110 [zfs]
[30540.659370]  metaslab_free_dva+0x61/0x90 [zfs]
[30540.661185]  metaslab_free+0x11e/0x1b0 [zfs]
[30540.663036]  zio_free_sync+0x11d/0x130 [zfs]
[30540.664907]  dsl_scan_free_block_cb+0x6a/0x1c0 [zfs]
[30540.666849]  bptree_visit_cb+0x46/0x160 [zfs]
[30540.668807]  traverse_visitbp+0x3f2/0xae0 [zfs]
[30540.671130]  ? traverse_prefetch_metadata+0x12a/0x140 [zfs]
[30540.673154]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.675219]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.677268]  traverse_dnode+0xd9/0x210 [zfs]
[30540.679362]  traverse_visitbp+0x70c/0xae0 [zfs]
[30540.681482]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.683607]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.685630]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.687573]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.689499]  traverse_visitbp+0x306/0xae0 [zfs]
[30540.691388]  traverse_dnode+0xd9/0x210 [zfs]
[30540.693295]  traverse_visitbp+0x948/0xae0 [zfs]
[30540.695189]  traverse_impl+0x1da/0x4a0 [zfs]
[30540.697021]  ? __pfx_bptree_visit_cb+0x10/0x10 [zfs]
[30540.698806]  traverse_dataset_destroyed+0x27/0x40 [zfs]
[30540.700577]  ? __pfx_bptree_visit_cb+0x10/0x10 [zfs]
[30540.702291]  bptree_iterate+0x1ea/0x390 [zfs]
[30540.704000]  ? __pfx_dsl_scan_free_block_cb+0x10/0x10 [zfs]
[30540.705708]  dsl_scan_sync+0x626/0x14a0 [zfs]
[30540.707410]  ? zio_destroy+0x9a/0xe0 [zfs]
[30540.709082]  spa_sync+0x5f1/0x1030 [zfs]
[30540.710765]  ? spa_txg_history_init_io+0x120/0x130 [zfs]
[30540.712460]  txg_sync_thread+0x1fd/0x390 [zfs]
[30540.714133]  ? __pfx_txg_sync_thread+0x10/0x10 [zfs]
[30540.715792]  ? __pfx_thread_generic_wrapper+0x10/0x10 [spl]
[30540.717318]  thread_generic_wrapper+0x5c/0x70 [spl]
[30540.718830]  kthread+0xef/0x120
[30540.720345]  ? __pfx_kthread+0x10/0x10
[30540.721881]  ret_from_fork+0x44/0x70
[30540.723394]  ? __pfx_kthread+0x10/0x10
[30540.724897]  ret_from_fork_asm+0x1b/0x30
[30540.726398]  </TASK>
[30540.727895] Modules linked in: uas usb_storage ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter nf_tables bonding tls softdog sunrpc nfnetlink_log nfnetlink binfmt_misc snd_hda_codec_hdmi xe intel_rapl_msr drm_gpuvm intel_rapl_common drm_exec gpu_sched snd_hda_codec_realtek drm_suballoc_helper drm_                                                                            ttm_helper intel_uncore_frequency snd_hda_codec_generic intel_uncore_frequency_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_sof_pci_intel_tgl snd_sof_intel_hda_common kvm soundwire_intel snd_sof_intel_hda_mlink iwlmvm irqbypass soundwire_cadence crct10dif_pclmul snd_sof_intel_hda polyval_clmulni snd_sof_pci polyval_generic snd                                                                            _sof_xtensa_dsp ghash_clmulni_intel snd_sof sha256_ssse3 sha1_ssse3 snd_sof_utils mac80211 aesni_intel snd_soc_hdac_hda crypto_simd cryptd snd_hda_ext_core libarc4 snd_soc_acpi_intel_match snd_soc_acpi soundwire_generic_allocation soundwire_bus rapl i915 snd_soc_core snd_compress ac97_bus snd_pcm_dmaengine snd_hda_intel
[30540.727930]  snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core snd_hwdep mei_pxp mei_hdcp snd_pcm drm_buddy ttm cmdlinepart iwlwifi spi_nor drm_display_helper snd_timer intel_cstate cfg80211 pcspkr cec snd ucsi_acpi mtd wmi_bmof mei_me typec_ucsi soundcore ee1004 rc_core mei i2c_algo_bit typec intel_pmc_core igen6_edac intel_vsec pmt                                                                            _telemetry pmt_class input_leds acpi_pad acpi_tad joydev mac_hid zfs(PO) spl(O) vhost_net vhost vhost_iotlb tap efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq hid_generic usbkbd usbhid hid dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c xhci_pci intel_lpss_pci nvme xhci_pci_renesas intel_lpss spi_                                                                            intel_pci crc32_pclmul igc thunderbolt nvme_core ahci i2c_i801 xhci_hcd i2c_smbus libahci spi_intel idma64 nvme_auth video wmi pinctrl_tigerlake
[30540.741567] CR2: 0000000000000138
[30540.741568] ---[ end trace 0000000000000000 ]---
[30540.741570] BUG: kernel NULL pointer dereference, address: 0000000000000001
[30540.741571] #PF: supervisor write access in kernel mode
[30540.741572] #PF: error_code(0x0002) - not-present page
[30540.741573] PGD 0 P4D 0
[30540.741575] Oops: 0002 [#2] PREEMPT SMP NOPTI
[30540.741576] CPU: 3 PID: 185096 Comm: z_fr_iss_1 Tainted: P      D W  O       6.8.4-3-pve #1
[30540.741578] Hardware name: Intel(R) Client Systems NUC11PAHi7/NUC11PABi7, BIOS PATGL357.0041.2021.0811.1505 08/11/2021
[30540.741579] RIP: 0010:mutex_lock+0x1d/0x50
[30540.741583] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 55 48 89 e5 53 48 89 fb e8 5e da ff ff 31 c0 65 48 8b 14 25 80 43 03 00 <f0> 48 0f b1 13 75 10 48 8b 5d f8 c9 31 c0 31 d2 31 ff c3 cc cc cc
[30540.741584] RSP: 0018:ffffaf9c01b9bd40 EFLAGS: 00010246
[30540.741586] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
[30540.741587] RDX: ffff9ae08caf2f40 RSI: 0000000000000000 RDI: 0000000000000000
[30540.741588] RBP: ffffaf9c01b9bd48 R08: 0000000000000000 R09: 0000000000000000
[30540.741588] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[30540.741589] R13: ffff9ae08efc94a8 R14: ffff9ae08cbb7600 R15: ffff9ae08b8fb3c0
[30540.741590] FS:  0000000000000000(0000) GS:ffff9ae420380000(0000) knlGS:0000000000000000
[30540.741591] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[30540.741592] CR2: 0000000000000001 CR3: 000000013be36004 CR4: 0000000000f70ef0
[30540.741593] PKRU: 55555554
[30540.741593] Call Trace:
[30540.741595]  <TASK>
[30540.741597]  ? show_regs+0x6d/0x80
[30540.741601]  ? __die+0x24/0x80
[30540.741603]  ? page_fault_oops+0x176/0x500
[30540.741606]  ? do_user_addr_fault+0x2f9/0x6b0
[30540.741609]  ? psi_group_change+0x1fb/0x460
[30540.741613]  ? exc_page_fault+0x83/0x1b0
[30540.741615]  ? asm_exc_page_fault+0x27/0x30
[30540.741618]  ? mutex_lock+0x1d/0x50
[30540.741620]  ddt_enter+0x12/0x30 [zfs]
[30540.741816]  zio_ddt_free+0x32/0x80 [zfs]
[30540.741941]  zio_execute+0x88/0x130 [zfs]
[30540.742063]  taskq_thread+0x27f/0x490 [spl]
[30540.742073]  ? __pfx_default_wake_function+0x10/0x10
[30540.742076]  ? __pfx_zio_execute+0x10/0x10 [zfs]
[30540.742199]  ? __pfx_taskq_thread+0x10/0x10 [spl]
[30540.742209]  kthread+0xef/0x120
[30540.742211]  ? __pfx_kthread+0x10/0x10
[30540.742212]  ret_from_fork+0x44/0x70
[30540.742214]  ? __pfx_kthread+0x10/0x10
[30540.742215]  ret_from_fork_asm+0x1b/0x30
[30540.742217]  </TASK>
[30540.742218] Modules linked in: uas usb_storage ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter nf_tables bonding tls softdog sunrpc nfnetlink_log nfnetlink binfmt_misc snd_hda_codec_hdmi xe intel_rapl_msr drm_gpuvm intel_rapl_common drm_exec gpu_sched snd_hda_codec_realtek drm_suballoc_helper drm_                                                                            ttm_helper intel_uncore_frequency snd_hda_codec_generic intel_uncore_frequency_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel snd_sof_pci_intel_tgl snd_sof_intel_hda_common kvm soundwire_intel snd_sof_intel_hda_mlink iwlmvm irqbypass soundwire_cadence crct10dif_pclmul snd_sof_intel_hda polyval_clmulni snd_sof_pci polyval_generic snd                                                                            _sof_xtensa_dsp ghash_clmulni_intel snd_sof sha256_ssse3 sha1_ssse3 snd_sof_utils mac80211 aesni_intel snd_soc_hdac_hda crypto_simd cryptd snd_hda_ext_core libarc4 snd_soc_acpi_intel_match snd_soc_acpi soundwire_generic_allocation soundwire_bus rapl i915 snd_soc_core snd_compress ac97_bus snd_pcm_dmaengine snd_hda_intel
[30540.742245]  snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core snd_hwdep mei_pxp mei_hdcp snd_pcm drm_buddy ttm cmdlinepart iwlwifi spi_nor drm_display_helper snd_timer intel_cstate cfg80211 pcspkr cec snd ucsi_acpi mtd wmi_bmof mei_me typec_ucsi soundcore ee1004 rc_core mei i2c_algo_bit typec intel_pmc_core igen6_edac intel_vsec pmt                                                                            _telemetry pmt_class input_leds acpi_pad acpi_tad joydev mac_hid zfs(PO) spl(O) vhost_net vhost vhost_iotlb tap efi_pstore dmi_sysfs ip_tables x_tables autofs4 btrfs blake2b_generic xor raid6_pq hid_generic usbkbd usbhid hid dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c xhci_pci intel_lpss_pci nvme xhci_pci_renesas intel_lpss spi_                                                                            intel_pci crc32_pclmul igc thunderbolt nvme_core ahci i2c_i801 xhci_hcd i2c_smbus libahci spi_intel idma64 nvme_auth video wmi pinctrl_tigerlake
[30540.742290] CR2: 0000000000000001
[30540.742291] ---[ end trace 0000000000000000 ]---
[30542.129599] RIP: 0010:metaslab_free_concrete+0x4c/0x290 [zfs]
[30543.525217] RIP: 0010:metaslab_free_concrete+0x4c/0x290 [zfs]
[30543.525574] Code: 48 8b 47 68 48 8b 8f 88 2b 00 00 48 89 45 d0 48 83 f9 3f 0f 87 9f 4f 18 00 49 8b 87 a8 2b 00 00 4c 89 e2 48 d3 ea 48 8b 1c d0 <8b> 83 38 01 00 00 85 c0 0f 85 31 01 00 00 4c 8b 8b b8 00 00 00 4d
[30543.530357] Code: 48 8b 47 68 48 8b 8f 88 2b 00 00 48 89 45 d0 48 83 f9 3f 0f 87 9f 4f 18 00 49 8b 87 a8 2b 00 00 4c 89 e2 48 d3 ea 48 8b 1c d0 <8b> 83 38 01 00 00 85 c0 0f 85 31 01 00 00 4c 8b 8b b8 00 00 00 4d
[30543.535341] RSP: 0018:ffffaf9c0439f2a8 EFLAGS: 00010203
[30543.540283] RSP: 0018:ffffaf9c0439f2a8 EFLAGS: 00010203


[30543.561141] RAX: ffff9ae095323000 RBX: 0000000000000000 RCX: 0000000000000022
[30543.566397] RAX: ffff9ae095323000 RBX: 0000000000000000 RCX: 0000000000000022
[30543.571572] RDX: 000000000000400b RSI: 0001002e0e04e800 RDI: ffff9ae08b8d4000
[30543.576731] RDX: 000000000000400b RSI: 0001002e0e04e800 RDI: ffff9ae08b8d4000
[30543.581896] RBP: ffffaf9c0439f2e0 R08: 0000000000000000 R09: 0000000000000000
[30543.587133] RBP: ffffaf9c0439f2e0 R08: 0000000000000000 R09: 0000000000000000
[30543.592355] R10: 0000000000000000 R11: 0000000000000000 R12: 0001002e0e04e800
[30543.597598] R10: 0000000000000000 R11: 0000000000000000 R12: 0001002e0e04e800
[30543.602828] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9ae08b8d4000
[30543.608002] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9ae08b8d4000
[30543.613171] FS:  0000000000000000(0000) GS:ffff9ae420380000(0000) knlGS:0000000000000000
[30543.618332] FS:  0000000000000000(0000) GS:ffff9ae420500000(0000) knlGS:0000000000000000
[30543.623434] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[30543.628560] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[30543.633663] CR2: 0000000000000001 CR3: 000000010ef82005 CR4: 0000000000f70ef0
[30543.638777] CR2: 0000000000000138 CR3: 000000010ef82002 CR4: 0000000000f70ef0
[30543.643874] PKRU: 55555554
[30543.648976] PKRU: 55555554
[30543.653955] note: z_fr_iss_1[185096] exited with irqs disabled
[30543.658770] note: txg_sync[185215] exited with irqs disabled

A downgrade of ZFS with:

apt-get install zfsutils-linux=2.1.12-pve1 zfs-initramfs=2.1.12-pve1 libzpool5linux=2.1.12-pve1 zfs-zed=2.1.12-pve1

didn't work. I get the following error:

root@pve:~# zfs list
zfs: symbol lookup error: zfs: undefined symbol: zfs_commit_all_shares
root@pve:~#
root@pve:~# zpool status
zpool: Symbol `spa_feature_table' has different size in shared object, consider re-linking
zpool: symbol lookup error: zpool: undefined symbol: zfs_commit_all_shares

Can anybody help me?

 

[fiona]

Hi,
I think you'll need to install/boot into an older kernel to downgrade. The packages above are just the userspace tools, there also is a kernel module. It might not even be necessary to downgrade the userspace ZFS tools. Can you check if the issue is also present with kernel 6.5?

 

[TobiT]

I've booted into an older kernel (Linux pve 6.2.16-20-pve That was installed. I hope it's not too old). Now i get the following dmesg:

[   45.592151] block device autoloading is deprecated and will be removed.
[   45.592321] sd 3:0:0:0: [sdb] Attached SCSI disk
[   45.838873] BUG: kernel NULL pointer dereference, address: 0000000000000138
[   45.838906] ================================================================================
[   45.838908] #PF: supervisor read access in kernel mode
[   45.838923] UBSAN: array-index-out-of-bounds in /home/tom/sources/pve/pve-kernel-6.2/proxmox-kernel-6.2.16/modules/pkg-zfs/module/zfs/ddt.c:600:22
[   45.838932] #PF: error_code(0x0000) - not-present page
[   45.838954] index 64 is out of range for type 'ddt_t *[14]'
[   45.838963] PGD 0 P4D 0
[   45.838973] CPU: 7 PID: 1454 Comm: z_fr_iss_0 Tainted: P           O       6.2.16-20-pve #1
[   45.838979] Oops: 0000 [#1] PREEMPT SMP NOPTI
[   45.838993] Hardware name: Intel(R) Client Systems NUC11PAHi7/NUC11PABi7, BIOS PATGL357.0041.2021.0811.1505 08/11/2021
[   45.839003] CPU: 1 PID: 1597 Comm: txg_sync Tainted: P           O       6.2.16-20-pve #1
[   45.839020] Call Trace:
[   45.839032] Hardware name: Intel(R) Client Systems NUC11PAHi7/NUC11PABi7, BIOS PATGL357.0041.2021.0811.1505 08/11/2021
[   45.839039]  <TASK>
[   45.839063]  dump_stack_lvl+0x48/0x70
[   45.839074]  dump_stack+0x10/0x20
[   45.839082]  __ubsan_handle_out_of_bounds+0xc6/0x110
[   45.839094]  ddt_select+0x50/0x60 [zfs]
[   45.839055] RIP: 0010:metaslab_free_concrete+0x4c/0x290 [zfs]
[   45.839184] Code: 48 8b 47 68 48 8b 8f 78 2b 00 00 48 89 45 d0 48 83 f9 3f 0f 87 5c 4b 15 00 49 8b 87 98 2b 00 00 4c 89 e2 48 d3 ea 48 8b 1c d0 <8b> 83 38 01 00 00 85 c0 0f 85 31 01 00 00 4c 8b 8b b8 00 00 00 4d
[   45.839165]  zio_ddt_free+0x27/0x90 [zfs]

And the "zfs list" command doesn't return.

I've installed 6.5 and have still the problem.

 

[fiona]

[   45.838873] BUG: kernel NULL pointer dereference, address: 0000000000000138

Hmm, that's the same address as with the new kernel (I don't think the additional UBSAN warning is the actual issue here). Did you already check your memory via memtest86+ or similar? Can you connect the disks to another system without issues?

 

[TobiT]

There are two USB NVME both are producing the problem. I've checked them with an other System (Ubuntu 20.04) and there i had no problem.
I've changed the RAM and have still the problem. Now I'm running an memtest. The test is at 20% and has no errors until now.

 

[fiona]

There are two USB NVME both are producing the problem. I've checked them with an other System (Ubuntu 20.04) and there i had no problem.

What kernel/ZFS version did that system use?

 

[TobiT]

tobias@thor:~$ zfs version
zfs-0.8.3-1ubuntu12.17
zfs-kmod-0.8.3-1ubuntu12.15

tobias@thor:~$ uname -a
Linux thor 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

 

[TobiT]

I gave it a new try in TrueNAS.

Linux version 6.6.20-production+truenas (root@tnsbuilds01.tn.ixsystems.net) (gcc (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Tue Apr 23 01:22:22 UTC 2024

root@truenas[~]# zfs version
zfs-2.1.11-1
zfs-kmod-2.1.11-1

I get the same error.

root@truenas[~]# zpool import -f pool
2024 May 14 06:17:42 truenas BUG: kernel NULL pointer dereference, address: 0000000000000001
2024 May 14 06:17:42 truenas #PF: supervisor write access in kernel mode
2024 May 14 06:17:42 truenas #PF: error_code(0x0002) - not-present page

 

[fiona]

You might want to report the issue to upstream ZFS developers too then: https://github.com/openzfs/zfs/issues/

 

[Nemesiz]

Did you upgraded pool version ?

 

[TobiT]

I didn't upgrade the pool. Maybe proxmox did it on his own?

 

[Nemesiz]

Try to load pool in read-only mode with ZFS 2.2 and check the version.

 

[TobiT]

The hint with read-only was helpfull. I could import the pool. But there is no version.

root@truenas[~]# zpool get version pool
NAME  PROPERTY  VALUE    SOURCE
pool  version   -        default

 

[Nemesiz]

If your `zpool status` report "Some supported and requested features are not enabled on the pool." then your pool is not upgraded.
Or you can check in `zpool history` did upgrade was initialized.
Or you can check in `zpool get all pool` enabled features and compare to documentation what was new in ZFS 2.2

Once I had problem with ZFS in 2.1 version with writes. After importing pool in read-only and copied data I had to rebuild pool.