Proxmox VE 8.2.2 ZFS problem

[flowbergit]

Hardware XFusion 2258 v7 with AMD Genoa

[   12.229551] Hardware name: XFUSION 2258 V7/BC15MASA, BIOS 1.06.28 11/06/2023
[   12.229783] Call Trace:
[   12.230009]  <TASK>
[   12.230231]  dump_stack_lvl+0x48/0x70
[   12.230453]  dump_stack+0x10/0x20
[   12.230668]  spl_kmem_zalloc+0x11b/0x130 [spl]
[   12.230890]  zstd_init+0x38/0x1f0 [zfs]
[   12.231184]  openzfs_init+0x3f/0xbe0 [zfs]
[   12.231471]  ? __pfx_openzfs_init+0x10/0x10 [zfs]
[   12.231758]  do_one_initcall+0x5b/0x340
[   12.231967]  do_init_module+0x97/0x290
[   12.232171]  load_module+0x213a/0x22a0
[   12.232377]  init_module_from_file+0x96/0x100
[   12.232574]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.232774]  ? init_module_from_file+0x96/0x100
[   12.232969]  ? vma_set_page_prot+0x69/0xc0
[   12.233166]  idempotent_init_module+0x11c/0x2b0
[   12.233361]  __x64_sys_finit_module+0x64/0xd0
[   12.233551]  x64_sys_call+0x169c/0x24b0
[   12.233739]  do_syscall_64+0x81/0x170
[   12.233931]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.234122]  ? ksys_mmap_pgoff+0x120/0x240
[   12.234314]  ? do_syscall_64+0x8d/0x170
[   12.234502]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.234691]  ? syscall_exit_to_user_mode+0x86/0x260
[   12.234879]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.235064]  ? do_syscall_64+0x8d/0x170
[   12.235248]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.235433]  ? exc_page_fault+0x94/0x1b0
[   12.235614]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[   12.235798] RIP: 0033:0x71d3b4a7f719
[   12.235992] Code: 08 89 e8 5b 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b7 06 0d 00 f7 d8 64 89 01 48
[   12.236394] RSP: 002b:00007ffca9b49bd8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[   12.236613] RAX: ffffffffffffffda RBX: 00006253eafaec30 RCX: 000071d3b4a7f719
[   12.236828] RDX: 0000000000000000 RSI: 00006253eafaf160 RDI: 0000000000000004
[   12.237040] RBP: 00006253eafaf160 R08: 0000000000000000 R09: 0000000000000017
[   12.237250] R10: 0000000000000004 R11: 0000000000000246 R12: 0000000000060000
[   12.237459] R13: 0000000000000000 R14: 00006253eafaed60 R15: 0000000000000018
[   12.237670]  </TASK>
[   12.237902] Large kmem_alloc(73728, 0x1000), please file an issue at:
               https://github.com/openzfs/zfs/issues/new
[   12.241934] CPU: 48 PID: 2893 Comm: modprobe Tainted: P           O       6.8.4-3-pve #1
[   12.244952] Hardware name: XFUSION 2258 V7/BC15MASA, BIOS 1.06.28 11/06/2023
[   12.246862] Call Trace:
[   12.249328]  <TASK>
[   12.253328]  dump_stack_lvl+0x48/0x70
[   12.255730]  dump_stack+0x10/0x20
[   12.260305]  spl_kmem_zalloc+0x11b/0x130 [spl]
[   12.264139]  zstd_init+0x61/0x1f0 [zfs]
[   12.267843]  openzfs_init+0x3f/0xbe0 [zfs]
[   12.273301]  ? __pfx_openzfs_init+0x10/0x10 [zfs]
[   12.278054]  do_one_initcall+0x5b/0x340
[   12.282002]  do_init_module+0x97/0x290
[   12.284316]  load_module+0x213a/0x22a0
[   12.288357]  init_module_from_file+0x96/0x100
[   12.291100]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.295665]  ? init_module_from_file+0x96/0x100
[   12.299806]  ? vma_set_page_prot+0x69/0xc0
[   12.303305]  idempotent_init_module+0x11c/0x2b0
[   12.307950]  __x64_sys_finit_module+0x64/0xd0
[   12.311051]  x64_sys_call+0x169c/0x24b0
[   12.315475]  do_syscall_64+0x81/0x170
[   12.318307]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.323303]  ? ksys_mmap_pgoff+0x120/0x240
[   12.326350]  ? do_syscall_64+0x8d/0x170
[   12.331321]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.335084]  ? syscall_exit_to_user_mode+0x86/0x260
[   12.338459]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.343308]  ? do_syscall_64+0x8d/0x170
[   12.344721]  ? srso_alias_return_thunk+0x5/0xfbef5
[   12.349306]  ? exc_page_fault+0x94/0x1b0
[   12.352781]  entry_SYSCALL_64_after_hwframe+0x78/0x80
[   12.355826] RIP: 0033:0x71d3b4a7f719
[   12.360307] Code: 08 89 e8 5b 5d c3 66 2e 0f 1f 84 00 00 00 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d b7 06 0d 00 f7 d8 64 89 01 48
[   12.367318] RSP: 002b:00007ffca9b49bd8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[   12.370500] RAX: ffffffffffffffda RBX: 00006253eafaec30 RCX: 000071d3b4a7f719
[   12.376303] RDX: 0000000000000000 RSI: 00006253eafaf160 RDI: 0000000000000004
[   12.379239] RBP: 00006253eafaf160 R08: 0000000000000000 R09: 0000000000000017
[   12.383089] R10: 0000000000000004 R11: 0000000000000246 R12: 0000000000060000
[   12.388026] R13: 0000000000000000 R14: 00006253eafaed60 R15: 0000000000000018
[   12.391326]  </TASK>
[   13.398157] ZFS: Loaded module v2.2.3-pve2, ZFS pool version 5000, ZFS filesystem version 5

 

[sterzy]

Hey,

this seems related to this issue reported to the ZFS project on GitHub [1]. The issue seems to be that the amount of memory that is allocated depends on the amount of CPU cores. If you have a CPU with many cores (which seems to be the case) the allocation will be “too” big, and this warning is logged.

From what I understand from the discussion over in the GitHub issue, this should be fine to ignore, though.

Do you experience any specific issues when this warning is logged?

[1]: https://github.com/openzfs/zfs/issues/13085

 

[flowbergit]

Host seems works but need more tests, CPU onboard 2x 64Core AMD EPYC 9554, and 1,5TB RAM

 

[sterzy]

Well, unless you experience any other issues, I'd suggest you report this to the folk over at ZFS [1]. They might be interested to know when these allocations happen.

Also note, this message doesn't seem to be related to the amount of memory you have available. It just happens because the allocation meets a threshold that triggers this message.

[1]: https://github.com/openzfs/zfs/issues/new