HPE MR416i-o & HPE MR408i-o Gen11/10

P

Patrik_V

New Member
Proxmox Subscriber
Aug 10, 2026
11
0
1
Hi Team,

I’d like to ask which kernel version after 6.18 works reliably with the HPE MR416i-o and HPE MR408i-o (different firmware versions almost always behave the same way).

I have several ProLiant DL380 Gen11 and Gen10 servers... I use the Enterprise repository on critical infrastructure.

I’ve observed the same behavior on multiple servers. If Proxmox is installed directly on a disk running via RAID on an HPE MR416i-o or HPE MR408i-o using ZFS Raidz2, a critical kernel write failure occurs during an update—the write freezes and the data is not written. The partition switches to read-only mode and requires repair. Version 6.18 works perfectly fine (which is why I kept it via PIN), but various versions of Kernel 7 suffer from the same problem, which can result in a server that won’t boot. This is solely a partition-related issue with the kernel. Other partitions (formatted differently) do not have this problem. If I install the system on an HPE NS204i Gen11 Boot Controller, the problem disappears.

------------------------------------------- DE --------------------------------
Hallo Team,

ich würde gerne wissen, auf welchem Kernel ab Version 6.18 die Modelle HPE MR416i-o und HPE MR408i-o zuverlässig laufen (verschiedene Firmware-Versionen zeigen fast immer das gleiche Verhalten).

Ich habe mehrere ProLiant DL380 Gen11- und Gen10-Server … In der kritischen Infrastruktur verwende ich das Enterprise-Repository.

Auf mehreren Servern habe ich das gleiche Verhalten beobachtet. Wenn Proxmox direkt auf einer Festplatte installiert ist, die über ein RAID mit HPE416i-o oder HPE MR408i-o unter ZFS Raidz2 läuft, kommt es zu einem kritischen Fehler beim Schreiben des Kernels während eines Updates – der Schreibvorgang friert ein und die Daten werden nicht geschrieben. Die Partition wechselt in den schreibgeschützten Modus und muss repariert werden. Version 6.18 funktioniert einwandfrei (deshalb habe ich sie per PIN beibehalten), aber verschiedene Versionen von Kernel 7 leiden unter demselben Problem, das dazu führen kann, dass der Server nicht mehr bootet. Es handelt sich ausschließlich um ein Problem zwischen der Partition und dem Kernel. Andere (anders formatierte Partitionen) haben kein Problem. Wenn ich das System auf einem HPE NS204i Gen11 Boot-Controller installiere, verschwindet das Problem.
 
Hi @Patrik_V

thank you for posting on the forum!
Patrik_V said:
If Proxmox is installed directly on a disk running via RAID on an HPE MR416i-o or HPE MR408i-o using ZFS Raidz2
Click to expand...
This will probably never work since ZFS is not designed to work with hardware RAID controllers, see [1].
If the MRs are running in HBA mode it should be fine, but RAID mode is not supported.

Patrik_V said:
a critical kernel write failure occurs during an update—the write freezes and the data is not written. The partition switches to read-only mode and requires repair. Version 6.18 works perfectly fine (which is why I kept it via PIN), but various versions of Kernel 7 suffer from the same problem, which can result in a server that won’t boot
Click to expand...
Can you post the exact error messages from the journal for these write failures?

What kind of disks are connected to the controllers?

Best regards
Jonas

[1] https://pve.proxmox.com/wiki/ZFS_on_Linux#:~:text=…-,Hardware
 
Hi Jonas

That RAID controller is always in JBOD mode - so Proxmox has direct control over those disks. I just phrased it wrong; by “RAID,” I meant the RAID controller—that is, the hardware—not the mode.

I don’t actually have the terminal output. I’ll describe it simply: ... Basically, as soon as the kernel is writing during an update, it usually just gets stuck on the 2nd or 3rd disk and stays there... It doesn’t log anything else… not even an error after a long time… and a reboot is necessary. I once saw in `dmesg` that it simply disconnects that disk while writing to VFAT.
 
Last edited:
I found that old Log


Code: 
root@berdaepve042:~# ps aux | grep -E "zz-proxmox-boot|cp /boot|update-initramfs" | grep -v grep
dmesg -T | tail -40
zpool status -v
root        6319  0.0  0.0   2680  1968 pts/1    S+   09:51   0:00 /bin/sh /etc/kernel/postrm.d/zz-proxmox-boot 6.8.12-10-pve /boot/vmlinuz-6.8.12-10-pve
root        6321  0.0  0.0   2680  1960 pts/1    S+   09:51   0:00 /bin/sh /etc/kernel/postrm.d/zz-proxmox-boot
root        6364  0.0  0.0   2680  1096 pts/1    S+   09:51   0:00 /bin/sh /etc/kernel/postrm.d/zz-proxmox-boot
[Fri Jul 17 09:56:32 2026] CR2: ff7ff5ac80abe000
[Fri Jul 17 09:56:32 2026] ---[ end trace 0000000000000000 ]---
[Fri Jul 17 09:56:32 2026] RIP: 0010:megasas_build_and_issue_cmd_fusion+0xe88/0x1850 [megaraid_sas]
[Fri Jul 17 09:56:32 2026] Code: 20 48 89 d1 48 83 e1 fc 83 e2 01 48 0f 45 d9 4c 8b 73 10 44 8b 6b 18 4c 89 f9 4c 8d 79 08 45 85 fa 0f 84 fd 03 00 00 45 29 cc <4c> 89 31 48 83 c0 08 41 83 c0 01 45 29 cd 45 85 e4 7f ab 44 89 c0
[Fri Jul 17 09:56:32 2026] RSP: 0018:ff7ff5ac800c72f8 EFLAGS: 00010206
[Fri Jul 17 09:56:32 2026] RAX: 00000000fe9e7000 RBX: ff307b1c028d3948 RCX: ff7ff5ac80b0e000
[Fri Jul 17 09:56:32 2026] RDX: ff7ff5ac80b0e008 RSI: ff307b1c028d3810 RDI: 0000000000000000
[Fri Jul 17 09:56:32 2026] RBP: ff7ff5ac800c73c8 R08: 0000000000000200 R09: 0000000000001000
[Fri Jul 17 09:56:32 2026] R10: 0000000000000fff R11: 0000000000001000 R12: 00000000001ff000
[Fri Jul 17 09:56:32 2026] R13: 0000000000200000 R14: 00000000e1200000 R15: ff7ff5ac80b0e008
[Fri Jul 17 09:56:32 2026] FS:  0000000000000000(0000) GS:ff307b7a01c0e000(0000) knlGS:0000000000000000
[Fri Jul 17 09:56:32 2026] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Jul 17 09:56:32 2026] CR2: ff7ff5ac80abe000 CR3: 00000047ec23e006 CR4: 0000000000f73ef0
[Fri Jul 17 09:56:32 2026] PKRU: 55555554
[Fri Jul 17 09:56:32 2026] note: z_wr_iss_0[1821] exited with irqs disabled
[Fri Jul 17 09:56:32 2026] ------------[ cut here ]------------
[Fri Jul 17 09:56:32 2026] WARNING: kernel/exit.c:904 at do_exit+0x87d/0xb00, CPU#6: z_wr_iss_0/1821
[Fri Jul 17 09:56:32 2026] Modules linked in: tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter nf_tables 8021q garp mrp sunrpc softdog bonding tls binfmt_misc nfnetlink_log intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_ifs skx_edac_common nfit x86_pkg_temp_thermal intel_powerclamp coretemp ipmi_ssif kvm_intel pmt_telemetry pmt_discovery pmt_class kvm intel_sdsi dax_hmem cxl_acpi cxl_port cxl_pmem irqbypass ghash_clmulni_intel aesni_intel cxl_core isst_if_mbox_pci isst_if_mmio cmdlinepart rapl fwctl intel_cstate ses einj pcspkr spi_nor mei_me enclosure acpi_power_meter isst_if_common iaa_crypto intel_vsec mgag200 scsi_transport_sas mei mtd ipmi_si acpi_ipmi hpilo i2c_algo_bit ipmi_devintf acpi_tad ipmi_msghandler input_leds joydev mac_hid sch_fq_codel vhost_net vhost vhost_iotlb tap efi_pstore nfnetlink dmi_sysfs ip_tables x_tables autofs4 zfs(PO) spl(O) btrfs libblake2b xor raid6_pq hid_generic usbmouse usbkbd usbhid hid
[Fri Jul 17 09:56:32 2026]  ixgbe xhci_pci libie_fwlog xfrm_algo idxd mdio ehci_pci spi_intel_pci bnxt_en megaraid_sas idxd_bus xhci_hcd tg3 dca ehci_hcd spi_intel wmi
[Fri Jul 17 09:56:32 2026] CPU: 6 UID: 0 PID: 1821 Comm: z_wr_iss_0 Tainted: P S    D W  O        7.0.14-4-pve #1 PREEMPT(lazy)
[Fri Jul 17 09:56:32 2026] Tainted: [P]=PROPRIETARY_MODULE, [S]=CPU_OUT_OF_SPEC, [D]=DIE, [W]=WARN, [O]=OOT_MODULE
[Fri Jul 17 09:56:32 2026] Hardware name: HPE ProLiant DL380 Gen11/ProLiant DL380 Gen11, BIOS 2.84 04/02/2026
[Fri Jul 17 09:56:32 2026] RIP: 0010:do_exit+0x87d/0xb00
[Fri Jul 17 09:56:32 2026] Code: fd ff ff 48 8b bb 30 0b 00 00 31 f6 e8 8c e1 ff ff e9 ae fd ff ff 48 89 df e8 af 65 17 00 e9 4b f9 ff ff 0f 0b e9 bf f7 ff ff <0f> 0b e9 c6 f7 ff ff 48 8d 55 c0 b9 04 00 00 00 31 c0 48 89 d7 f3
[Fri Jul 17 09:56:32 2026] RSP: 0018:ff7ff5ac85717ec0 EFLAGS: 00010282
[Fri Jul 17 09:56:32 2026] RAX: 0000000000000286 RBX: ff307b1c3a3a0000 RCX: 0000000000000000
[Fri Jul 17 09:56:32 2026] RDX: 000000000000270f RSI: 0000000000002710 RDI: 0000000000000009
[Fri Jul 17 09:56:32 2026] RBP: ff7ff5ac85717f10 R08: 0000000000000000 R09: 0000000000000000
[Fri Jul 17 09:56:32 2026] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000009
[Fri Jul 17 09:56:32 2026] R13: 0000000000000001 R14: ff307b1c3a3a0000 R15: 0000000000000000
[Fri Jul 17 09:56:32 2026] FS:  0000000000000000(0000) GS:ff307b7a00c0e000(0000) knlGS:0000000000000000
[Fri Jul 17 09:56:32 2026] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Jul 17 09:56:32 2026] CR2: 00007c8868000020 CR3: 00000047ec23e002 CR4: 0000000000f73ef0
[Fri Jul 17 09:56:32 2026] PKRU: 55555554
[Fri Jul 17 09:56:32 2026] Call Trace:
[Fri Jul 17 09:56:32 2026]  <TASK>
[Fri Jul 17 09:56:32 2026]  make_task_dead+0x93/0xa0
[Fri Jul 17 09:56:32 2026]  rewind_stack_and_make_dead+0x16/0x20
[Fri Jul 17 09:56:32 2026]  </TASK>
[Fri Jul 17 09:56:32 2026] ---[ end trace 0000000000000000 ]---
  pool: rpool
 state: ONLINE
status: Some supported and requested features are not enabled on the pool.
        The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0B in 01:08:19 with 0 errors on Sun Jul 12 01:32:20 2026
config:
 
Code: 
root@berdaepve042:~# dmesg -T | tail -20
[Fri Jul 17 10:15:21 2026]  ? __pfx_kthread+0x10/0x10
[Fri Jul 17 10:15:21 2026]  ret_from_fork_asm+0x1a/0x30
[Fri Jul 17 10:15:21 2026]  </TASK>
[Fri Jul 17 10:15:21 2026] Modules linked in: tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter nf_tables 8021q garp mrp softdog sunrpc binfmt_misc bonding tls nfnetlink_log intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_ifs skx_edac_common nfit x86_pkg_temp_thermal intel_powerclamp coretemp ipmi_ssif kvm_intel kvm dax_hmem cxl_acpi pmt_telemetry cxl_port pmt_discovery cxl_pmem irqbypass intel_sdsi pmt_class ghash_clmulni_intel cxl_core aesni_intel rapl fwctl isst_if_mbox_pci isst_if_mmio cmdlinepart intel_cstate ses einj pcspkr acpi_power_meter mei_me spi_nor enclosure iaa_crypto isst_if_common mgag200 intel_vsec ipmi_si acpi_ipmi scsi_transport_sas mtd mei hpilo i2c_algo_bit ipmi_devintf acpi_tad ipmi_msghandler joydev input_leds mac_hid sch_fq_codel vhost_net vhost vhost_iotlb tap efi_pstore nfnetlink dmi_sysfs ip_tables x_tables autofs4 zfs(PO) spl(O) btrfs libblake2b xor raid6_pq hid_generic usbmouse usbkbd usbhid hid
[Fri Jul 17 10:15:21 2026]  ixgbe xhci_pci libie_fwlog idxd xfrm_algo ehci_pci spi_intel_pci mdio bnxt_en megaraid_sas idxd_bus xhci_hcd tg3 dca ehci_hcd spi_intel wmi
[Fri Jul 17 10:15:21 2026] CR2: ff7bfa0444e05000
[Fri Jul 17 10:15:21 2026] ---[ end trace 0000000000000000 ]---
[Fri Jul 17 10:15:22 2026] RIP: 0010:megasas_build_and_issue_cmd_fusion+0xe88/0x1850 [megaraid_sas]
[Fri Jul 17 10:15:22 2026] Code: 20 48 89 d1 48 83 e1 fc 83 e2 01 48 0f 45 d9 4c 8b 73 10 44 8b 6b 18 4c 89 f9 4c 8d 79 08 45 85 fa 0f 84 fd 03 00 00 45 29 cc <4c> 89 31 48 83 c0 08 41 83 c0 01 45 29 cd 45 85 e4 7f ab 44 89 c0
[Fri Jul 17 10:15:22 2026] RSP: 0018:ff7bfa0445ce72f8 EFLAGS: 00010206
[Fri Jul 17 10:15:22 2026] RAX: 00000000fda44000 RBX: ff3fa43901f45d08 RCX: ff7bfa0444e5f000
[Fri Jul 17 10:15:22 2026] RDX: ff7bfa0444e5f008 RSI: ff3fa43901f45bd0 RDI: 0000000000000000
[Fri Jul 17 10:15:22 2026] RBP: ff7bfa0445ce73c8 R08: 0000000000000200 R09: 0000000000001000
[Fri Jul 17 10:15:22 2026] R10: 0000000000000fff R11: 0000000000001000 R12: 0000000000001000
[Fri Jul 17 10:15:22 2026] R13: 0000000000002000 R14: 000000009b600000 R15: ff7bfa0444e5f008
[Fri Jul 17 10:15:22 2026] FS:  0000000000000000(0000) GS:ff3fa4971b58e000(0000) knlGS:0000000000000000
[Fri Jul 17 10:15:22 2026] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Jul 17 10:15:22 2026] CR2: ff7bfa0444e05000 CR3: 000000420d83e005 CR4: 0000000000f73ef0
[Fri Jul 17 10:15:22 2026] PKRU: 55555554
[Fri Jul 17 10:15:22 2026] note: kworker/5:1H[3655] exited with irqs disabled
root@berdaepve042:~#
 
Code: 
root@berdaepve041:~# dmesg -T | tail -30
[Fri Jul 17 13:11:37 2026] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Jul 17 13:11:37 2026] CR2: ff4443b3443ec000 CR3: 0000000ae8c3e006 CR4: 0000000000f73ef0
[Fri Jul 17 13:11:37 2026] PKRU: 55555554
[Fri Jul 17 13:11:37 2026] note: kworker/u256:3[178957] exited with irqs disabled
[Fri Jul 17 13:11:37 2026] ------------[ cut here ]------------
[Fri Jul 17 13:11:37 2026] WARNING: kernel/exit.c:904 at do_exit+0x87d/0xb00, CPU#39: kworker/u256:3/178957
[Fri Jul 17 13:11:37 2026] Modules linked in: tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter nf_tables 8021q garp mrp softdog sunrpc binfmt_misc bonding tls nfnetlink_log intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_ifs skx_edac_common nfit x86_pkg_temp_thermal intel_powerclamp coretemp ipmi_ssif kvm_intel kvm dax_hmem cxl_acpi cxl_port pmt_telemetry cxl_pmem pmt_discovery irqbypass pmt_class intel_sdsi isst_if_mbox_pci isst_if_mmio ghash_clmulni_intel cxl_core cmdlinepart aesni_intel rapl fwctl ses intel_cstate acpi_power_meter einj pcspkr spi_nor mei_me enclosure mgag200 iaa_crypto isst_if_common intel_vsec ipmi_si acpi_ipmi scsi_transport_sas mtd mei i2c_algo_bit hpilo ipmi_devintf acpi_tad ipmi_msghandler joydev input_leds mac_hid sch_fq_codel vhost_net vhost vhost_iotlb tap efi_pstore nfnetlink dmi_sysfs ip_tables x_tables autofs4 zfs(PO) spl(O) btrfs libblake2b xor raid6_pq hid_generic usbmouse usbkbd usbhid hid
[Fri Jul 17 13:11:37 2026]  ixgbe xhci_pci libie_fwlog xfrm_algo idxd ehci_pci spi_intel_pci mdio bnxt_en megaraid_sas idxd_bus xhci_hcd tg3 dca ehci_hcd spi_intel wmi
[Fri Jul 17 13:11:37 2026] CPU: 39 UID: 0 PID: 178957 Comm: kworker/u256:3 Tainted: P S    D    O        7.0.14-4-pve #1 PREEMPT(lazy)
[Fri Jul 17 13:11:37 2026] Tainted: [P]=PROPRIETARY_MODULE, [S]=CPU_OUT_OF_SPEC, [D]=DIE, [O]=OOT_MODULE
[Fri Jul 17 13:11:37 2026] Hardware name: HPE ProLiant DL380 Gen11/ProLiant DL380 Gen11, BIOS 2.84 04/02/2026
[Fri Jul 17 13:11:37 2026] Workqueue: writeback wb_workfn (flush-8:0)
[Fri Jul 17 13:11:37 2026] RIP: 0010:do_exit+0x87d/0xb00
[Fri Jul 17 13:11:37 2026] Code: fd ff ff 48 8b bb 30 0b 00 00 31 f6 e8 8c e1 ff ff e9 ae fd ff ff 48 89 df e8 af 65 17 00 e9 4b f9 ff ff 0f 0b e9 bf f7 ff ff <0f> 0b e9 c6 f7 ff ff 48 8d 55 c0 b9 04 00 00 00 31 c0 48 89 d7 f3
[Fri Jul 17 13:11:37 2026] RSP: 0018:ff4443b3dbfd3ec0 EFLAGS: 00010282
[Fri Jul 17 13:11:37 2026] RAX: 0000000000000286 RBX: ff2f0e37036a8000 RCX: 0000000000000000
[Fri Jul 17 13:11:37 2026] RDX: 000000000000270f RSI: 0000000000002710 RDI: 0000000000000009
[Fri Jul 17 13:11:37 2026] RBP: ff4443b3dbfd3f10 R08: 0000000000000000 R09: 0000000000000000
[Fri Jul 17 13:11:37 2026] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000009
[Fri Jul 17 13:11:37 2026] R13: 0000000000000001 R14: ff2f0e37036a8000 R15: 0000000000000000
[Fri Jul 17 13:11:37 2026] FS:  0000000000000000(0000) GS:ff2f0e957628e000(0000) knlGS:0000000000000000
[Fri Jul 17 13:11:37 2026] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[Fri Jul 17 13:11:37 2026] CR2: ff4443b3443ec000 CR3: 0000000ae8c3e006 CR4: 0000000000f73ef0
[Fri Jul 17 13:11:37 2026] PKRU: 55555554
[Fri Jul 17 13:11:37 2026] Call Trace:
[Fri Jul 17 13:11:37 2026]  <TASK>
[Fri Jul 17 13:11:37 2026]  make_task_dead+0x93/0xa0
[Fri Jul 17 13:11:37 2026]  rewind_stack_and_make_dead+0x16/0x20
[Fri Jul 17 13:11:37 2026]  </TASK>
[Fri Jul 17 13:11:37 2026] ---[ end trace 0000000000000000 ]---
 
Had exactly the same issues with some HPE DL380 Gen 11 and MR-416i-o, never figured out how to address this issue.

Put MRs from JBOD to RAID and set up the RAID.
Use the RAID-Volume for "ZFS single disk".
ZFS sees the MR RAID as a physical disk .

Yes, this is not supported but it's working great since day one.
 
This is probably a problem with the megasas driver, but to begin with, no one ever said there would be no issues using Megaraid as a JBOD.

If firmware for IT mode were available and mpt3sas could be used, there probably wouldn’t be a problem, but that doesn’t seem likely to happen either.

Of course, just because it’s an MR doesn’t mean I’m saying your choice was wrong. However, based on what’s written in the zfs_on_linux wiki I mentioned earlier, I don’t think they’ll go out of their way to fix this issue.

Controllers such as the 9500-16i, which use mpt3sas, are working without any issues.
 
Thanks @Patrik_V for providing the outputs!
There were similar issues with the megaraid_sas driver on kernel 6.17 but they were reported to be fixed for most users with kernel 7

What kind of drives are connected to your controller?

Do you have a reproducer for these failures or do they occur randomly?

Best regards
Jonas
 
Hi Jonas


What types of drives are connected to your controller?

We use original HP drives, such as the 3.20TB 32.0G NVMe SSD.

Can these failures be reproduced in any way, or do they occur randomly?
The problem occurs almost every time on the 2nd or 3rd drive when writing the kernel. However, I cannot reproduce the problem because this is critical infrastructure where I cannot experiment.

For this reason, I also created a support ticket with HPE Support: "HPE MR416i-o & HPEMR408i-o Gen11/10 - JBOD - megaraid_sas driver Critical BUG when writing to VFAT partitions Debian/Ubuntu." I intentionally specified Debian/Ubuntu because they are listed as supported systems.
 
Could you maybe run the following command on the affected server?
Code: 
lsblk --ascii -M -o +HOTPLUG,ROTA,PHY-SEC,FSTYPE,MODEL,TRAN,WWN | grep nvme

It will give us some additional information on the used drives since HPE just sells SSDs from different vendors under their own name.

Patrik_V said:
For this reason, I also created a support ticket with HPE Support: "HPE MR416i-o & HPEMR408i-o Gen11/10 - JBOD - megaraid_sas driver Critical BUG when writing to VFAT partitions Debian/Ubuntu." I intentionally specified Debian/Ubuntu because they are listed as supported systems.
Click to expand...
Please keep us posted if something comes up there.
Although i have to warn you, since PVE uses a modified version of the Ubuntu Kernel, HPE might be a little uncooperative as long as the issue is not reproducible on an unpatched kernel.

Best regards
Jonas
 
Code: 
root@berdaepve042:~# lsblk --ascii -M -o +HOTPLUG,ROTA,PHY-SEC,FSTYPE,MODEL,TRAN,WWN | grep nvme
root@berdaepve042:~# lsblk --ascii -o NAME,MODEL,VENDOR,TRAN,ROTA,PHY-SEC,FSTYPE,SERIAL,WWN,SIZE
NAME       MODEL         VENDOR   TRAN ROTA PHY-SEC FSTYPE     SERIAL       WWN   SIZE
sda        MO003200KXPAA NVMe             0     512            24264A3170D4       2.9T
|-sda1                                    0     512                              1007K
|-sda2                                    0     512 vfat                            1G
`-sda3                                    0     512 zfs_member                    2.9T
sdb        MO003200KXPAA NVMe             0     512            24264A316E82       2.9T
|-sdb1                                    0     512                              1007K
|-sdb2                                    0     512 vfat                            1G
`-sdb3                                    0     512 zfs_member                    2.9T
sdc        MO003200KXPAA NVMe             0     512            24264A3170D2       2.9T
|-sdc1                                    0     512                              1007K
|-sdc2                                    0     512 vfat                            1G
`-sdc3                                    0     512 zfs_member                    2.9T
sdd        MO003200KXPAA NVMe             0     512            24264A317089       2.9T
|-sdd1                                    0     512                              1007K
|-sdd2                                    0     512 vfat                            1G
`-sdd3                                    0     512 zfs_member                    2.9T
sde        MO003200KXPAA NVMe             0     512            24264A3170EE       2.9T
|-sde1                                    0     512                              1007K
|-sde2                                    0     512 vfat                            1G
`-sde3                                    0     512 zfs_member                    2.9T
zd0                                       0   16384                               200G
|-zd0p1                                   0   16384 ntfs                          499M
|-zd0p2                                   0   16384 vfat                           99M
|-zd0p3                                   0   16384                              15.8M
|-zd0p4                                   0   16384 ntfs                        199.4G
`-zd0p5                                   0   16384                               256K
zd16                                      0   16384                             161.1G
|-zd16p1                                  0   16384 ntfs                          375M
|-zd16p2                                  0   16384 ntfs                          150G
`-zd16p3                                  0   16384 ntfs                         10.7G
zd32                                      0   16384                               130G
|-zd32p1                                  0   16384 vfat                          100M
|-zd32p2                                  0   16384                                16M
|-zd32p3                                  0   16384 ntfs                        129.1G
`-zd32p4                                  0   16384 ntfs                          782M
zd48                                      0   16384                                 1M
zd64                                      0   16384                               150G
|-zd64p1                                  0   16384 ext4                          149G
|-zd64p2                                  0   16384                                 1K
`-zd64p5                                  0   16384 swap                          975M
zd80                                      0   16384                               150G
zd96                                      0   16384                                 4M
zd112                                     0   16384                              32.5G
zd128                                     0   16384                                 4M
zd144                                     0   16384                                 4M
zd160                                     0   16384                                 1M
zd176                                     0   16384                              32.5G
zd192                                     0   16384                                80G
`-zd192p1                                 0   16384 ntfs                           80G
zd208                                     0   16384                                 1M
zd224                                     0   16384                               150G
zd240                                     0   16384                               300G
|-zd240p1                                 0   16384                              15.7M
|-zd240p2                                 0   16384 ntfs                          250G
`-zd240p3                                 0   16384                               256K
zd256                                     0   16384                                50G
`-zd256p1                                 0   16384 ntfs                           50G
zd272                                     0   16384                                40G
|-zd272p1                                 0   16384 ntfs                          350M
`-zd272p2                                 0   16384 ntfs                         39.7G
zd288                                     0   16384                               100G
|-zd288p1                                 0   16384 vfat                          100M
|-zd288p2                                 0   16384                                16M
|-zd288p3                                 0   16384 ntfs                         99.2G
`-zd288p4                                 0   16384 ntfs                          696M
zd304                                     0   16384                                 1M
zd320                                     0   16384                                50G
|-zd320p1                                 0   16384                                16M
`-zd320p2                                 0   16384 ntfs                           50G
zd336                                     0   16384                                50G
`-zd336p1                                 0   16384 ntfs                           50G
zd352                                     0   16384                                 1M
zd368                                     0   16384                               100G
|-zd368p1                                 0   16384 vfat                          100M
|-zd368p2                                 0   16384                                16M
|-zd368p3                                 0   16384 BitLocker                    99.2G
`-zd368p4                                 0   16384 ntfs                          664M
zd384                                     0   16384                               300G
|-zd384p1                                 0   16384                                16M
`-zd384p2                                 0   16384 ntfs                          300G
zd400                                     0   16384                                 1M
zd416                                     0   16384                                 1M
zd432                                     0   16384                               150G
|-zd432p1                                 0   16384 vfat                          100M
|-zd432p2                                 0   16384                                16M
|-zd432p3                                 0   16384 ntfs                        149.4G
`-zd432p4                                 0   16384 ntfs                          510M
zd448                                     0   16384                               8.5G
zd464                                     0   16384                               150G
zd480                                     0   16384                               100G
|-zd480p1                                 0   16384 vfat                          100M
|-zd480p2                                 0   16384                                16M
|-zd480p3                                 0   16384 BitLocker                    99.2G
`-zd480p4                                 0   16384 ntfs                          664M
zd512                                     0   16384                                 1M
zd528                                     0   16384                               170G
`-zd528p1                                 0   16384 ntfs                          170G
zd544                                     0   16384                               100G
|-zd544p1                                 0   16384 ntfs                          500M
`-zd544p2                                 0   16384 ntfs                         99.5G
zd560                                     0   16384                                 1M
zd576                                     0   16384                               200G
|-zd576p1                                 0   16384 vfat                          100M
|-zd576p2                                 0   16384                              15.8M
|-zd576p3                                 0   16384 ntfs                        199.4G
|-zd576p4                                 0   16384 ntfs                          510M
`-zd576p5                                 0   16384                               256K
zd592                                     0   16384                               150G
zd608                                     0   16384                                 4M
zd624                                     0   16384                                 1M
zd640                                     0   16384                               150G
zd656                                     0   16384                               150G
|-zd656p1                                 0   16384 vfat                          100M
|-zd656p2                                 0   16384                                16M
|-zd656p3                                 0   16384 ntfs                          149G
`-zd656p4                                 0   16384 ntfs                          855M
zd672                                     0   16384                               100G
|-zd672p1                                 0   16384 ntfs                          500M
`-zd672p2                                 0   16384 ntfs                         99.5G
zd688                                     0   16384                                 1M
zd704                                     0   16384                                40G
`-zd704p1                                 0   16384 ntfs                           40G
zd720                                     0   16384                                80G
|-zd720p1                                 0   16384 ntfs                          350M
|-zd720p2                                 0   16384 ntfs                         79.1G
`-zd720p3                                 0   16384 ntfs                          585M
zd752                                     0   16384                               150G
zd768                                     0   16384                                 1M
zd784                                     0   16384                               100G
|-zd784p1                                 0   16384 vfat                          100M
|-zd784p2                                 0   16384                              15.8M
|-zd784p3                                 0   16384 ntfs                         99.4G
|-zd784p4                                 0   16384 ntfs                          510M
`-zd784p5                                 0   16384                               256K
zd800                                     0   16384                                 1M
zd816                                     0   16384                                 1M
zd832                                     0   16384                                 4M
zd848                                     0   16384                               3.4T
|-zd848p1                                 0   16384                                16M
`-zd848p2                                 0   16384 ntfs                          3.4T
zd864                                     0   16384                                 1M
zd880                                     0   16384                               150G
zd896                                     0   16384                                24G
|-zd896p1                                 0   16384 ext4                           23G
|-zd896p2                                 0   16384                                 1K
`-zd896p5                                 0   16384 swap                          975M
zd912                                     0   16384                               200G
|-zd912p1                                 0   16384 ntfs                          549M
`-zd912p2                                 0   16384 ntfs                        199.5G
zd928                                     0   16384                                 1M
zd944                                     0   16384                               100G
|-zd944p1                                 0   16384 vfat                          100M
|-zd944p2                                 0   16384                              15.8M
|-zd944p3                                 0   16384 ntfs                         99.4G
|-zd944p4                                 0   16384 ntfs                          510M
`-zd944p5                                 0   16384                               256K
zd960                                     0   16384                                 1M
zd976                                     0   16384                                 1M
zd992                                     0   16384                                 1M
zd1008                                    0   16384                              16.5G
zd1024                                    0   16384                                30G
|-zd1024p1                                0   16384                              15.7M
|-zd1024p2                                0   16384 ntfs                           30G
`-zd1024p3                                0   16384                               256K
zd1056                                    0   16384                               2.1T
|-zd1056p1                                0   16384                                16M
`-zd1056p2                                0   16384 ntfs                          2.1T
zd1072                                    0   16384                                 1M
zd1088                                    0   16384                               200G
|-zd1088p1                                0   16384 vfat                          100M
|-zd1088p2                                0   16384                                16M
|-zd1088p3                                0   16384 ntfs                        199.4G
`-zd1088p4                                0   16384 ntfs                          510M
zd1104                                    0   16384                               150G
zd1120                                    0   16384                               150G
zd1136                                    0   16384                               150G
 
Code: 
root@berdaepve042:~# lsblk --ascii -M -o +HOTPLUG,ROTA,PHY-SEC,FSTYPE,MODEL,TRAN,WWN
NAME       MAJ:MIN  RM   SIZE RO TYPE MOUNTPOINTS HOTPLUG ROTA PHY-SEC FSTYPE     MODEL         TRAN WWN
sda          8:0     0   2.9T  0 disk                   0    0     512            MO003200KXPAA    
|-sda1       8:1     0  1007K  0 part                   0    0     512                              
|-sda2       8:2     0     1G  0 part                   0    0     512 vfat                        
`-sda3       8:3     0   2.9T  0 part                   0    0     512 zfs_member                  
sdb          8:16    0   2.9T  0 disk                   0    0     512            MO003200KXPAA    
|-sdb1       8:17    0  1007K  0 part                   0    0     512                              
|-sdb2       8:18    0     1G  0 part                   0    0     512 vfat                        
`-sdb3       8:19    0   2.9T  0 part                   0    0     512 zfs_member                  
sdc          8:32    0   2.9T  0 disk                   0    0     512            MO003200KXPAA    
|-sdc1       8:33    0  1007K  0 part                   0    0     512                              
|-sdc2       8:34    0     1G  0 part                   0    0     512 vfat                        
`-sdc3       8:35    0   2.9T  0 part                   0    0     512 zfs_member                  
sdd          8:48    0   2.9T  0 disk                   0    0     512            MO003200KXPAA    
|-sdd1       8:49    0  1007K  0 part                   0    0     512                              
|-sdd2       8:50    0     1G  0 part                   0    0     512 vfat                        
`-sdd3       8:51    0   2.9T  0 part                   0    0     512 zfs_member                  
sde          8:64    0   2.9T  0 disk                   0    0     512            MO003200KXPAA    
|-sde1       8:65    0  1007K  0 part                   0    0     512                              
|-sde2       8:66    0     1G  0 part                   0    0     512 vfat                        
`-sde3       8:67    0   2.9T  0 part                   0    0     512 zfs_member

+ Zd........ disks


Okay ? Because as you saw - first command 0 results ....
 
Last edited:
Patrik_V said:
Okay ? Because as you saw - first command 0 results ....
Click to expand...
Yes perfect, thank you!

What firmware is currently installed on these drives?
There was a similar case [1] with Micron SSDs which from my understanding of this HPE product number could also be one of your SSDs, where updating the drive firmware fixed the issue.

If your drives are already using the latest version please let me know.

Best regards
Jonas

[1] https://forum.proxmox.com/threads/problem-with-megaraid-sas3508-controller.179378/page-2#post-856670
 
Ok thank you for providing all the info!

There is a known issue which seems to cause this kind of behavior.
The current workaround is a udev rule to limit the request size, referencing [1]
This would require you to create the following file /etc/udev/rules.d/10-megaraid.rules
and paste the following rule into it
Code: 
ACTION=="add|change", SUBSYSTEM=="block", KERNEL=="sd[a-z]", DRIVERS=="megaraid_sas", ATTR{queue/max_sectors_kb}="1280"

I cannot guarantee this will fix the issue and since you already mentioned this is critical infrastructure i would understand if you cannot try this currently.
Still it would be great to know if this fixes the issue.

Best regards
Jonas

[1] https://lore.kernel.org/all/9900ABF6-01C5-4B9B-BEF3-BAB5A18C3F54@intility.no/
 
  • Like
Reactions: waltar
You must log in or register to reply here.
Top Bottom
Back