DELL server with 4 of 8TB SSD on Haresware controller

[UK SPEED]

Hi
I have a Dell server with PERC H745 Controller for 2 x NVMe and 4 x SAS/SATA/SSD SATA Drives
2 of NVMe as software RAID1 ( mirror) and installing the system on them also
4 of 8TB SSD on as RAID 5 with PERC H745

After adding the 4 SSD drives as a RAID 5, I used it and added them as ZFS storage ( 24TB )
But I'm getting very high load on one of the VM on this ZFS storage using normal Almalinx 9 with Cpanel

Does using the ZFS after the hardware raid controller, wrong?

 

[leesteken]

Does using the ZFS after the hardware raid controller, wrong?

The manual ( https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_hardware_2 ) warns against it:

Do not use ZFS on top of a hardware RAID controller which has its own cache management. ZFS needs to communicate directly with the disks. An HBA adapter or something like an LSI controller flashed in “IT” mode is more appropriate.

EDIT: The installer section also mentions: ZFS on top of any hardware RAID is not supported and can result in data loss.

 

[UK SPEED]

So, what other options can I use in this case, Ext4 or LVM?

Also, I have noticed there is high load even from the Cloudlinx panel, and I don't know if that is from the websites on the server or from the misconfiguration on the storage part ..

 

[leesteken]

So, what other options can I use in this case, Ext4 or LVM?

For directory storage you can probably use any filesystem supported by Linux. LVM or LVM-Thin is also an option: https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_storage_types (BTRFS probably has similar issues as ZFS on hardware RAID).