What is the best file system for RAID1 nvme SSD？

[berlin2123]

I want to using two U.2 pcie Nvme SSD as the fast disk of tens of VMs ( disk Image ) in one PVE host. In order to minimize the risk of “data loss due to disk corruption”, I would like to use raid 1.

Then, what is the best filesystem of raid1?

ZFS with raid1.
or
F2FS on MDRAID with raid1.

I found an article online comparing the performance of zfs vs f2fs. The performance of zfs in that test was pretty poor overall. I wonder if any of the pve users have done the test?

Note: The pve system is installed inside other disks, and those fast Nvme SSD are newly accessed. So, no need to be concerned about the convenience of installing pve's operating system.

 

[Maximiliano]

Hello,

we recommend ZFS for such usecases. While the performance is not the best, it is the best alternative for keeping your data safe if one follows good practices, e.g. using ECC memory, enterprise disks, and not using hardware raid controllers (or at least setting them to HBA mode).

 

[esi_y]

I want to using two U.2 pcie Nvme SSD as the fast disk of tens of VMs ( disk Image ) in one PVE host. In order to minimize the risk of “data loss due to disk corruption”, I would like to use raid 1.

Then, what is the best filesystem of raid1?

ZFS with raid1.
or
F2FS on MDRAID with raid1.

I found an article online comparing the performance of zfs vs f2fs. The performance of zfs in that test was pretty poor overall. I wonder if any of the pve users have done the test?

Note: The pve system is installed inside other disks, and those fast Nvme SSD are newly accessed. So, no need to be concerned about the convenience of installing pve's operating system.

You sound like you can set up your own MDRAID, I would do so, especially with U.2 drives and looking for performance, avoid any copy-on-write filesystem. The only thing to be aware of with PVE in this scenario is:
https://bugzilla.proxmox.com/show_bug.cgi?id=5235

 

[berlin2123]

The only thing to be aware of with PVE in this scenario is:
https://bugzilla.proxmox.com/show_bug.cgi?id=5235

Do you mean setting the cache mode of mdraid to "write-back" or "write-through"?
I checked the docs of mdraid, it seems only raid4/5/6 has that cache options, but not raid1. So, no need set any special for raid1?
such as:

mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/nvme0n1p1 /dev/nvme1n1p1

 

[esi_y]

Do you mean setting the cache mode of mdraid to "write-back" or "write-through"?
I checked the docs of mdraid, it seems only raid4/5/6 has that cache options, but not raid1. So, no need set any special for raid1?
such as:

mdadm --create /dev/md0 --level=1 --raid-devices=2 /dev/nvme0n1p1 /dev/nvme1n1p1

The issue pointed out there specifically concerns VMs, so the settings is for QEMU.

 

[esi_y]

The issue pointed out there specifically concerns VMs, so the settings is for QEMU.

See also: https://pve.proxmox.com/wiki/Performance_Tweaks#Disk_Cache

So do not use "none" (PVE has it as its default) for when your underlying storage is on MDRAID, otherwise nothing wrong with MDRAID mirrors.