ZFS: pve7 vs pve8

[siema_proxmox]

I have two very similar hardware configurations. On one host pve7, on the other pve8. zfs storage raid10.
On pve7 host, zfsutils-linux: 2.0.5-pve1, Windows VM. Copying a large file are max. 200MB/s
On pve8 host, zfsutils-linux: 2.1.12-pve1, Windows VM. Copying a large file is up to 800MB/s
It is normal with pve7?

 

[Dunuin]

Most likely because of different disk models and controllers?
You shouldn't see such a big performance jump just because of a newer kernel/ZFS version.

One of the bigger differences is that a newly created pool on PVE8 is using a default volblocksize of 16K instead of 8K when working with zvols.

 

[siema_proxmox]

Most likely because of different disk models and controllers?
You shouldn't see such a big performance jump just because of a newer kernel/ZFS version.

One of the bigger differences is that a newly created pool on PVE8 is using a default volblocksize of 16K instead of 8K when working with zvols.

volblocksize are the same 8K

the slower pve7 ZFS has a slightly faster Samsung Pro nvme and Asus nvme controller
the faster pve8 ZFS has a Silicon Power nvme and an no name nvme controller
Both are on Dell R730

 

[Dunuin]

the slower pve7 ZFS has a slightly faster Samsung Pro nvme and Asus nvme controller
the faster pve8 ZFS has a Silicon Power nvme and an no name nvme controller
Both are on Dell R730

So basically both are using SSDs that aren't recommended to be used with ZFS (bad durability, low cache size and missing power-loss protection). Did you make sure that those Samsung Pros are patched to the latest firmware? They are known to destroy themselves when running with the bugged firmware. Also check if the PCIe/M.2 slots got enough lanes, fast enough lanes and if those lanes are directly connected to the CPU or just to the slow chipset (which might be bottlenecking).

 

[siema_proxmox]

So basically both are using SSDs that aren't recommended to be used with ZFS (bad durability, low cache size and missing power-loss protection). Did you make sure that those Samsung Pros are patched to the latest firmware? They are known to destroy themselves when running with the bugged firmware. Also check if the PCIe/M.2 slots got enouth lanes, fast enough lanes and if those lanes are directly connected to the CPU or just to the slow chipset (which might be bottlenecking).

In another location I have the same Samsung SSD 980 PRO with Dell r630 and the speed is also ~800MB/s (pve8) Firmware was checked.
I have to check pcie slot, thanks

 

[siema_proxmox]

So basically both are using SSDs that aren't recommended to be used with ZFS (bad durability, low cache size and missing power-loss protection). Did you make sure that those Samsung Pros are patched to the latest firmware? They are known to destroy themselves when running with the bugged firmware. Also check if the PCIe/M.2 slots got enough lanes, fast enough lanes and if those lanes are directly connected to the CPU or just to the slow chipset (which might be bottlenecking).