ZFS Datastore on PBS - ZFS Recordsize/Dedup...

[Ramalama]

Lets do a conclusion, because this thread get too long:

Local Storage / PVE Default Settings (Zstd 1thread):

ZSTD -> 1GB/s limit
LZO -> Around 600MB/s
GZIP -> Around 40MB/s
none -> 4,5-5 GB/s

Local Storage / Zstd: 32 threads + Pigz:

ZSTD -> 1GB/s limit
LZO -> Didn't tested, but i don't expect a differnce.
GZIP -> Around 500MB/s
none -> 4,5-5 GB/s

PBS: (PVE is always the Genoa 9374 Node)

PVE -> to Dedicated PBS (8x SAS + Special Vdev / Xeon E5 Server): 1GB/s limit
PVE -> to PBS-VM on another Genoa PVE: 1GB/s limit
PVE -> to Dedicated PBS (8x Micron 7450 Max / Another Genoa): 1GB/s limit
PVE -> to Dedicated PBS (2x PM1735 / Xeon E5 Server): 1GB/s limit
PVE -> to PBS-VM (on same node, network only through VMBR) on same Genoa PVE: 1GB/s limit

Bugreport:
https://bugzilla.proxmox.com/show_bug.cgi?id=5481

Cheers.