ZFS Datastore on PBS - ZFS Recordsize/Dedup...

[Ramalama]

Lets do a conclusion, because this thread get too long:

Local Storage / PVE Default Settings (Zstd 1thread):

ZSTD -> 1GB/s limit
LZO -> Around 600MB/s
GZIP -> Around 40MB/s
none -> 4,5-5 GB/s

Local Storage / Zstd: 32 threads + Pigz:

ZSTD -> 1GB/s limit
LZO -> Didn't tested, but i don't expect a differnce.
GZIP -> Around 500MB/s
none -> 4,5-5 GB/s

PBS: (PVE is always the Genoa 9374 Node)

PVE -> to Dedicated PBS (8x SAS + Special Vdev / Xeon E5 Server): 1GB/s limit
PVE -> to PBS-VM on another Genoa PVE: 1GB/s limit
PVE -> to Dedicated PBS (8x Micron 7450 Max / Another Genoa): 1GB/s limit
PVE -> to Dedicated PBS (2x PM1735 / Xeon E5 Server): 1GB/s limit
PVE -> to PBS-VM (on same node, network only through VMBR) on same Genoa PVE: 1GB/s limit

Bugreport:
https://bugzilla.proxmox.com/show_bug.cgi?id=5481

Cheers.

 

[velocity08]

https://bugzilla.proxmox.com/show_bug.cgi?id=5481
Im not completely sure if it's SSL, but almost nothing else is left. I cannot break the barrier of 1GB/s, no matter which hardware.
And im absolutely sure, that no one can, if the destination is a PBS.

Alternative way that's left, is to ditch PBS Completely and simply go the Standard-Linux route, making the server Available over ISCSi. That way i can disable Compression Completely and get the desired speeds of at least 3GB/s.

Cheers

I've run into a similar backup throughput limit > PBS.

so you're not alone.