Hello,
we're currently having a problem with our PBS server speed. While backups are reasonably fast (at least 200 MB/s, hard to say due to concurrent backup jobs), restores are painfully slow (60 MB/s) for seemingly no reason.
System specs are as follows:
PVE node:
2x Xeon Gold 5218R
320GB DDR4 ECC
2x PERC RAID1 with 3.84TiB SAS12 SSDs with LVM thick provisioning
PBS server:
1x Xeon Silver 4210
64GB DDR4 ECC
2x SAS HDDs as boot drive
10x 12TB WD Golds in ZFS (6x stripe of 2x mirrors) with 2x 960GB Samsung SATA SSDs (2x mirror) as special device (metadata cache)
The hosts are on the same L2 with 0.3ms ping times between them. The network is 10G.
Running a benchmark from the PVE node gives these results:
Benchmark directly on the PBS server:
IO utilization was extremely low, with
Does this make sense? Is this just a result of using HDDs?
we're currently having a problem with our PBS server speed. While backups are reasonably fast (at least 200 MB/s, hard to say due to concurrent backup jobs), restores are painfully slow (60 MB/s) for seemingly no reason.
System specs are as follows:
PVE node:
2x Xeon Gold 5218R
320GB DDR4 ECC
2x PERC RAID1 with 3.84TiB SAS12 SSDs with LVM thick provisioning
PBS server:
1x Xeon Silver 4210
64GB DDR4 ECC
2x SAS HDDs as boot drive
10x 12TB WD Golds in ZFS (6x stripe of 2x mirrors) with 2x 960GB Samsung SATA SSDs (2x mirror) as special device (metadata cache)
The hosts are on the same L2 with 0.3ms ping times between them. The network is 10G.
Running a benchmark from the PVE node gives these results:
Code:
Uploaded 446 chunks in 5 seconds.
Time per request: 11268 microseconds.
TLS speed: 372.22 MB/s
SHA256 speed: 191.80 MB/s
Compression speed: 232.69 MB/s
Decompress speed: 346.36 MB/s
AES256/GCM speed: 512.53 MB/s
Verify speed: 123.09 MB/sBenchmark directly on the PBS server:
Code:
Uploaded 951 chunks in 5 seconds.
Time per request: 5268 microseconds.
TLS speed: 796.04 MB/s
SHA256 speed: 397.03 MB/s
Compression speed: 418.36 MB/s
Decompress speed: 625.46 MB/s
AES256/GCM speed: 2988.50 MB/s
Verify speed: 243.40 MB/sIO utilization was extremely low, with
atop showing busy-times on the HDDs below 10-15%. CPU usage on both hosts barely went over 10%. Memory usage was consistently low aswell, although the GUI on the PBS server always shows very high memory usage due to ZFS. free -m reported around 30GB of free memory on the PBS server, with barely any swap being used.Does this make sense? Is this just a result of using HDDs?