PBS hardware recommendations for optimal speed (NVME)

[Suertzz]

Hello,

We are considering buying a new server to get a fast (local) PBS and moving the others slower based HDD server on another physical location

Our current hardware :
- x2 Intel xeon 24Core
- 256 Go RAM
- 24 x 7200rpm HDD
- 2x 4To NVME
- 2X 1To SATA SSD
- 10G network

ZFS conf :
2 Mirrored SSD for the OS
2 Mirrored NVME for metadata (special device)
12x striped (2 disk mirrors) 
HDD

Our current setup is a little bit slow (even with the special device we get painfully ~100mo/s)

On small periodic restore it is acceptable, however with multiple large restores I'm afraid the server won't be able to handle it with fast throughput

We are looking for a setup with a least 86To of usable space (the same as the others server, they will sync on this new server)

We are going on full NVME, ZFS based with 256 GO RAM and 10G network, for the OS 2x SATA SSD on the backplane

Do you have any recommendations on the raid type for the datastore (the server can be 8/12/16/24 bay and the nvme can be up to 16TO) ?

Any advice on the CPU choice aswell (on nvme they can be the bottleneck and PBS use it a lot for hashing right?)

I guess the benefic of special device is not worth it on full nvme setup

What can I expect in term of restore performance ?

Thanks for ur help!

 

[kwinz]

AFAIK the majority of work is handled in the PVE clients, the PBS server is untrusted and mainly only does dedup. So it would also make sense to check your PVE hardware. I see that you didn't receive any response for half a year. What did you end up buying for PBS? And what's your performance now?

 

[Suertzz]

AFAIK the majority of work is handled in the PVE clients, the PBS server is untrusted and mainly only does dedup. So it would also make sense to check your PVE hardware. I see that you didn't receive any response for half a year. What did you end up buying for PBS? And what's your performance now?

Hi,

Sorry for the delay!

We did swap our HDD devices with SSD (still SATA, that was the cheapest option.) We get almost ~220mo/s when restoring!

HDD works when you have a special device but verify/gc can be very very slow, and disk keep a lot of pressure when it run