Is PBS using single thread only?

[proxmoxrks]

My initial observation is, proxmox backup server seems to use single thread when performing backup/restore.
If the CPU's single core is not fast enough, it cannot saturate the network interface.

1) Is it correct?
2) How do I tune the TLS speed?

Uploaded 18 chunks in 10 seconds.
Time per request: 570639 microseconds.
TLS speed: 7.35 MB/s
SHA256 speed: 1964.99 MB/s
Compression speed: 2077.70 MB/s
Decompress speed: 9049.08 MB/s
AES256/GCM speed: 3725.96 MB/s
┌───────────────────────────────────┬─────────────────────┐
│ Name                              │ Value               │
╞═══════════════════════════════════╪═════════════════════╡
│ TLS (maximal backup upload speed) │ 7.35 MB/s (1%)      │
├───────────────────────────────────┼─────────────────────┤
│ SHA256 checksum comptation speed  │ 1964.99 MB/s (93%)  │
├───────────────────────────────────┼─────────────────────┤
│ ZStd level 1 compression speed    │ 2077.70 MB/s (96%)  │
├───────────────────────────────────┼─────────────────────┤
│ ZStd level 1 decompression speed  │ 9049.08 MB/s (112%) │
├───────────────────────────────────┼─────────────────────┤
│ AES256 GCM encryption speed       │ 3725.96 MB/s (98%)  │
└───────────────────────────────────┴─────────────────────┘

Uploaded 16 chunks in 9 seconds.
Time per request: 615069 microseconds.
TLS speed: 6.82 MB/s
SHA256 speed: 1793.27 MB/s
Compression speed: 1965.30 MB/s
Decompress speed: 9048.97 MB/s
AES256/GCM speed: 3516.82 MB/s
┌───────────────────────────────────┬─────────────────────┐
│ Name                              │ Value               │
╞═══════════════════════════════════╪═════════════════════╡
│ TLS (maximal backup upload speed) │ 6.82 MB/s (1%)      │
├───────────────────────────────────┼─────────────────────┤
│ SHA256 checksum comptation speed  │ 1793.27 MB/s (85%)  │
├───────────────────────────────────┼─────────────────────┤
│ ZStd level 1 compression speed    │ 1965.30 MB/s (91%)  │
├───────────────────────────────────┼─────────────────────┤
│ ZStd level 1 decompression speed  │ 9048.97 MB/s (112%) │
├───────────────────────────────────┼─────────────────────┤
│ AES256 GCM encryption speed       │ 3516.82 MB/s (92%)  │
└───────────────────────────────────┴─────────────────────┘

[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   107 MBytes   900 Mbits/sec    1   1012 KBytes       
[  5]   1.00-2.00   sec  66.2 MBytes   556 Mbits/sec   45    798 KBytes       
[  5]   2.00-3.00   sec  70.0 MBytes   587 Mbits/sec    1    864 KBytes       
[  5]   3.00-4.00   sec  73.8 MBytes   619 Mbits/sec   19    925 KBytes       
[  5]   4.00-5.00   sec  90.0 MBytes   755 Mbits/sec    0    996 KBytes       
[  5]   5.00-6.00   sec  68.8 MBytes   577 Mbits/sec   45    571 KBytes       
[  5]   6.00-7.00   sec  45.0 MBytes   377 Mbits/sec    0    697 KBytes       
[  5]   7.00-8.00   sec  90.0 MBytes   755 Mbits/sec    0    798 KBytes       
[  5]   8.00-9.00   sec  70.0 MBytes   587 Mbits/sec    0    878 KBytes       
[  5]   9.00-10.00  sec   100 MBytes   839 Mbits/sec   63    945 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   781 MBytes   655 Mbits/sec  174             sender
[  5]   0.00-10.00  sec   778 MBytes   653 Mbits/sec                  receiver

 

[tom]

TLS (maximal backup upload speed) │ 7.35 MB/s (1%)

Please tell all details about your hardware, there is something very wrong here.

 

[proxmoxrks]

Please tell all details about your hardware, there is something very wrong here.

I am using VPSs. But you can see the iperf, I can get to around 70MB/s in both direction.

Client:

Processor: AMD Ryzen 9 3900X 12-Core Processor
CPU cores: 4
Frequency: 3792.872 MHz
RAM: 3.7G


Backup Server:

Processor : Intel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
CPU cores : 2@ 2799.998 MHz
RAM : 3.7G

 

[Alwin]

CPU cores : 2@ 2799.998 MHz
RAM : 3.7G

I suppose that's the VPS? Check the system load on the VPS while a backup or test is running. I guess the machine won't be able to handle much more.

 

[proxmoxrks]

I suppose that's the VPS? Check the system load on the VPS while a backup or test is running. I guess the machine won't be able to handle much more.

My backup VPS can push/pull 1Gbps without issue.
I am not asking for 100MB/s during backup/restore. I would be happy if it can do 30MB/s.

 

[tom]

My backup VPS can push/pull 1Gbps without issue.
I am not asking for 100MB/s during backup/restore. I would be happy if it can do 30MB/s.

There is obviously an issue with TLS, see your benchmark results.

What kind of "VPS" do you run, seems yours cannot provide the needed TLS power?

Please note, Proxmox Backup Server is designed to run on bare-metal.

 

[DC-CA1]

the issue he is facing with the VM is the vm cpu is probably set to KVM and AES Flag need to be ON for TLS , but not supported on KVM Cpu type ,
so change your Vcpu to Type = Host and enable AES flag