What sort of speed should i expect ?

Craig St George

Well-Known Member
Jul 31, 2018
114
14
58
62
First of all my hardware on my LAB sucks but even then I wondering if my backups are slow or not when using the PVE integration.

As it only shows like INFO: 1% (632.0 MiB of 60.0 GiB) in 10s, read: 40.0 MiB/s, write: 40.0 MiB/s
Sometimes a little more than this and if I look at the ceph storage its only using 40 to 60 MiB/s and that storage can do a lot more
If I use fio on the VM storage i can get
write BW=173MiB/s
read BW=374MiB/s
with --bs=1024k --iodepth=32


The PBS server is using spinning 15K disks and I tested them with fifo and --bs=1024k --iodepth=32
BW=130MiB/s and the about the same for read

The network is running at 10G and iperf shows that's good 9.86 Gbits/sec in both directions

The bench make test from hypervisor to the pbs gives me
Uploaded 209 chunks in 5 seconds.
Time per request: 24159 microseconds.
TLS speed: 173.61 MB/s
SHA256 speed: 208.24 MB/s
Compression speed: 352.35 MB/s
Decompress speed: 591.01 MB/s
AES256/GCM speed: 641.15 MB/s
Verify speed: 154.18 MB/s

Not great so I assume the limit is because of the disks for the TLS speed ?

But when I do a backup it never reaches that speed

INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: created new
INFO: 0% (352.0 MiB of 60.0 GiB) in 3s, read: 117.3 MiB/s, write: 44.0 MiB/s
INFO: 1% (624.0 MiB of 60.0 GiB) in 10s, read: 38.9 MiB/s, write: 38.9 MiB/s
INFO: 2% (1.2 GiB of 60.0 GiB) in 30s, read: 31.4 MiB/s, write: 31.2 MiB/s
INFO: 3% (1.9 GiB of 60.0 GiB) in 42s, read: 54.3 MiB/s, write: 22.3 MiB/s
INFO: 4% (2.4 GiB of 60.0 GiB) in 47s, read: 120.8 MiB/s, write: 3.2 MiB/s
INFO: 5% (3.0 GiB of 60.0 GiB) in 1m 3s, read: 35.5 MiB/s, write: 28.0 MiB/s
INFO: 6% (3.6 GiB of 60.0 GiB) in 1m 20s, read: 36.7 MiB/s, write: 36.7 MiB/s
......

NFO: 80% (48.1 GiB of 60.0 GiB) in 8m 8s, read: 2.0 GiB/s, write: 1.3 MiB/s
INFO: 90% (54.1 GiB of 60.0 GiB) in 8m 11s, read: 2.0 GiB/s, write: 0 B/s
INFO: 100% (60.0 GiB of 60.0 GiB) in 8m 14s, read: 2.0 GiB/s, write: 2.7 MiB/s
INFO: backup is sparse: 46.35 GiB (77%) total zero data
INFO: backup was done incrementally, reused 46.43 GiB (77%)
INFO: transferred 60.00 GiB in 494 seconds (124.4 MiB/s)
INFO: Finished Backup of VM 919 (00:08:15)
INFO: Backup finished at 2020-10-27 14:38:54
INFO: Backup job finished successfully
TASK OK



Is this a normal backup speed as never gets near that 170 MB/s ?
Or should be be expecting faster

Of course the incremental is a lot faster than this initial one

thanks
 
Hi,

this is hard to say in general and defense on many factors.
Blocksize, load on PBS and PVE, source storage ....
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!