First of all my hardware on my LAB sucks but even then I wondering if my backups are slow or not when using the PVE integration.
As it only shows like INFO: 1% (632.0 MiB of 60.0 GiB) in 10s, read: 40.0 MiB/s, write: 40.0 MiB/s
Sometimes a little more than this and if I look at the ceph storage its only using 40 to 60 MiB/s and that storage can do a lot more
If I use fio on the VM storage i can get
write BW=173MiB/s
read BW=374MiB/s
with --bs=1024k --iodepth=32
The PBS server is using spinning 15K disks and I tested them with fifo and --bs=1024k --iodepth=32
BW=130MiB/s and the about the same for read
The network is running at 10G and iperf shows that's good 9.86 Gbits/sec in both directions
The bench make test from hypervisor to the pbs gives me
Uploaded 209 chunks in 5 seconds.
Time per request: 24159 microseconds.
TLS speed: 173.61 MB/s
SHA256 speed: 208.24 MB/s
Compression speed: 352.35 MB/s
Decompress speed: 591.01 MB/s
AES256/GCM speed: 641.15 MB/s
Verify speed: 154.18 MB/s
Not great so I assume the limit is because of the disks for the TLS speed ?
But when I do a backup it never reaches that speed
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: created new
INFO: 0% (352.0 MiB of 60.0 GiB) in 3s, read: 117.3 MiB/s, write: 44.0 MiB/s
INFO: 1% (624.0 MiB of 60.0 GiB) in 10s, read: 38.9 MiB/s, write: 38.9 MiB/s
INFO: 2% (1.2 GiB of 60.0 GiB) in 30s, read: 31.4 MiB/s, write: 31.2 MiB/s
INFO: 3% (1.9 GiB of 60.0 GiB) in 42s, read: 54.3 MiB/s, write: 22.3 MiB/s
INFO: 4% (2.4 GiB of 60.0 GiB) in 47s, read: 120.8 MiB/s, write: 3.2 MiB/s
INFO: 5% (3.0 GiB of 60.0 GiB) in 1m 3s, read: 35.5 MiB/s, write: 28.0 MiB/s
INFO: 6% (3.6 GiB of 60.0 GiB) in 1m 20s, read: 36.7 MiB/s, write: 36.7 MiB/s
......
NFO: 80% (48.1 GiB of 60.0 GiB) in 8m 8s, read: 2.0 GiB/s, write: 1.3 MiB/s
INFO: 90% (54.1 GiB of 60.0 GiB) in 8m 11s, read: 2.0 GiB/s, write: 0 B/s
INFO: 100% (60.0 GiB of 60.0 GiB) in 8m 14s, read: 2.0 GiB/s, write: 2.7 MiB/s
INFO: backup is sparse: 46.35 GiB (77%) total zero data
INFO: backup was done incrementally, reused 46.43 GiB (77%)
INFO: transferred 60.00 GiB in 494 seconds (124.4 MiB/s)
INFO: Finished Backup of VM 919 (00:08:15)
INFO: Backup finished at 2020-10-27 14:38:54
INFO: Backup job finished successfully
TASK OK
Is this a normal backup speed as never gets near that 170 MB/s ?
Or should be be expecting faster
Of course the incremental is a lot faster than this initial one
thanks
As it only shows like INFO: 1% (632.0 MiB of 60.0 GiB) in 10s, read: 40.0 MiB/s, write: 40.0 MiB/s
Sometimes a little more than this and if I look at the ceph storage its only using 40 to 60 MiB/s and that storage can do a lot more
If I use fio on the VM storage i can get
write BW=173MiB/s
read BW=374MiB/s
with --bs=1024k --iodepth=32
The PBS server is using spinning 15K disks and I tested them with fifo and --bs=1024k --iodepth=32
BW=130MiB/s and the about the same for read
The network is running at 10G and iperf shows that's good 9.86 Gbits/sec in both directions
The bench make test from hypervisor to the pbs gives me
Uploaded 209 chunks in 5 seconds.
Time per request: 24159 microseconds.
TLS speed: 173.61 MB/s
SHA256 speed: 208.24 MB/s
Compression speed: 352.35 MB/s
Decompress speed: 591.01 MB/s
AES256/GCM speed: 641.15 MB/s
Verify speed: 154.18 MB/s
Not great so I assume the limit is because of the disks for the TLS speed ?
But when I do a backup it never reaches that speed
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: created new
INFO: 0% (352.0 MiB of 60.0 GiB) in 3s, read: 117.3 MiB/s, write: 44.0 MiB/s
INFO: 1% (624.0 MiB of 60.0 GiB) in 10s, read: 38.9 MiB/s, write: 38.9 MiB/s
INFO: 2% (1.2 GiB of 60.0 GiB) in 30s, read: 31.4 MiB/s, write: 31.2 MiB/s
INFO: 3% (1.9 GiB of 60.0 GiB) in 42s, read: 54.3 MiB/s, write: 22.3 MiB/s
INFO: 4% (2.4 GiB of 60.0 GiB) in 47s, read: 120.8 MiB/s, write: 3.2 MiB/s
INFO: 5% (3.0 GiB of 60.0 GiB) in 1m 3s, read: 35.5 MiB/s, write: 28.0 MiB/s
INFO: 6% (3.6 GiB of 60.0 GiB) in 1m 20s, read: 36.7 MiB/s, write: 36.7 MiB/s
......
NFO: 80% (48.1 GiB of 60.0 GiB) in 8m 8s, read: 2.0 GiB/s, write: 1.3 MiB/s
INFO: 90% (54.1 GiB of 60.0 GiB) in 8m 11s, read: 2.0 GiB/s, write: 0 B/s
INFO: 100% (60.0 GiB of 60.0 GiB) in 8m 14s, read: 2.0 GiB/s, write: 2.7 MiB/s
INFO: backup is sparse: 46.35 GiB (77%) total zero data
INFO: backup was done incrementally, reused 46.43 GiB (77%)
INFO: transferred 60.00 GiB in 494 seconds (124.4 MiB/s)
INFO: Finished Backup of VM 919 (00:08:15)
INFO: Backup finished at 2020-10-27 14:38:54
INFO: Backup job finished successfully
TASK OK
Is this a normal backup speed as never gets near that 170 MB/s ?
Or should be be expecting faster
Of course the incremental is a lot faster than this initial one
thanks
