Slow backup...

[Gilberto Ferreira]

Hi there

I am using PBS in the same PVE server
Everything is up to date...
pveversion
pve-manager/6.2-10/a20769ed (running kernel: 5.4.44-2-pve)
proxmox-backup-server 0.8.9-1
The VM itselft has a virtual disk of 1TB but is using about 250G!
Backups are salve in a SATA disk WD10PURZ-85U (that purple one) and I know this HDD has slow RPM (5400).
But when make the initials backup couple of weeks agos, everything runs smooth and fast, something about 5 minutes to incremental.
Now it's take too long. In fact, while I type this words, is took me 10 hours to make the same backup! And I am using --compress zstd whichi is suppose to be fast.

Anybody has the same behavior?

Thanks.

INFO: starting new backup job: vzdump 100 --mailto root@localhost --compress zstd --node proxmox01 --storage BKP --mode snapshot --mailnotification always --quiet 1
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2020-08-07 00:15:02
INFO: status = running
INFO: VM Name: Win-01
INFO: include disk 'scsi2' '/dev/sdd' 1000204885504
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating Proxmox Backup Server archive 'vm/100/2020-08-07T03:15:02Z'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task 'cc2578da-b61f-43d5-91d3-282edf0bc273'
INFO: resuming VM again
INFO: using fast incremental mode (dirty-bitmap), 1.6 TiB dirty of 1.9 TiB total
INFO: status: 0% (160.0 MiB of 1.6 TiB), duration 3, read: 53.3 MiB/s, write: 53.3 MiB/s
....
INFO: status: 98% (1.6 TiB of 1.6 TiB), duration 37853, read: 29.0 MiB/s, write: 29.0 MiB/s

 

[fabian]

please post a full backup log, and the results of the benchmark command

 

[Gilberto Ferreira]

please post a full backup log, and the results of the benchmark command

[ Sorry! I need to repost the log ]
Ok... Here it is!
This last backup, I most to admit, had has a external HDD (USB 3.0) attached to the VM which I forgot to mark it to do not backup.
But even in normal circunstances, even without this external HDD still is too slow...

proxmox01:~# proxmox-backup-client benchmark --repository datastore1
Password for "root@pam": *************
fingerprint: 99:e0:45:96:0f:b8:03:94:86:40:40:1b:4b:96:d1:7e:02:8d:5b:2e:0e:ef:ac:63:2f:73:ff:0a:14:8c:3d:82
Are you sure you want to continue connecting? (y/n): y
Uploaded 1168 chunks in 5 seconds.
Time per request: 4289 microseconds.
TLS speed: 977.84 MB/s
SHA256 speed: 550.55 MB/s
Compression speed: 1705.29 MB/s
Decompress speed: 6996.31 MB/s
AES256/GCM speed: 4196.90 MB/s
+===================================+=====================+
| Name | Value |
+===================================+=====================+
| TLS (maximal backup upload speed) | 977.84 MB/s (166%) |
+-----------------------------------+---------------------+
| SHA256 checksum comptation speed | 550.55 MB/s (26%) |
+-----------------------------------+---------------------+
| ZStd level 1 compression speed | 1705.29 MB/s (79%) |
+-----------------------------------+---------------------+
| ZStd level 1 decompression speed | 6996.31 MB/s (87%) |
+-----------------------------------+---------------------+
| AES256 GCM encryption speed | 4196.90 MB/s (110%) |
+===================================+=====================+

Last successful backup in attach.

Regards

 

[fabian]

so it's either the source or backup storage that's slowing you down. please post a log of the slow backup with the external disk removed/marked as exluded from backup.

note that in the successful log you posted, you only uploaded ~14G, and it still took over an hour to read all the data to notice whether anything has changed.