Why are my backups so slow?

hefferbub

Member
Sep 11, 2010
28
0
21
I have a fairly lightly loaded server running Proxmox 4.4-5. It is a Dual Intel Xeon E5645 Six core/12 thread
with 96GB, with a 4 drive ZFS RAID. My PVEPerf numbers are:

CPU BOGOMIPS: 116252.16
REGEX/SECOND: 1143709
HD SIZE: 3280.12 GB (rpool/ROOT/pve-1)
FSYNCS/SECOND: 1441.33
DNS EXT: 39.11 ms
DNS INT: 18.70 ms (xxx)

I backup to a Synology DS918+ 3-drive NAS over a CIFS share. Both server and NAS have dual Bonded gigabit NICS. CPU, memory and I/O don't appear to be saturated when I view the server Summary in Proxmox web interface during backup. I have tried changing the ionice value to 5 and removing any bandwidth restrictions, but those seemed to have no effect.

My backups to the NAS run at about 9-12 megabytes/sec. If I do a manual copy of similarly-sized files to/from this same share, I get about 100 megabytes/sec.

Can anyone share ideas about why the backup runs 1/10 the speed of a simple copy? Are there things I can do to speed it up?

Info from backup log below:

INFO: starting new backup job: vzdump 134 149 152 155 --quiet 1 --storage evifiles_cifs_bak --mailnotification always --mailto xxx --compress lzo --mode snapshot
INFO: Starting Backup of VM 134 (qemu)
INFO: status = running
INFO: update VM 134: -lock backup
INFO: VM Name: toadng
INFO: include disk 'ide0' 'vmpool:vm-134-disk-1'
INFO: include disk 'scsi0' 'vmpool:vm-134-disk-2'
INFO: backup mode: snapshot
INFO: bandwidth limit: 50000 KB/s
INFO: ionice priority: 7
INFO: skip unused drive 'vmpool:vm-134-disk-3' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-4' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-5' (not included into backup)
INFO: creating archive '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_13-00_45_02.vma.lzo'
INFO: started backup task '40ffce1a-8c9d-4397-80bf-8bb9853c4f8f'
INFO: status: 0% (49414144/171798691840), sparse 0% (16384), duration 4, 12/12 MB/s
INFO: status: 1% (1721892864/171798691840), sparse 0% (36265984), duration 305, 5/5 MB/s
INFO: status: 2% (3452370944/171798691840), sparse 0% (52572160), duration 442, 12/12 MB/s
INFO: status: 3% (5156503552/171798691840), sparse 0% (56872960), duration 566, 13/13 MB/s
INFO: status: 4% (6876168192/171798691840), sparse 0% (72728576), duration 657, 18/18 MB/s
(some lines removed)
IINFO: status: 97% (166649790464/171798691840), sparse 46% (80002199552), duration 13339, 25/0 MB/s
INFO: status: 98% (168384200704/171798691840), sparse 47% (81736503296), duration 13406, 25/0 MB/s
INFO: status: 99% (170092724224/171798691840), sparse 48% (83444666368), duration 13472, 25/0 MB/s
INFO: status: 100% (171798691840/171798691840), sparse 49% (85150461952), duration 13538, 25/0 MB/s
INFO: transferred 171798 MB in 13538 seconds (12 MB/s)
INFO: archive file size: 51.08GB
INFO: delete old backup '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_01-00_45_02.vma.lzo'
INFO: Finished Backup of VM 134 (03:45:46)
 
you configured a bandwidth limit.

=> INFO: bandwidth limit: 50000 KB/s
 
I disabled that on a subsequent test, (and also changed ionice to 5) and it seemed to make no difference. And isn't that limit equal to 50 megabytes per second? I'm getting 12.

Any other thoughts?

Thanks!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!