I have a fairly lightly loaded server running Proxmox 4.4-5. It is a Dual Intel Xeon E5645 Six core/12 thread
with 96GB, with a 4 drive ZFS RAID. My PVEPerf numbers are:
CPU BOGOMIPS: 116252.16
REGEX/SECOND: 1143709
HD SIZE: 3280.12 GB (rpool/ROOT/pve-1)
FSYNCS/SECOND: 1441.33
DNS EXT: 39.11 ms
DNS INT: 18.70 ms (xxx)
I backup to a Synology DS918+ 3-drive NAS over a CIFS share. Both server and NAS have dual Bonded gigabit NICS. CPU, memory and I/O don't appear to be saturated when I view the server Summary in Proxmox web interface during backup. I have tried changing the ionice value to 5 and removing any bandwidth restrictions, but those seemed to have no effect.
My backups to the NAS run at about 9-12 megabytes/sec. If I do a manual copy of similarly-sized files to/from this same share, I get about 100 megabytes/sec.
Can anyone share ideas about why the backup runs 1/10 the speed of a simple copy? Are there things I can do to speed it up?
Info from backup log below:
INFO: starting new backup job: vzdump 134 149 152 155 --quiet 1 --storage evifiles_cifs_bak --mailnotification always --mailto xxx --compress lzo --mode snapshot
INFO: Starting Backup of VM 134 (qemu)
INFO: status = running
INFO: update VM 134: -lock backup
INFO: VM Name: toadng
INFO: include disk 'ide0' 'vmpool:vm-134-disk-1'
INFO: include disk 'scsi0' 'vmpool:vm-134-disk-2'
INFO: backup mode: snapshot
INFO: bandwidth limit: 50000 KB/s
INFO: ionice priority: 7
INFO: skip unused drive 'vmpool:vm-134-disk-3' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-4' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-5' (not included into backup)
INFO: creating archive '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_13-00_45_02.vma.lzo'
INFO: started backup task '40ffce1a-8c9d-4397-80bf-8bb9853c4f8f'
INFO: status: 0% (49414144/171798691840), sparse 0% (16384), duration 4, 12/12 MB/s
INFO: status: 1% (1721892864/171798691840), sparse 0% (36265984), duration 305, 5/5 MB/s
INFO: status: 2% (3452370944/171798691840), sparse 0% (52572160), duration 442, 12/12 MB/s
INFO: status: 3% (5156503552/171798691840), sparse 0% (56872960), duration 566, 13/13 MB/s
INFO: status: 4% (6876168192/171798691840), sparse 0% (72728576), duration 657, 18/18 MB/s
(some lines removed)
IINFO: status: 97% (166649790464/171798691840), sparse 46% (80002199552), duration 13339, 25/0 MB/s
INFO: status: 98% (168384200704/171798691840), sparse 47% (81736503296), duration 13406, 25/0 MB/s
INFO: status: 99% (170092724224/171798691840), sparse 48% (83444666368), duration 13472, 25/0 MB/s
INFO: status: 100% (171798691840/171798691840), sparse 49% (85150461952), duration 13538, 25/0 MB/s
INFO: transferred 171798 MB in 13538 seconds (12 MB/s)
INFO: archive file size: 51.08GB
INFO: delete old backup '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_01-00_45_02.vma.lzo'
INFO: Finished Backup of VM 134 (03:45:46)
with 96GB, with a 4 drive ZFS RAID. My PVEPerf numbers are:
CPU BOGOMIPS: 116252.16
REGEX/SECOND: 1143709
HD SIZE: 3280.12 GB (rpool/ROOT/pve-1)
FSYNCS/SECOND: 1441.33
DNS EXT: 39.11 ms
DNS INT: 18.70 ms (xxx)
I backup to a Synology DS918+ 3-drive NAS over a CIFS share. Both server and NAS have dual Bonded gigabit NICS. CPU, memory and I/O don't appear to be saturated when I view the server Summary in Proxmox web interface during backup. I have tried changing the ionice value to 5 and removing any bandwidth restrictions, but those seemed to have no effect.
My backups to the NAS run at about 9-12 megabytes/sec. If I do a manual copy of similarly-sized files to/from this same share, I get about 100 megabytes/sec.
Can anyone share ideas about why the backup runs 1/10 the speed of a simple copy? Are there things I can do to speed it up?
Info from backup log below:
INFO: starting new backup job: vzdump 134 149 152 155 --quiet 1 --storage evifiles_cifs_bak --mailnotification always --mailto xxx --compress lzo --mode snapshot
INFO: Starting Backup of VM 134 (qemu)
INFO: status = running
INFO: update VM 134: -lock backup
INFO: VM Name: toadng
INFO: include disk 'ide0' 'vmpool:vm-134-disk-1'
INFO: include disk 'scsi0' 'vmpool:vm-134-disk-2'
INFO: backup mode: snapshot
INFO: bandwidth limit: 50000 KB/s
INFO: ionice priority: 7
INFO: skip unused drive 'vmpool:vm-134-disk-3' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-4' (not included into backup)
INFO: skip unused drive 'vmpool:vm-134-disk-5' (not included into backup)
INFO: creating archive '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_13-00_45_02.vma.lzo'
INFO: started backup task '40ffce1a-8c9d-4397-80bf-8bb9853c4f8f'
INFO: status: 0% (49414144/171798691840), sparse 0% (16384), duration 4, 12/12 MB/s
INFO: status: 1% (1721892864/171798691840), sparse 0% (36265984), duration 305, 5/5 MB/s
INFO: status: 2% (3452370944/171798691840), sparse 0% (52572160), duration 442, 12/12 MB/s
INFO: status: 3% (5156503552/171798691840), sparse 0% (56872960), duration 566, 13/13 MB/s
INFO: status: 4% (6876168192/171798691840), sparse 0% (72728576), duration 657, 18/18 MB/s
(some lines removed)
IINFO: status: 97% (166649790464/171798691840), sparse 46% (80002199552), duration 13339, 25/0 MB/s
INFO: status: 98% (168384200704/171798691840), sparse 47% (81736503296), duration 13406, 25/0 MB/s
INFO: status: 99% (170092724224/171798691840), sparse 48% (83444666368), duration 13472, 25/0 MB/s
INFO: status: 100% (171798691840/171798691840), sparse 49% (85150461952), duration 13538, 25/0 MB/s
INFO: transferred 171798 MB in 13538 seconds (12 MB/s)
INFO: archive file size: 51.08GB
INFO: delete old backup '/mnt/evifiles_cifs_bak/dump/vzdump-qemu-134-2018_11_01-00_45_02.vma.lzo'
INFO: Finished Backup of VM 134 (03:45:46)