Slow vzdump

  • Thread starter Thread starter christophe charron
  • Start date Start date
C

christophe charron

Guest
Hello,

I have a Proxmox server that runs very well with a few virtual machines that spin very well too.
But the problem, in my opinion, at backups.
That night i made "only" 1 hour 40 minutes to save a machine 26go what seems to me quite a lot.
The previous night, I rebooted the server because after 4 hours, a backup of 40GB was not yet complete.

and you? it takes how long, how you think you are?

below the record

vzdump --quiet --node 1 --suspend --dumpdir /backup/vzdump 106 107

106: aoû 25 00:00:08 INFO: Starting Backup of VM 106 (openvz)
106: aoû 25 00:00:08 INFO: status = CTID 106 exist mounted running

106: aoû 25 00:00:08 INFO: starting first sync /var/lib/vz/private/106 to /tampon/tmp/vzdumptmp9304
106: aoû 25 00:53:36 INFO: Number of files: 289966
106: aoû 25 00:53:36 INFO: Number of files transferred: 262185

106: aoû 25 00:53:36 INFO: Total file size: 28306928219 bytes
106: aoû 25 00:53:36 INFO: Total transferred file size: 27945008337 bytes
106: aoû 25 00:53:36 INFO: Literal data: 27945008337 bytes
106: aoû 25 00:53:36 INFO: Matched data: 0 bytes

106: aoû 25 00:53:36 INFO: File list size: 7698780
106: aoû 25 00:53:36 INFO: File list generation time: 0.001 seconds
106: aoû 25 00:53:36 INFO: File list transfer time: 0.000 seconds
106: aoû 25 00:53:36 INFO: Total bytes sent: 27967346830

106: aoû 25 00:53:36 INFO: Total bytes received: 5105696
106: aoû 25 00:53:36 INFO: sent 27967346830 bytes received 5105696 bytes 8718233.61 bytes/sec
106: aoû 25 00:53:36 INFO: total size is 28306928219 speedup is 1.01

106: aoû 25 00:53:36 INFO: first sync finished (3208 seconds)
106: aoû 25 00:53:36 INFO: suspend vps
106: aoû 25 00:53:36 INFO: Setting up checkpoint...
106: aoû 25 00:53:36 INFO: suspend...
106: aoû 25 00:53:36 INFO: get context...

106: aoû 25 00:53:36 INFO: Checkpointing completed succesfully
106: aoû 25 00:53:36 INFO: final sync /var/lib/vz/private/106 to /tampon/tmp/vzdumptmp9304
106: aoû 25 00:54:43 INFO: Number of files: 289966
106: aoû 25 00:54:43 INFO: Number of files transferred: 0

106: aoû 25 00:54:43 INFO: Total file size: 28306928219 bytes
106: aoû 25 00:54:43 INFO: Total transferred file size: 0 bytes
106: aoû 25 00:54:43 INFO: Literal data: 0 bytes
106: aoû 25 00:54:43 INFO: Matched data: 0 bytes

106: aoû 25 00:54:43 INFO: File list size: 7698780
106: aoû 25 00:54:43 INFO: File list generation time: 0.001 seconds
106: aoû 25 00:54:43 INFO: File list transfer time: 0.000 seconds
106: aoû 25 00:54:43 INFO: Total bytes sent: 7721616

106: aoû 25 00:54:43 INFO: Total bytes received: 22835
106: aoû 25 00:54:43 INFO: sent 7721616 bytes received 22835 bytes 114732.61 bytes/sec
106: aoû 25 00:54:43 INFO: total size is 28306928219 speedup is 3655.12

106: aoû 25 00:54:43 INFO: final sync finished (67 seconds)
106: aoû 25 00:54:43 INFO: resume vps
106: aoû 25 00:54:43 INFO: Resuming...
106: aoû 25 00:54:43 INFO: vps is online again after 67 seconds
106: aoû 25 00:55:35 INFO: creating archive '/backup/vzdump/vzdump-106.dat' (/tampon/tmp/vzdumptmp9304/106)

106: aoû 25 01:40:37 INFO: Nombre total d'octets écrits: 28320266240 (27GiB, 11MiB/s)
106: aoû 25 01:40:37 INFO: file size 26.38GB
106: aoû 25 01:44:49 INFO: Finished Backup of VM 106 (01:44:48)

107: aoû 25 01:44:49 INFO: Starting Backup of VM 107 (openvz)

107: aoû 25 01:44:49 INFO: status = CTID 107 exist mounted running
107: aoû 25 01:44:49 INFO: starting first sync /var/lib/vz/private/107 to /tampon/tmp/vzdumptmp9304
107: aoû 25 01:48:18 INFO: Number of files: 83537

107: aoû 25 01:48:18 INFO: Number of files transferred: 70849
107: aoû 25 01:48:18 INFO: Total file size: 1358708483 bytes
107: aoû 25 01:48:18 INFO: Total transferred file size: 1355387487 bytes
107: aoû 25 01:48:18 INFO: Literal data: 1355387487 bytes

107: aoû 25 01:48:18 INFO: Matched data: 0 bytes
107: aoû 25 01:48:18 INFO: File list size: 1874377
107: aoû 25 01:48:18 INFO: File list generation time: 0.001 seconds
107: aoû 25 01:48:18 INFO: File list transfer time: 0.000 seconds

107: aoû 25 01:48:18 INFO: Total bytes sent: 1360495738
107: aoû 25 01:48:18 INFO: Total bytes received: 1408669
107: aoû 25 01:48:18 INFO: sent 1360495738 bytes received 1408669 bytes 6500737.03 bytes/sec
107: aoû 25 01:48:18 INFO: total size is 1358708483 speedup is 1.00

107: aoû 25 01:48:18 INFO: first sync finished (209 seconds)
107: aoû 25 01:48:18 INFO: suspend vps
107: aoû 25 01:48:18 INFO: Setting up checkpoint...
107: aoû 25 01:48:18 INFO: suspend...
107: aoû 25 01:48:18 INFO: get context...

107: aoû 25 01:48:18 INFO: Checkpointing completed succesfully
107: aoû 25 01:48:18 INFO: final sync /var/lib/vz/private/107 to /tampon/tmp/vzdumptmp9304
107: aoû 25 01:48:21 INFO: Number of files: 83537
107: aoû 25 01:48:21 INFO: Number of files transferred: 0

107: aoû 25 01:48:21 INFO: Total file size: 1358708483 bytes
107: aoû 25 01:48:21 INFO: Total transferred file size: 0 bytes
107: aoû 25 01:48:21 INFO: Literal data: 0 bytes
107: aoû 25 01:48:21 INFO: Matched data: 0 bytes

107: aoû 25 01:48:21 INFO: File list size: 1874377
107: aoû 25 01:48:21 INFO: File list generation time: 0.001 seconds
107: aoû 25 01:48:21 INFO: File list transfer time: 0.000 seconds
107: aoû 25 01:48:21 INFO: Total bytes sent: 1882121

107: aoû 25 01:48:21 INFO: Total bytes received: 7743
107: aoû 25 01:48:21 INFO: sent 1882121 bytes received 7743 bytes 539961.14 bytes/sec
107: aoû 25 01:48:21 INFO: total size is 1358708483 speedup is 718.95

107: aoû 25 01:48:21 INFO: final sync finished (3 seconds)
107: aoû 25 01:48:21 INFO: resume vps
107: aoû 25 01:48:21 INFO: Resuming...
107: aoû 25 01:48:21 INFO: vps is online again after 3 seconds
107: aoû 25 01:48:21 INFO: creating archive '/backup/vzdump/vzdump-107.dat' (/tampon/tmp/vzdumptmp9304/107)

107: aoû 25 01:50:37 INFO: Nombre total d'octets écrits: 1420646400 (1,4GiB, 11MiB/s)
107: aoû 25 01:50:37 INFO: file size 1.32GB
107: aoû 25 01:50:47 INFO: Finished Backup of VM 107 (00:05:58)
Do you have any idea to make it faster ? Is it the right time ?

Cordially,
Christophe Charron
 
vzdump uses a bandwidth limit (10MB/s default). You can set that in /etc/vzdump.conf, for example (20MB/s):

bwlimit: 20000

see 'man vzdump'
 
vzdump uses a bandwidth limit (10MB/s default). You can set that in /etc/vzdump.conf, for example (20MB/s):

bwlimit: 20000

see 'man vzdump'
Thanks.
I'll tell you about it, after this night vzdump.

--
Cordially,
Christophe Charron
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!