Backup hang vzdump

[slumdog]

Hello,

I have a cluster with 2 nodes and every night I setup to make automatic backup on a server with FreeNas 8.0.4.
The backup hangs everytime and the log is bellow:

May 03 02:13:57 INFO: Starting Backup of VM 101 (qemu)
May 03 02:13:57 INFO: status = running
May 03 02:13:57 INFO: backup mode: snapshot
May 03 02:13:57 INFO: ionice priority: 7
May 03 02:13:57 INFO: Logical volume "vzsnap-web9-0" created
May 03 02:13:57 INFO: creating archive '/mnt/pve/freenas/dump/vzdump-qemu-101-2012_05_03-02_13_57.tar.lzo'
May 03 02:13:57 INFO: adding '/mnt/pve/freenas/dump/vzdump-qemu-101-2012_05_03-02_13_57.tmp/qemu-server.conf' to archive ('qemu-server.conf')
May 03 02:13:57 INFO: adding '/mnt/vzsnap0/images/101/vm-101-disk-1.vmdk' to archive ('vm-disk-ide0.vmdk')
May 03 23:53:18 INFO: umount: /mnt/vzsnap0: device is busy.
May 03 23:53:18 INFO: (In some cases useful info about processes that use
May 03 23:53:18 INFO: the device is found by lsof(8) or fuser(1))
May 03 23:53:18 ERROR: command 'umount /mnt/vzsnap0' failed: exit code 1
May 03 23:53:45 INFO: lvremove failed - trying again in 8 seconds
May 03 23:53:58 INFO: lvremove failed - trying again in 16 seconds
May 03 23:54:19 INFO: lvremove failed - trying again in 32 seconds
May 03 23:54:24 ERROR: Backup of VM 101 failed - command '/usr/lib/qemu-server/vmtar '/mnt/pve/freenas/dump/vzdump-qemu-101-2012_05_03-02_13_57.tmp/qemu-server.conf' 'qemu-server.conf' '/mnt/vzsnap0/images/101/vm-101-disk-1.vmdk' 'vm-disk-ide0.vmdk'|lzop >/mnt/pve/freenas/dump/vzdump-qemu-101-2012_05_03-02_13_57.tar.dat' failed: interrupted by signal


Why it hangs???
I have tested the network speed between proxmox cluster and NAS...It's very fast...
Is there any solution???
Thanks..

 

[dietmar]

What is the output of

# pveversion -v

I guess you need to update

 

[slumdog]

here is:

web9:~# pveversion -v
pve-manager: 2.1-1 (pve-manager/2.1/f9b0f63a)
running kernel: 2.6.32-11-pve
proxmox-ve-2.6.32: 2.0-66
pve-kernel-2.6.32-10-pve: 2.6.32-63
pve-kernel-2.6.32-11-pve: 2.6.32-66
lvm2: 2.02.95-1pve2
clvm: 2.02.95-1pve2
corosync-pve: 1.4.3-1
openais-pve: 1.1.4-2
libqb: 0.10.1-2
redhat-cluster-pve: 3.1.8-3
resource-agents-pve: 3.9.2-3
fence-agents-pve: 3.1.7-2
pve-cluster: 1.0-26
qemu-server: 2.0-39
pve-firmware: 1.0-15
libpve-common-perl: 1.0-27
libpve-access-control: 1.0-21
libpve-storage-perl: 2.0-18
vncterm: 1.0-2
vzctl: 3.0.30-2pve5
vzprocps: 2.0.11-2
vzquota: 3.0.12-3
pve-qemu-kvm: 1.0-9
ksm-control-daemon: 1.1-1
web9:~#

what i noticed that the backup process hangs hours on "INFO: adding '/mnt/vzsnap0/images/102/vm-102-disk-1.vmdk' to archive ('vm-disk-ide0.vmdk')" ..see the attached image

 

[slumdog]

here is the log detailes of last backup attempt:

Detailed backup logs:


vzdump 102 --quiet 1 --mailto --mode snapshot --compress gzip --storage freenas

102: May 04 01:32:29 INFO: Starting Backup of VM 102 (qemu)
102: May 04 01:32:29 INFO: status = running
102: May 04 01:32:30 INFO: backup mode: snapshot
102: May 04 01:32:30 INFO: ionice priority: 7
102: May 04 01:32:30 INFO: trying to remove stale snapshot '/dev/pve/vzsnap-web9-0'
102: May 04 01:32:31 INFO: Logical volume "vzsnap-web9-0" created
102: May 04 01:32:31 INFO: creating archive '/mnt/pve/freenas/dump/vzdump-qemu-102-2012_05_04-01_32_29.tar.gz'
102: May 04 01:32:31 INFO: adding '/mnt/pve/freenas/dump/vzdump-qemu-102-2012_05_04-01_32_29.tmp/qemu-server.conf' to archive ('qemu-server.conf')
102: May 04 01:32:31 INFO: adding '/mnt/vzsnap0/images/102/vm-102-disk-1.vmdk' to archive ('vm-disk-ide0.vmdk')
102: May 04 10:20:52 INFO: umount: /mnt/vzsnap0: device is busy.
102: May 04 10:20:52 INFO: (In some cases useful info about processes that use
102: May 04 10:20:52 INFO: the device is found by lsof(8) or fuser(1))
102: May 04 10:20:52 ERROR: command 'umount /mnt/vzsnap0' failed: exit code 1
102: May 04 10:21:14 ERROR: Backup of VM 102 failed - command '/usr/lib/qemu-server/vmtar '/mnt/pve/freenas/dump/vzdump-qemu-102-2012_05_04-01_32_29.tmp/qemu-server.conf' 'qemu-server.conf' '/mnt/vzsnap0/images/102/vm-102-disk-1.vmdk' 'vm-disk-ide0.vmdk'|gzip >/mnt/pve/freenas/dump/vzdump-qemu-102-2012_05_04-01_32_29.tar.dat' failed: interrupted by signal

 

[tom]

try lzo compression instead of gzip (lzo is much faster)

 

[slumdog]

ok I will try..Thank you