Unable to backup OpenVZ on NFS share

  • Thread starter Thread starter fluke
  • Start date Start date
F

fluke

Guest
I am unable to backup an OpenVZ machine on NFS share. Local backup of the same VM is OK. Here is a part of the log:

Code:
105: Dec 29 04:08:51 INFO: Starting Backup of VM 105 (openvz)
105: Dec 29 04:08:51 INFO: CTID 105 exist mounted running
105: Dec 29 04:08:51 INFO: status = CTID 105 exist mounted running
105: Dec 29 04:08:52 INFO: mode failure - unable to detect lvm volume group
105: Dec 29 04:08:52 INFO: trying 'suspend' mode instead
105: Dec 29 04:08:52 INFO: backup mode: suspend
105: Dec 29 04:08:52 INFO: bandwidth limit: 10240 KB/s
105: Dec 29 04:08:52 INFO: starting first sync /var/lib/vz/private/105/ to /mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp
105: Dec 29 04:13:30 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man1/:.1.gz": Input/output error (5)
105: Dec 29 04:13:44 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/Attribute::Handlers.3pm.gz": Input/output error (5)
105: Dec 29 04:13:44 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/B::Asmdata.3pm.gz": Input/output error (5)
105: Dec 29 04:13:44 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/B::Assembler.3pm.gz": Input/output error (5)
105: Dec 29 04:13:44 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/B::Bblock.3pm.gz": Input/output error (5)
105: Dec 29 04:13:44 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/B::Bytecode.3pm.gz": Input/output error (5)
...
...
105: Dec 29 04:13:46 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/XS::Typemap.3pm.gz": Input/output error (5)
105: Dec 29 04:14:03 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/threads::shared.3pm.gz": Input/output error (5)
105: Dec 29 04:14:04 INFO: rsync: recv_generator: failed to stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/man/man3/warnings::register.3pm.gz": Input/output error (5)
105: Dec 29 04:14:41 INFO: rsync: link "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/2/2621A" => usr/share/terminfo/2/2621a failed: File exists (17)
105: Dec 29 04:14:49 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/L/LFT-PC850" failed: No such file or directory (2)
105: Dec 29 04:14:50 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/N/NCR260VT300WPP" failed: No such file or directory (2)
105: Dec 29 04:14:50 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/N/NCRVT100WPP" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P12" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P12-M" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P12-M-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P12-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P14" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P14-M" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P14-M-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P14-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P4" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P5" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P7" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P8" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P8-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P9" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P9-8" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P9-8-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/P/P9-W" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: hlink.c:512: finish_hard_link: Assertion `(((unsigned char *)(node->data))[0]) == 0' failed.
105: Dec 29 04:14:51 INFO: rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
105: Dec 29 04:14:51 INFO: rsync: stat "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/Q/Q310-vip-H-am" failed: No such file or directory (2)
105: Dec 29 04:14:51 INFO: rsync: link "/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp/usr/share/terminfo/h/hp70092A" => usr/share/terminfo/h/hp70092a failed: File exists (17)
105: Dec 29 04:14:51 INFO: rsync: connection unexpectedly closed (451529 bytes received so far) [sender]
105: Dec 29 04:14:51 INFO: rsync error: error in rsync protocol data stream (code 12) at io.c(635) [sender=3.0.3]
105: [COLOR=red]Dec 29 04:16:44 ERROR: Backup of VM 105 failed - command 'rsync --stats -x --numeric-ids --bwlimit=10240 -aH --delete --no-whole-file --inplace '/var/lib/vz/private/105/' '/mnt/pve/VMBackups/vzdump-openvz-105-2009_12_29-04_08_51.tmp'' failed with exit code 12[/COLOR]

Any help will be appreciated.
 
Is there enough free space on the NFS share? Does 'root' have write permissions on the NFS share?
 
Is there enough free space on the NFS share? Does 'root' have write permissions on the NFS share?

Yes, there is enough space on the NFS share. As for permissions - I think there should be no problems, because I backup successfully on the same NFS share KVM machines. Is there a difference in the connection to the nfs share when OpenVZ VM is backuped? Just for info, I am using Windows 2003 R2 NFS server.
 
Is there a difference in the connection to the nfs share when OpenVZ VM is backuped?

we do an rsync to the NFS share, so the NFS server need to be posix compatible.

Just for info, I am using Windows 2003 R2 NFS server.

Please can you test with another NFS server?
 
The Windows 2003 R2 NFS server is part of the Subsystem for UNIX-based Applications (SUA) which is posix compatible (that's the whole idea of SUA).

Anyway, when I stop the OpenVZ machine (backup mode: stop), everything is OK. The problem is probably on my side, because I am running the OpenVZ machines on drbd/ocfs2 partiton.

Thank you for your support.