vzdump and NFS / Slow performance / Is there a solution?

[fips]

Hey Guys!

I am new to proxmox but so far its a great peace of software. Thanks to the developers!

My situation:
I have to nodes (Version: 3.2) and they are connected to a NFS share, everything in a gigabit network.
Performance when i backup (or restore) a CT is worse.
So i searched a little bit and found quite a lot of other users who has the same problems.
But so far i could find a common solution.
If i backup a CT to my NFS share, i reach about 1MB/s.
If i copy directly on the node a file to the same NFS share, everything is fine with about 100MB/s

Here my question:
Is there something what i have to change in vzdump to increase the speed with it?

The NFS share itself can't be problem otherwise i would have the same worse speed if i copy directly on the node.

Thanks in advanced
Steve

 

[liska_]

When I tried to use gluster instead of nfs, I noticed that a container is firstly synced to /tmp, compressed and then transferred to remote storage. It was much faster because of copying many files versus one big file, so I suppose it could be done with nfs as well, but I did not try it.

 

[fips]

Ah ok, than "sync" is the problem...

 

[fireon]

You mean sync on the NFSserver, so you set from sync to async?Regards

 

[deveth0]

Hi,

i know this thread is a little bit older but I got the same issue with backups to my NFS share.

After some debugging I found the reason (at least for me):
Proxmox rsyncs your OpenVZ container to the NFS target and zips it afterwards. This results in many small file-transfers.
BUT you can configure a temp-dir in /etc/vzdump.conf which is used for the rsync process (I use /tmp on my local ssd).

See more: https://dev-eth0.de/increase-performance-proxmox-backups-nfs-target/

Regards

 

[mir]

Whow, Amazing speed increase

Before change tmp directory:
INFO: creating archive '/mnt/pve/qnap_nfs/dump/vzdump-openvz-137-2014_09_07-05_15_01.tar.lzo'
INFO: Total bytes written: 846704640 (808MiB, 7.9MiB/s)
INFO: archive file size: 438MB
INFO: Finished Backup of VM 137 (00:06:11)

After changing tmp directory to local SSD:
INFO: creating archive '/mnt/pve/qnap_nfs/dump/vzdump-openvz-137-2014_09_07-22_16_56.tar.lzo'
INFO: Total bytes written: 846725120 (808MiB, 49MiB/s)
INFO: archive file size: 438MB
INFO: Finished Backup of VM 137 (00:02:05)

 

[Saphirim]

7 years later...and this post just saved me!

Backing up Containers/VMs to a CIFS share:

Before: ~30Mb/s
After: ~110MB/s most likely limited by GBit LAN.

Using a local root storage of 3x250Gb SSD in RaidZ1.

Regards