I'm looking to improve my backup (well, and overall VM, but that's a story for another day) speed in PVE. I've looked around, and haven't found anything on optimization, or even what normal or 'good' performance would be.
I have 4 nodes, all on PVE6.1-7, all 12th gen Dell R620/R720 machines with dual 8 core processor and 192GB of ram. They have 3 active network connections, the bridge is 10G on 192.168.100.0/24 for the guests, it has a 10G on a SAN subnet 192.168.101.0/24 where there are 3 FreeNAS hosts with NFS shares for Images, ISOs, and Backups, and a 1G CoroSync on 192.168.102.0/24.
When I copy a file from a guest VM to a Samba share on FreeNAS I get about 150 MB/s, but when I copy from my MacOS physical machines I get nearly 400MB/s, so I'd like improve that as well. The VM image is stored on FreeNAS as well, but I would've thought that the transfer would go to the host's physical memory before going back out to the NFS share (it's only 5GB), so I wouldn't have expected it to be so bottlenecked, but maybe that was unreasonable.
Some performance testing information. I'm wondering if my expectations are off, or where I should start looking to tune this setup. Thanks for any advice. I'll post testing results as replies as it doesn't like the post to be too long.
UPDATE: I included a bunch of network details in this other posting, but if you follow along the details below, I no longer believe this is a network or storage issue. This really appears to be some bottleneck in the vzdump process to me.
I have 4 nodes, all on PVE6.1-7, all 12th gen Dell R620/R720 machines with dual 8 core processor and 192GB of ram. They have 3 active network connections, the bridge is 10G on 192.168.100.0/24 for the guests, it has a 10G on a SAN subnet 192.168.101.0/24 where there are 3 FreeNAS hosts with NFS shares for Images, ISOs, and Backups, and a 1G CoroSync on 192.168.102.0/24.
When I copy a file from a guest VM to a Samba share on FreeNAS I get about 150 MB/s, but when I copy from my MacOS physical machines I get nearly 400MB/s, so I'd like improve that as well. The VM image is stored on FreeNAS as well, but I would've thought that the transfer would go to the host's physical memory before going back out to the NFS share (it's only 5GB), so I wouldn't have expected it to be so bottlenecked, but maybe that was unreasonable.
Some performance testing information. I'm wondering if my expectations are off, or where I should start looking to tune this setup. Thanks for any advice. I'll post testing results as replies as it doesn't like the post to be too long.
UPDATE: I included a bunch of network details in this other posting, but if you follow along the details below, I no longer believe this is a network or storage issue. This really appears to be some bottleneck in the vzdump process to me.
Last edited: