Network Setup Advice - Jumbo Frames

[greavette]

Hello,

I've added two more Nics to my Proxmox Server. While I'm at it I thought I would make some other improvements to our network.

We use a NAS Storage Device (T5R Imation) and this is connected to our Proxmox Servers using NFS. I've bonded the Nics (802.3ad) on the NAS and our Dell Powerconnect has been setup for LAG for the NAS. I've setup Jumbo Frames (MTU 9000) on the NAS as well.

Our Proxmox Server will have 6 Nics. 4 are bonded in pairs and will be used for VM traffic. These two bonded sets are both setup with 802.3ad to our Powerconnect switch. My eth0 (vmbr0) has the IP for the server and is how I access our Proxmox Servers.

Should I add Jubmo Frames (MTU 9000) to my bonded Nics on my Proxmox Server? Will I see a performance increase using Jumbo Frames when running VM's from our NAS?

I'm assuming that using Jumbo Frames on my Proxmox eth0 (vmbr0) will not improve my backups to the NAS since I only have one Nic. If I were to bond (802.3ad) my eth0 Nic with another and setup that as vmbr0 and then use Jubmo Frames, would my backup times be faster?

What more can I do to improve performance on my network if I were to run my VM's from my NAS.

Thank you.

 

[screenie]

Hi,

Jumbo frames gave you a little bit more noticeable performance some years ago then yet;
Actual switches and nic's (with tcp offload engine) have already very low latencies in packet forwarding, in my tests i saw about 4-6% increase;
Use iperf and run some tests with and without jumbo frames to find out how your network devices perform;
If you have 10G hardware you need to tune rmem, wmem and mmrbc;
Also test your storage throughput (especially on 10G) that you could serve the network load;
There are also options on the NFS side to check and possible to tune (rsize,wsize,intr,noatime);

Alex