SDN - QinQ and MTU?

CodeBreaker

Active Member
Aug 6, 2019
17
2
43
31
I'm trying to configure SDN QinQ in my Proxomx cluster and I am wondering is my configuration correct and is there anything I can do to increase performance.
My goal is to have VMs and containers on a default 1500 MTU so I did the following:

1714806486810.png

I have eno1 & eno2 bonded (LACP (802.3ad)) to bond0 and have created a linux bridge using bond0. I have set MTU on eno1, eno2 & bond0 to 1508. All other MTUs remained at default 1500 or auto. I created a QinQ zone:

1714807235946.png

and then a test VNet:

1714807268030.png

Next, I created two containers, and ran iperf3 test and the results are:
Code:
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.01  sec   801 MBytes   671 Mbits/sec  1136             sender
[  5]   0.00-10.01  sec   801 MBytes   671 Mbits/sec                  receiver
[  7]   0.00-10.01  sec  1.28 GBytes  1.10 Gbits/sec  301             sender
[  7]   0.00-10.01  sec  1.28 GBytes  1.10 Gbits/sec                  receiver
[  9]   0.00-10.01  sec  1.04 GBytes   897 Mbits/sec  1082             sender
[  9]   0.00-10.01  sec  1.04 GBytes   895 Mbits/sec                  receiver
[ 11]   0.00-10.01  sec  1.03 GBytes   884 Mbits/sec  1527             sender
[ 11]   0.00-10.01  sec  1.03 GBytes   883 Mbits/sec                  receiver
[SUM]   0.00-10.01  sec  4.14 GBytes  3.55 Gbits/sec  4046             sender
[SUM]   0.00-10.01  sec  4.13 GBytes  3.55 Gbits/sec                  receiver

Which is a lot less than a 10G link I have.

I also manually created nested VLANs by creating a vlan on top of bond0 on the host, then created a VLAN aware bridge on top of that and then set container network interface to use that bridge with an additional VLAN tag. After running iperf again it showed the same speed. If I remove VLAN tag on the container and that there is only one VLAN tag in the packate the speed I get are around 9Gbits/sec. What could be the issue here?

I use Mikrotik switch with RouterOS. I've increased L2MTU as well as MTU on all the ports and bonds. Could this be a wrong Mikrotik configuration?
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!