OVS noob, jumbo frames not working?

Giovanni

Renowned Member
Apr 1, 2009
108
10
83
I have a new test box with Proxmox beta and trying out openvswitch. My server has 4 interfaces, I am using one for MGMT and 3 other ports I wanted to have with LACP trunking.

I may be missing some configs here but one thing I noticed is that I am forcing MTU 9000 in the settings but the ifconfig and 'ip link' commands show mtu 1500 on all ports.... the switch is configured with max MTU of 9216 (assuming we can configure the OS with a lower limit)

Anyway here is the ip link and ifconfig
Code:
root@ve-ssd:~# ip link; ifconfig; cat /etc/network/interfaces
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP mode DEFAULT group default qlen 1000
    link/ether 98:4b:e1:60:98:bc brd ff:ff:ff:ff:ff:ff
3: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP mode DEFAULT group default qlen 1000
    link/ether 98:4b:e1:60:98:be brd ff:ff:ff:ff:ff:ff
4: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 90:b1:1c:15:db:8f brd ff:ff:ff:ff:ff:ff
5: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master ovs-system state UP mode DEFAULT group default qlen 1000
    link/ether 90:b1:1c:15:db:90 brd ff:ff:ff:ff:ff:ff
7: ovs-system: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 1a:8c:49:74:11:1d brd ff:ff:ff:ff:ff:ff
10: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 90:b1:1c:15:db:8f brd ff:ff:ff:ff:ff:ff
11: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/ether 90:b1:1c:15:db:90 brd ff:ff:ff:ff:ff:ff
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        ether 90:b1:1c:15:db:8f  txqueuelen 1000  (Ethernet)
        RX packets 2328  bytes 794599 (775.9 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1025  bytes 648994 (633.7 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 16

eth1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::92b1:1cff:fe15:db90  prefixlen 64  scopeid 0x20<link>
        ether 90:b1:1c:15:db:90  txqueuelen 1000  (Ethernet)
        RX packets 2922  bytes 491812 (480.2 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 10440  bytes 1426483 (1.3 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 17

eth2: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::9a4b:e1ff:fe60:98bc  prefixlen 64  scopeid 0x20<link>
        ether 98:4b:e1:60:98:bc  txqueuelen 1000  (Ethernet)
        RX packets 3915  bytes 963856 (941.2 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1886  bytes 144719 (141.3 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth3: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::9a4b:e1ff:fe60:98be  prefixlen 64  scopeid 0x20<link>
        ether 98:4b:e1:60:98:be  txqueuelen 1000  (Ethernet)
        RX packets 7776  bytes 705291 (688.7 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2585  bytes 350340 (342.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 128  bytes 61121 (59.6 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 128  bytes 61121 (59.6 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vmbr0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.255.20  netmask 255.255.255.0  broadcast 192.168.255.255
        inet6 fe80::92b1:1cff:fe15:db8f  prefixlen 64  scopeid 0x20<link>
        ether 90:b1:1c:15:db:8f  txqueuelen 1000  (Ethernet)
        RX packets 2329  bytes 752799 (735.1 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1031  bytes 645634 (630.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

vmbr1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet6 fe80::92b1:1cff:fe15:db90  prefixlen 64  scopeid 0x20<link>
        ether 90:b1:1c:15:db:90  txqueuelen 1000  (Ethernet)
        RX packets 1237  bytes 57448 (56.1 KiB)
        RX errors 0  dropped 2  overruns 0  frame 0
        TX packets 15  bytes 1166 (1.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

# network interface settings; autogenerated
# Please do NOT modify this file directly, unless you know what
# you're doing.
#
# If you want to manage part of the network configuration manually,
# please utilize the 'source' or 'source-directory' directives to do
# so.
# PVE will preserve these directives, but will NOT its network
# configuration from sourced files, so do not attempt to move any of
# the PVE managed interfaces into external files!

auto lo
iface lo inet loopback

iface eth0 inet manual
#MGMT

allow-vmbr1 eth1
iface eth1 inet manual
        ovs_type OVSPort
        ovs_bridge vmbr1

allow-vmbr1 eth2
iface eth2 inet manual
        ovs_type OVSPort
        ovs_bridge vmbr1

allow-vmbr1 eth3
iface eth3 inet manual
        ovs_type OVSPort
        ovs_bridge vmbr1

allow-vmbr1 bond0
iface bond0 inet manual
        ovs_type OVSBond
        ovs_bridge vmbr1
        ovs_options bond_mode=balance-tcp lacp=active
        mtu 9000
#802.3ad aggregation

auto vmbr0
iface vmbr0 inet static
        address  192.168.255.20
        netmask  255.255.255.0
        gateway  192.168.255.1
        bridge_ports eth0
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
        ovs_type OVSBridge
        ovs_ports eth1 eth2 eth3 bond0
        mtu 9000
#TRUNK
 
Bon giorno Giovanni!

You must use/setup the same MTU(9000) on the entire network stack from top to base: bridge -> any port-members(ethX, bondX). Also is not recomanded from pont of view of performance to mix network devices(phisical or software) with different MTU.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!