Message too long, mtu=1500 on OVSInt Port

[chris_lee]

I just ran into trouble with enabling multicast on the OVSIntPorts.
My cluster network uses 2 Intel 10G ports bonded together, 1 Bridge, 2 IntPorts. On the switch side I added a trunk and enabled jumboframes. After setting (according to the wiki) MTU to 8996 ceph cluster stops working, while proxmox/corosync still works. Ping with frames smaller than 1500 work fine. When I do a ping with bigger frames I get an error.

ping -M do -s 8972 10.10.1.2
ping: local error: Message too long, mtu=1500

The interfaces are announced to use MTU 8996, when I ask ifconfig.
Obviously Jumboframes do not work properly. Has somebody an idea?


I added my network config. Im running the latest Proxmox version.

allow-vmbr1 bond0
iface bond0 inet manual
        ovs_bonds eth1 eth3
        ovs_type OVSBond
        ovs_bridge vmbr1
        pre-up ( ifconfig eth1 mtu 8996 && ifconfig eth3 mtu 8996 )
        ovs_options bond_mode=balance-tcp lacp=active other_config:lacp-time=fast
        mtu 8996
     
auto vmbr1
iface vmbr1 inet manual
        ovs_type OVSBridge
        ovs_ports bond0 coro ceph ceph_priv
        mtu 8996

#Corosync
allow-vmbr1 coro
iface coro inet static
        ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif
        address  10.10.1.1
        netmask  255.255.255.0
        ovs_type OVSIntPort
        ovs_bridge vmbr1
        ovs_options vlan_mode=native-untagged
        mtu 1500

#Ceph public (OSD Traffic, Monitor traffic)     
allow-vmbr1 ceph
iface ceph inet static
        ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif
        address  10.10.2.1
        netmask  255.255.255.0
        ovs_type OVSIntPort
        ovs_bridge vmbr1
        ovs_options vlan_mode=native-untagged
        mtu 8996

#Ceph private (heartbeat, replication, recovery)
allow-vmbr1 ceph_priv
iface ceph_priv inet static
        address  10.10.3.1
        netmask  255.255.255.0
        ovs_type OVSIntPort
        ovs_bridge vmbr1
        ovs_options vlan_mode=native-untagged
        mtu 8996