I just ran into trouble with enabling multicast on the OVSIntPorts.
My cluster network uses 2 Intel 10G ports bonded together, 1 Bridge, 2 IntPorts. On the switch side I added a trunk and enabled jumboframes. After setting (according to the wiki) MTU to 8996 ceph cluster stops working, while proxmox/corosync still works. Ping with frames smaller than 1500 work fine. When I do a ping with bigger frames I get an error.
The interfaces are announced to use MTU 8996, when I ask ifconfig.
Obviously Jumboframes do not work properly. Has somebody an idea?
I added my network config. Im running the latest Proxmox version.
My cluster network uses 2 Intel 10G ports bonded together, 1 Bridge, 2 IntPorts. On the switch side I added a trunk and enabled jumboframes. After setting (according to the wiki) MTU to 8996 ceph cluster stops working, while proxmox/corosync still works. Ping with frames smaller than 1500 work fine. When I do a ping with bigger frames I get an error.
Code:
ping -M do -s 8972 10.10.1.2
ping: local error: Message too long, mtu=1500The interfaces are announced to use MTU 8996, when I ask ifconfig.
Obviously Jumboframes do not work properly. Has somebody an idea?
I added my network config. Im running the latest Proxmox version.
Code:
allow-vmbr1 bond0
iface bond0 inet manual
ovs_bonds eth1 eth3
ovs_type OVSBond
ovs_bridge vmbr1
pre-up ( ifconfig eth1 mtu 8996 && ifconfig eth3 mtu 8996 )
ovs_options bond_mode=balance-tcp lacp=active other_config:lacp-time=fast
mtu 8996
auto vmbr1
iface vmbr1 inet manual
ovs_type OVSBridge
ovs_ports bond0 coro ceph ceph_priv
mtu 8996
#Corosync
allow-vmbr1 coro
iface coro inet static
ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif
address 10.10.1.1
netmask 255.255.255.0
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options vlan_mode=native-untagged
mtu 1500
#Ceph public (OSD Traffic, Monitor traffic)
allow-vmbr1 ceph
iface ceph inet static
ovs_extra set interface ${IFACE} external-ids:iface-id=$(hostname -s)-${IFACE}-vif
address 10.10.2.1
netmask 255.255.255.0
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options vlan_mode=native-untagged
mtu 8996
#Ceph private (heartbeat, replication, recovery)
allow-vmbr1 ceph_priv
iface ceph_priv inet static
address 10.10.3.1
netmask 255.255.255.0
ovs_type OVSIntPort
ovs_bridge vmbr1
ovs_options vlan_mode=native-untagged
mtu 8996
Last edited: