SDN OpenFabric set MTU?

MarvinE

Well-Known Member
Jan 16, 2020
123
17
58
28
Hello,

I want to set the MTU to 9000 (Jumbo Frames) for my 40Gbit/s OpenFabic, is there any prefferd way to do this with SDN?
https://pve.proxmox.com/wiki/Full_Mesh_Network_for_Ceph_Server#Using_SDN_Fabrics

I already has set it for the Nics in /etc/network/interfaces but fabric stays at MTU 1500:

Code:
2: ens3f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP group default qlen 1000
3: ens3f1np1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP group default qlen 1000
11: dummy_40G: <BROADCAST,NOARP,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000

Thanks.
 
does editing both /etc/network/interfaces and /etc/network/interfaces.d/sdn is the correct way to go?

/etc/network/interfaces
iface nic3 inet manual
mtu 9000

iface nic4 inet manual
mtu 9000


/etc/network/interfaces.d/sdn
#version:3

auto dummy_cephnet
iface dummy_cephnet inet static
address 10.10.10.1/32
link-type dummy
ip-forward 1
mtu 9000

auto nic3
iface nic3 inet static
address 0.10.10.1/32
ip-forward 1
mtu 9000

auto nic4
iface nic4 inet static
address 10.10.10.1/32
ip-forward 1
mtu 9000
 
does editing both /etc/network/interfaces and /etc/network/interfaces.d/sdn is the correct way to go?

/etc/network/interfaces
iface nic3 inet manual
mtu 9000

iface nic4 inet manual
mtu 9000


/etc/network/interfaces.d/sdn
#version:3

auto dummy_cephnet
iface dummy_cephnet inet static
address 10.10.10.1/32
link-type dummy
ip-forward 1
mtu 9000

auto nic3
iface nic3 inet static
address 0.10.10.1/32
ip-forward 1
mtu 9000

auto nic4
iface nic4 inet static
address 10.10.10.1/32
ip-forward 1
mtu 9000

I added mtu only to /etc/network/interfaces seams to work.

Code:
iface ens3f0np0 inet manual
    mtu 9000

iface ens3f1np1 inet manual
    mtu 9000

iface dummy_40G
    mtu 9000
 
/etc/network/interfaces.d/sdn will be overwritten by the sdn stack, so adding the mtu in /etc/network/interfaces is correct. ifupdown2 will merge the config on reload.