Can't get a 10gb interface to work

[SteveT1970]

Last year I built a DIY NAS using a motherboard that had a 10Gb port on it. Since then I've been slowly updating my home network to 10Gb.

Now I've got a (second hand but known to be working) 10gb card which I've put in to my (existing) Proxmox server. Powered it back on and the OS and Proxmox can see it

# dmesg | grep ixgbe
[    1.674984] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[    1.674985] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    1.675082] ixgbe 0000:02:00.0: enabling device (0100 -> 0102)
[    2.856561] ixgbe 0000:02:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    2.856851] ixgbe 0000:02:00.0: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    2.856932] ixgbe 0000:02:00.0: MAC: 2, PHY: 1, PBA No: E68785-007
[    2.856933] ixgbe 0000:02:00.0: 90:e2:ba:55:7d:30
[    2.857988] ixgbe 0000:02:00.0: Intel(R) 10 Gigabit Network Connection
[    2.858048] libphy: ixgbe-mdio: probed
[    2.858116] ixgbe 0000:02:00.1: enabling device (0100 -> 0102)
[    4.040525] ixgbe 0000:02:00.1: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    4.040812] ixgbe 0000:02:00.1: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    4.040893] ixgbe 0000:02:00.1: MAC: 2, PHY: 1, PBA No: E68785-007
[    4.040895] ixgbe 0000:02:00.1: 90:e2:ba:55:7d:31
[    4.041895] ixgbe 0000:02:00.1: Intel(R) 10 Gigabit Network Connection
[    4.041914] libphy: ixgbe-mdio: probed
[    4.042942] ixgbe 0000:02:00.0 enp2s0f0: renamed from eth0
[    4.056133] ixgbe 0000:02:00.1 enp2s0f1: renamed from eth1
[   48.452392] ixgbe 0000:02:00.0: complete
[   48.620418] ixgbe 0000:02:00.1: complete

But if I try and do anything with it (the above picture is just one combination) I get same error message when I try and apply it

error: vmbr1: bridge port enp2s0f1 does not exist

It obviously does exist! It doesn't show up with

ip link show up

either. At the moment in /etc/network/interfaces eno1/enp2s0f1 and vmbr0/vmbr1 are identical except for the gateway as shown.

An afternoon of guessing and Googling hasn't moved me any closer to a solution so I'm hoping someone here can spot what I've missed.

Thanks!

 

[psionic]

Last year I built a DIY NAS using a motherboard that had a 10Gb port on it. Since then I've been slowly updating my home network to 10Gb.

Now I've got a (second hand but known to be working) 10gb card which I've put in to my (existing) Proxmox server. Powered it back on and the OS and Proxmox can see it

# dmesg | grep ixgbe
[    1.674984] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k
[    1.674985] ixgbe: Copyright (c) 1999-2016 Intel Corporation.
[    1.675082] ixgbe 0000:02:00.0: enabling device (0100 -> 0102)
[    2.856561] ixgbe 0000:02:00.0: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    2.856851] ixgbe 0000:02:00.0: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    2.856932] ixgbe 0000:02:00.0: MAC: 2, PHY: 1, PBA No: E68785-007
[    2.856933] ixgbe 0000:02:00.0: 90:e2:ba:55:7d:30
[    2.857988] ixgbe 0000:02:00.0: Intel(R) 10 Gigabit Network Connection
[    2.858048] libphy: ixgbe-mdio: probed
[    2.858116] ixgbe 0000:02:00.1: enabling device (0100 -> 0102)
[    4.040525] ixgbe 0000:02:00.1: Multiqueue Enabled: Rx Queue count = 40, Tx Queue count = 40 XDP Queue count = 0
[    4.040812] ixgbe 0000:02:00.1: 32.000 Gb/s available PCIe bandwidth (5 GT/s x8 link)
[    4.040893] ixgbe 0000:02:00.1: MAC: 2, PHY: 1, PBA No: E68785-007
[    4.040895] ixgbe 0000:02:00.1: 90:e2:ba:55:7d:31
[    4.041895] ixgbe 0000:02:00.1: Intel(R) 10 Gigabit Network Connection
[    4.041914] libphy: ixgbe-mdio: probed
[    4.042942] ixgbe 0000:02:00.0 enp2s0f0: renamed from eth0
[    4.056133] ixgbe 0000:02:00.1 enp2s0f1: renamed from eth1
[   48.452392] ixgbe 0000:02:00.0: complete
[   48.620418] ixgbe 0000:02:00.1: complete

View attachment 14241

But if I try and do anything with it (the above picture is just one combination) I get same error message when I try and apply it

error: vmbr1: bridge port enp2s0f1 does not exist

It obviously does exist! It doesn't show up with

ip link show up

either. At the moment in /etc/network/interfaces eno1/enp2s0f1 and vmbr0/vmbr1 are identical except for the gateway as shown.

An afternoon of guessing and Googling hasn't moved me any closer to a solution so I'm hoping someone here can spot what I've missed.

Thanks!

Do you have autostart box checked for all your network devices? Inside popup when editing in GUI?

 

[SteveT1970]

I'm using bridges so the physical devices shouldn't need to autostart.

Update: Tried it anyway, still get the "error: vmbr1: bridge port enp2s0f1 does not exist" error

 

[psionic]

I'm using bridges so the physical devices shouldn't need to autostart.

Update: Tried it anyway, still get the "error: vmbr1: bridge port enp2s0f1 does not exist" error

You could also for troubleshooting purposes assign IPs directly to the interfaces to test connectivity...

 

[SteveT1970]

Found it. I have to add ixgbe to /etc/modules and restart.

 

[psionic]

Found it. I have to add ixgbe to /etc/modules and restart.

Strange, checked /etc/modules file on my nodes and none of them have any entries. I have 6 10G, 2 ixgbe and 4 i40e nic ports on each node.

 

[SteveT1970]

It might be that your cards are directly compatible with Debian. Mine obviously aren't and need the ixgbe driver loaded to function.

https://www.intel.co.uk/content/www...005688/network-and-i-o/ethernet-products.html

 

[mbosma]

Could you show the output of cat /etc/network/interfaces?