NIC Link up but no traffic flowing

akc360

New Member
Dec 13, 2024
1
0
1
Hello Proxmox Community,

I have been using Proxmox for about 2 years now and it is great. I have just been given a Mellanox ConnectX 4 Lx Dual port 25Gb NIC and installed it to my main server. Proxmox recognises the card and also recognises the link as 10Gb active which is correct. Unfortunately I can't seem to get any traffic to flow on this NIC. I have tried the NIC the same server same PCIe slot with Truenas Scale and can confirm the NIC works fine with that OS. Below are the server hardware and software info and also the anonimised (with x's) outputs of "ip a" and "/etc/network/interfaces/".

Xeon Silver 4214
AsrockRack EPC621D8A
Samsung RDIMM 64GB
Mellanox ConnectX 4 Lx Dual port 25Gb NIC latest firmware available
Proxmox 8.3-1

Bash:
auto lo
iface lo inet loopback

iface enp23s0 inet manual

iface enxfee07c3753c6 inet manual

iface ens20f0np0 inet manual

iface ens20f1np1 inet manual

auto vmbr0
iface vmbr0 inet static
        address 1xxxxx/24
        gateway 1xxxxx
        bridge-ports enp23s0
        bridge-stp off
        bridge-fd 0

auto vmbr1
iface vmbr1 inet manual
        bridge-ports ens20f0np0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids x-x
#10Gb Bridge

auto vmbr1.x
iface vmbr1.x inet static
        address 1xxxxx/24
#Admin VLANx

source /etc/network/interfaces.d/*

Bash:
root@prox1-mgmt:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute
       valid_lft forever preferred_lft forever
2: enp23s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
    link/ether xx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff
4: ens20f0np0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP group default qlen 1000
    link/ether xx:xx:xx:xx:xx:x brd ff:ff:ff:ff:ff:ff
    altname enp101s0f0np0
5: ens20f1np1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether xx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff
    altname enp101s0f1np1
6: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether xx:xx:xx:xx:xx:fc brd ff:ff:ff:ff:ff:ff
    inet 1xxxx/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 xxxx::xxxx:xxxx:xxxx:xx/64 scope link
       valid_lft forever preferred_lft forever
7: vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether xx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff
    inet6 xxxx::xxxx:xxxx:xxxx:xxxx/64 scope link
       valid_lft forever preferred_lft forever
8: vmbr1.x@vmbr1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/etherxx:xx:xx:xx:xx:xx brd ff:ff:ff:ff:ff:ff
    inet 1xxxx/24 scope global vmbr1.x
       valid_lft forever preferred_lft forever
    inet6 xxxx::xxxx:xxxx:xxxx:xxxx/64 scope link
       valid_lft forever preferred_lft forever
root@prox1-mgmt:~#

Any help greatly appreciated! unfortunately and am at the end of my skill level with this :(

Many Thanks

Alex
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!