HP Mellanox card visible, but not active

inf3rno

New Member
Jan 21, 2023
7
0
1
Hi!
I have a dual port QSFP+ HP Mellanox card. I can see both ports, but they are not active. Any idea how to make them active?

mstflint -d 0a:00.0 q
Code:
Image type: FS2
FW Version: 2.42.5052
FW Release Date: 7.7.2019
Product Version: 02.42.50.52
Rom Info: version_id=8025 type=CLP
type=UEFI version=14.11.49 cpu=AMD64
type=PXE version=3.4.754
Device ID: 4103
Description: Node Port1 Port2 Sys image
GUIDs: ... ... ... ...
MACs: ... ...
VSD:
PSID: HP_1370110017

dmesg | grep mlx4
Code:
[    1.092182] mlx4_core: Mellanox ConnectX core driver v4.0-0
[    1.092213] mlx4_core: Initializing 0000:0a:00.0
[    9.512279] mlx4_core 0000:0a:00.0: DMFS high rate steer mode is: disabled performance optimized steering
[    9.512482] mlx4_core 0000:0a:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0000:00:03.1 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)
[    9.613786] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.0-0
[    9.613902] mlx4_en 0000:0a:00.0: Activating port:1
[    9.615806] mlx4_en: 0000:0a:00.0: Port 1: Using 12 TX rings
[    9.615814] mlx4_en: 0000:0a:00.0: Port 1: Using 8 RX rings
[    9.616000] mlx4_en: 0000:0a:00.0: Port 1: Initializing port
[    9.616267] mlx4_en 0000:0a:00.0: registered PHC clock
[    9.617047] mlx4_core 0000:0a:00.0 enp10s0: renamed from eth0
[    9.617899] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.0-0
[    9.639778] <mlx4_ib> mlx4_ib_add: counter index 2 for port 1 allocated 1
[    9.639783] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   14.168134] mlx4_en 0000:0a:00.0: removed PHC
[   14.170863] mlx4_en 0000:0a:00.0: Activating port:2
[   14.172633] mlx4_en: 0000:0a:00.0: Port 2: Using 12 TX rings
[   14.172639] mlx4_en: 0000:0a:00.0: Port 2: Using 8 RX rings
[   14.172828] mlx4_en: 0000:0a:00.0: Port 2: Initializing port
[   14.173096] mlx4_en 0000:0a:00.0: registered PHC clock
[   14.173573] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   14.173577] <mlx4_ib> mlx4_ib_add: counter index 3 for port 2 allocated 1
[   14.174692] mlx4_core 0000:0a:00.0 enp10s0d1: renamed from eth0
[   18.656484] mlx4_en 0000:0a:00.0: removed PHC
[   18.659291] mlx4_en 0000:0a:00.0: Activating port:1
[   18.660841] mlx4_en: 0000:0a:00.0: Port 1: Using 12 TX rings
[   18.660845] mlx4_en: 0000:0a:00.0: Port 1: Using 8 RX rings
[   18.661066] mlx4_en: 0000:0a:00.0: Port 1: Initializing port
[   18.666007] mlx4_en 0000:0a:00.0: registered PHC clock
[   18.666577] <mlx4_ib> mlx4_ib_add: counter index 4 for port 1 allocated 1
[   18.666581] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   18.667812] mlx4_core 0000:0a:00.0 enp10s0: renamed from eth0
[   22.873870] mlx4_en 0000:0a:00.0: removed PHC
[   22.876841] mlx4_en 0000:0a:00.0: Activating port:2
[   22.878478] mlx4_en: 0000:0a:00.0: Port 2: Using 12 TX rings
[   22.878483] mlx4_en: 0000:0a:00.0: Port 2: Using 8 RX rings
[   22.878669] mlx4_en: 0000:0a:00.0: Port 2: Initializing port
[   22.880373] mlx4_en 0000:0a:00.0: registered PHC clock
[   22.880904] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   22.880909] <mlx4_ib> mlx4_ib_add: counter index 5 for port 2 allocated 1
[   22.882058] mlx4_core 0000:0a:00.0 enp10s0d1: renamed from eth0
[   27.698321] mlx4_en 0000:0a:00.0: removed PHC
[   27.701367] mlx4_en 0000:0a:00.0: Activating port:1
[   27.702978] mlx4_en: 0000:0a:00.0: Port 1: Using 12 TX rings
[   27.702983] mlx4_en: 0000:0a:00.0: Port 1: Using 8 RX rings
[   27.703159] mlx4_en: 0000:0a:00.0: Port 1: Initializing port
[   27.705446] mlx4_en 0000:0a:00.0: registered PHC clock
[   27.705955] <mlx4_ib> mlx4_ib_add: counter index 6 for port 1 allocated 1
[   27.705961] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   27.707053] mlx4_core 0000:0a:00.0 enp10s0: renamed from eth0
[   32.658505] mlx4_en 0000:0a:00.0: removed PHC
[   32.661345] mlx4_en 0000:0a:00.0: Activating port:2
[   32.662944] mlx4_en: 0000:0a:00.0: Port 2: Using 12 TX rings
[   32.662948] mlx4_en: 0000:0a:00.0: Port 2: Using 8 RX rings
[   32.663136] mlx4_en: 0000:0a:00.0: Port 2: Initializing port
[   32.665227] mlx4_en 0000:0a:00.0: registered PHC clock
[   32.665701] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   32.665705] <mlx4_ib> mlx4_ib_add: counter index 7 for port 2 allocated 1
[   32.666797] mlx4_core 0000:0a:00.0 enp10s0d1: renamed from eth0
[   37.282530] mlx4_en 0000:0a:00.0: removed PHC
[   37.285178] mlx4_en 0000:0a:00.0: Activating port:1
[   37.286706] mlx4_en: 0000:0a:00.0: Port 1: Using 12 TX rings
[   37.286712] mlx4_en: 0000:0a:00.0: Port 1: Using 8 RX rings
[   37.286937] mlx4_en: 0000:0a:00.0: Port 1: Initializing port
[   37.290885] mlx4_en 0000:0a:00.0: registered PHC clock
[   37.291460] <mlx4_ib> mlx4_ib_add: counter index 8 for port 1 allocated 1
[   37.291464] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   37.292595] mlx4_core 0000:0a:00.0 enp10s0: renamed from eth0
[   42.174517] mlx4_en 0000:0a:00.0: removed PHC
[   42.177403] mlx4_en 0000:0a:00.0: Activating port:2
[   42.179000] mlx4_en: 0000:0a:00.0: Port 2: Using 12 TX rings
[   42.179004] mlx4_en: 0000:0a:00.0: Port 2: Using 8 RX rings
[   42.179192] mlx4_en: 0000:0a:00.0: Port 2: Initializing port
[   42.180958] mlx4_en 0000:0a:00.0: registered PHC clock
[   42.181436] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[   42.181443] <mlx4_ib> mlx4_ib_add: counter index 9 for port 2 allocated 1
[   42.182582] mlx4_core 0000:0a:00.0 enp10s0d1: renamed from eth0
[   47.134568] mlx4_en 0000:0a:00.0: removed PHC
[   47.137696] mlx4_en 0000:0a:00.0: Activating port:1
[   47.139301] mlx4_en: 0000:0a:00.0: Port 1: Using 12 TX rings
[   47.139306] mlx4_en: 0000:0a:00.0: Port 1: Using 8 RX rings
[   47.139481] mlx4_en: 0000:0a:00.0: Port 1: Initializing port
[   47.141685] mlx4_en 0000:0a:00.0: registered PHC clock
[   47.142161] <mlx4_ib> mlx4_ib_add: counter index 10 for port 1 allocated 1
[   47.142166] <mlx4_ib> mlx4_ib_add: counter index 1 for port 2 allocated 0
[   47.143364] mlx4_core 0000:0a:00.0 enp10s0: renamed from eth0
 
I tried out a few things, but still I did not manage to make the cards active. :S
 
Code:
auto lo
iface lo inet loopback

iface enp9s0 inet manual

iface wlp8s0 inet manual

auto enp10s0
iface enp10s0 inet static
        address 192.168.2.124/24

auto enp10s0d1
iface enp10s0d1 inet static
        address 192.168.2.125/24

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.124/24
        gateway 192.168.1.1
        bridge-ports enp9s0
        bridge-stp off
        bridge-fd 0

auto vmbr1
iface vmbr1 inet static
        address 192.168.2.124/24
        bridge-ports ensp10s0
        bridge-stp off
        bridge-fd 0

auto vmbr2
iface vmbr2 inet static
        address 192.168.2.125/24
        bridge-ports ensp10s0d1
        bridge-stp off
        bridge-fd 0

Code:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: enp9s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP group default qlen 1000
    link/ether a8:xx:xx:xx:xx:ed brd ff:ff:ff:ff:ff:ff
4: wlp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 98:xx:xx:xx:xx:d3 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether a8:xx:xx:xx:xx:ed brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.124/24 scope global vmbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::xxxx:xxxx:xxxx:xxxx/64 scope link
       valid_lft forever preferred_lft forever
6: vmbr1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 52:xx:xx:xx:xx:05 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.124/24 scope global vmbr1
       valid_lft forever preferred_lft forever
7: vmbr2: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether a2:xx:xx:xx:xx:61 brd ff:ff:ff:ff:ff:ff
    inet 192.168.2.125/24 scope global vmbr2
       valid_lft forever preferred_lft forever
204: enp10s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 94:xx:xx:xx:xx:31 brd ff:ff:ff:ff:ff:ff
205: enp10s0d1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether 94:xx:xx:xx:xx:32 brd ff:ff:ff:ff:ff:ff
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!