"Link down" with Mellanox ConnectX 6 Lx (MCX631102AN-ADAT)

Feb 20, 2021
87
9
13
For testing purposes we bought the card from the topic. It seems to work out of the box with pve7 as two interfaces shows up and can be configured, but i don't get a link using a fs SFP28-Module and a switch: when i try to bring the inferfaces up, it just says link down and the LED indikator on the switch and on the card shows no connection.


The SFP28-Modules are 25GBit but what i read they should work with 10G. I've tested this between two switches and there it works with 10G. I tried SFP+-Modules in the Network Card, different cables, etcetc but for some reason the link stays down. I tried to manually set to 1G and 10G but this doesn't work as well.

The firmware of the card is the latest.

Do you have an idea what i'm missing? Is the card incompatible to the linux 5.11 or just all SFP modules incompatible to the card? Or doesn't this work at all, SFP28-Port, SFP28-Module <-> SFP28 Module, 10GBit Switch Port?
 

Attachments

  • mlxconfig.txt
    10 KB · Views: 3
  • dmesg.txt
    2.4 KB · Views: 2
  • ethtool.txt
    1.5 KB · Views: 3
  • sfpinfo.txt
    4.6 KB · Views: 2
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!