Can't get X540-AT2 quad port NIC to negotiate at 10Gb

mtlater

Member
Jun 27, 2022
2
0
6
I've been trying to get a X540-AT2 NIC to negotiate at 10Gb to a 10GbE switch (MokerLink 10G080GPTM) but I can only get 1Gb speeds with a 5ft cat6a cable. I've looked through some other posts here but none have solved the issue for me. I'm wondering what I'm missing. Some relevant data:

ip link output: interface is enp69s0f0

Code:
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: enp70s0f0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether d0:50:99:db:9f:8f brd ff:ff:ff:ff:ff:ff
3: enp74s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a0:36:9f:50:b6:d8 brd ff:ff:ff:ff:ff:ff
4: enp75s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether a0:36:9f:50:b6:d9 brd ff:ff:ff:ff:ff:ff
5: enp77s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether a0:36:9f:50:b6:da brd ff:ff:ff:ff:ff:ff
7: enp70s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether d0:50:99:db:9f:90 brd ff:ff:ff:ff:ff:ff
8: enp67s0f0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq master vmbr0 state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:e0:ed:7a:e5:79 brd ff:ff:ff:ff:ff:ff
9: enp67s0f1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq master vmbr0 state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:e0:ed:7a:e5:7a brd ff:ff:ff:ff:ff:ff
10: enp69s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP mode DEFAULT group default qlen 1000
    link/ether 00:e0:ed:7a:e5:7b brd ff:ff:ff:ff:ff:ff
11: enp69s0f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:e0:ed:7a:e5:7c brd ff:ff:ff:ff:ff:ff
13: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 00:e0:ed:7a:e5:79 brd ff:ff:ff:ff:ff:ff
14: tap100i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr100i0 state UNKNOWN mode DEFAULT group default qlen 1000
    link/ether 9e:fa:4d:6d:15:a4 brd ff:ff:ff:ff:ff:ff
15: fwbr100i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether fe:3f:fc:20:6c:78 brd ff:ff:ff:ff:ff:ff
16: fwpr100p0@fwln100i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 8a:24:f1:b9:56:88 brd ff:ff:ff:ff:ff:ff
17: fwln100i0@fwpr100p0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master fwbr100i0 state UP mode DEFAULT group default qlen 1000
    link/ether fe:3f:fc:20:6c:78 brd ff:ff:ff:ff:ff:ff
18: tap105i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr105i0 state UNKNOWN mode DEFAULT group default qlen 1000
    link/ether 4a:14:92:1c:43:97 brd ff:ff:ff:ff:ff:ff
19: fwbr105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether b6:e9:01:47:43:e6 brd ff:ff:ff:ff:ff:ff
20: fwpr105p0@fwln105i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 02:a0:fd:88:fa:8a brd ff:ff:ff:ff:ff:ff

ethtool enp69s0f0 output:

Code:
Settings for enp69s0f0:
        Supported ports: [ TP ]
        Supported link modes:   100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Supported pause frame use: Symmetric
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  100baseT/Full
                                1000baseT/Full
                                10000baseT/Full
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Speed: 1000Mb/s
        Duplex: Full
        Auto-negotiation: on
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        MDI-X: Unknown
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes

Port config in switch:
Screenshot 2025-02-16 230641.png
 
Try manually setting speed of the nic:
ethtool -s enp69s0f0 autoneg on speed 10000 duplex full
and on the switch, if possible.

Personally: I will never ever use again 10G over copper. Too many issues with incompatibilities between ports/sfp, crosstalk between neighbouring ports, overheating sfp modules, port flapping.... It is just not worth the trouble.
 
Try manually setting speed of the nic:
ethtool -s enp69s0f0 autoneg on speed 10000 duplex full
and on the switch, if possible.

Personally: I will never ever use again 10G over copper. Too many issues with incompatibilities between ports/sfp, crosstalk between neighbouring ports, overheating sfp modules, port flapping.... It is just not worth the trouble.
I appreciate the response. Even when I try manually setting the speed at both the NIC and the switch, the connection just drops. I wonder if it could be a driver issue with the NIC.