[SOLVED] Enable SFP module

[unkn0wnDnS]

Hi all,

I'm re-using Cisco C240m4 for proxmox installation.
It all works great, but I'm unable to use my LOM ports..

I've been going through some forums but can't find anything really helpful, hopefully I can by making my own post <3


# lspci -nnk | grep -i net -A3

06:00.0 Ethernet controller [0200]: Cisco Systems Inc VIC Ethernet NIC [1137:0043] (rev a2)
    Subsystem: Cisco Systems Inc VIC 1227 PCIe Ethernet NIC [1137:012e]
    Kernel driver in use: enic
    Kernel modules: enic
07:00.0 Ethernet controller [0200]: Cisco Systems Inc VIC Ethernet NIC [1137:0043] (rev a2)
    Subsystem: Cisco Systems Inc VIC 1227 PCIe Ethernet NIC [1137:012e]
    Kernel driver in use: enic
    Kernel modules: enic
08:00.0 Fibre Channel [0c04]: Cisco Systems Inc VIC FCoE HBA [1137:0045] (rev a2)
--
0f:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
    DeviceName: LOM Port 1
    Subsystem: Cisco Systems Inc I350 Gigabit Network Connection [1137:00d6]
    Kernel driver in use: igb
    Kernel modules: igb
0f:00.1 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
    DeviceName: LOM Port 2
    Subsystem: Cisco Systems Inc I350 Gigabit Network Connection [1137:00d6]
    Kernel driver in use: igb
    Kernel modules: igb
7f:08.0 System peripheral [0880]: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 [8086:2f80] (rev 02)

This is the one I want to use:

0f:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
    DeviceName: LOM Port 1
    Subsystem: Cisco Systems Inc I350 Gigabit Network Connection [1137:00d6]
    Kernel driver in use: igb
    Kernel modules: igb

# ip link show

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2: enp6s0: <BROADCAST,MULTICAST> mtu 9000 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether cc:46:d6:c0:62:e5 brd ff:ff:ff:ff:ff:ff
3: enp7s0: <BROADCAST,MULTICAST> mtu 9000 qdisc noop state DOWN mode DEFAULT group default qlen 1000
    link/ether cc:46:d6:c0:62:e6 brd ff:ff:ff:ff:ff:ff
4: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr0 state UP mode DEFAULT group default qlen 1000
    link/ether 00:35:1a:0f:ab:0e brd ff:ff:ff:ff:ff:ff
    altname enp15s0f0
5: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:35:1a:0f:ab:0f brd ff:ff:ff:ff:ff:ff
    altname enp15s0f1
6: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT group default qlen 1000
    link/ether 00:35:1a:0f:ab:0e brd ff:ff:ff:ff:ff:ff

# lsmod | grep igb

igb                   290816  0
i2c_algo_bit           16384  2 igb,mgag200
dca                    16384  2 igb,ixgbe

# dmesg | grep igb

[    2.979228] igb: Intel(R) Gigabit Ethernet Network Driver
[    2.979232] igb: Copyright (c) 2007-2014 Intel Corporation.
[    2.982863] igb 0000:0f:00.0: PHY reset is blocked due to SOL/IDER session.
[    3.036326] igb 0000:0f:00.0: added PHC on eth0
[    3.036346] igb 0000:0f:00.0: Intel(R) Gigabit Ethernet Network Connection
[    3.036348] igb 0000:0f:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:35:1a:0f:ab:0e
[    3.036438] igb 0000:0f:00.0: eth0: PBA No: FFFFFF-0FF
[    3.036440] igb 0000:0f:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    3.037248] igb 0000:0f:00.1: PHY reset is blocked due to SOL/IDER session.
[    3.075832] igb 0000:0f:00.1: added PHC on eth1
[    3.075851] igb 0000:0f:00.1: Intel(R) Gigabit Ethernet Network Connection
[    3.075853] igb 0000:0f:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:35:1a:0f:ab:0f
[    3.075937] igb 0000:0f:00.1: eth1: PBA No: FFFFFF-0FF
[    3.075938] igb 0000:0f:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[    3.350002] igb 0000:0f:00.1 eno2: renamed from eth1
[    3.358127] igb 0000:0f:00.0 eno1: renamed from eth0
[   13.762328] igb 0000:0f:00.0 eno1: entered allmulticast mode
[   13.762382] igb 0000:0f:00.0 eno1: entered promiscuous mode
[   13.795894] igb 0000:0f:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   15.919089] igb 0000:0f:00.0: exceed max 2 second

This is not showing my LOM port

 

[cheiss]

Hi,

This is not showing my LOM port

What do you exactly are missing?

There are four NICs and four links shown by ip link.
E.g. either eno1 or eno2 should be the port, as can be seen from the dmesg output - probably eno1.
From the ip link output, looks like the enp6s0 and enp7s0 are probably the Cisco NICs with the enic driver, while for the two ports on the LOM card the igb driver is used - as you already found out.

 

[unkn0wnDnS]

Hi,


What do you exactly are missing?

There are four NICs and four links shown by ip link.
E.g. either eno1 or eno2 should be the port, as can be seen from the dmesg output - probably eno1.
From the ip link output, looks like the enp6s0 and enp7s0 are probably the Cisco NICs with the enic driver, while for the two ports on the LOM card the igb driver is used - as you already found out.

Ugh, I don't know how I missed it >.<

I was sure it was not coming on! But apparently it is..

# for i in `ip link show| grep -v link| grep -v 'lo:'| awk {'print $2'}| sed 's/://'`; do echo $i; ethtool -i $i; echo "#####" ;done

verified me the pci bus and interface.
I wrote more down here, but removing that now. As I got totally confused...

Settings for enp6s0:
    Supported ports: [ FIBRE ]
    Supported link modes:   10000baseT/Full
    Supported pause frame use: No
    Supports auto-negotiation: No
    Supported FEC modes: Not reported
    Advertised link modes:  10000baseT/Full
    Advertised pause frame use: No
    Advertised auto-negotiation: No
    Advertised FEC modes: Not reported
    Speed: 10000Mb/s
    Duplex: Full
    Auto-negotiation: off
    Port: FIBRE
    PHYAD: 0
    Transceiver: internal
        Current message level: 0x00000000 (0)

enp6s0 is exactly as I needed it to be and what I wanted to use! <3 Thanks for the patience