Kernel 4.15.18-9 incompatible with 10 Gbps card

I'm pretty sure we saw exactly this sort of behavior ourselves on the embedded SFP+ Intel 10G ports of a set of 3 supermicro servers we have when we upgraded from the 4.4 to 4.15 kernel during a proxmox upgrade. The motherboard they were built into was the X10SDV-TP8F. We technically had issues on the older 4.4 kernel too, but we could run 'ethtool -t $iface' and it would magically come up, so we put that in our /etc/network/interfaces as a pre-up script ... that hack stopped working with the 4.15 kernel.

We contacted supermicro and they sent us firmware updates to flash to the NIC, etc. Nothing worked.

We ended up biting the bullet and purchased X710-DA2 cards and stopped using the onboard NICs. We used all the same cables and switches and everything worked with the new NICs. It was one of the weirdest things I've ever seen.

Code:
lspci | grep SFP
04:00.0 Ethernet controller: Intel Corporation Ethernet Connection X552 10 GbE SFP+
04:00.1 Ethernet controller: Intel Corporation Ethernet Connection X552 10 GbE SFP+

[root@proxmox1.p10atl ~]# ethtool -i eno7
driver: ixgbe
version: 5.1.0-k
firmware-version: 0x800006b1
expansion-rom-version:
bus-info: 0000:04:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
[root@proxmox1.p10atl ~]# ethtool -i eno8
driver: ixgbe
version: 5.1.0-k
firmware-version: 0x800006b1
expansion-rom-version:
bus-info: 0000:04:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
 
Last edited:
well.... if it is embedded nic... then it is more of motherboard vendor issue/firmware
You know what they say about assumptions ... evidence in my case showed different behavior from different driver versions in the kernel.
 
Can someone give me advice about the problem I'm having?
I would at least recommend compiling and installing the latest official intel ixgbe driver and seeing if it magically resolves your issue. If so, maybe the proxmox guys can either bundle the newer version, or maybe switch to a newer kernel that already bundles a newer driver.
https://downloadcenter.intel.com/download/14687
 
  • Like
Reactions: elurex
I would at least recommend compiling and installing the latest official intel ixgbe driver and seeing if it magically resolves your issue. If so, maybe the proxmox guys can either bundle the newer version, or maybe switch to a newer kernel that already bundles a newer driver.
https://downloadcenter.intel.com/download/14687

yes.... try to compile your own ixgbe driver might be alternative solution
 
I tried rebuilding ixgbe-5.5.3 and encountered an error
Code:
root@node03:/usr/local/src/ixgbe-5.5.3/src# make install
common.mk:81: *** Kernel header files not in any of the expected locations.
common.mk:82: *** Install the appropriate kernel development package, e.g.
common.mk:83: *** kernel-devel, for building kernel modules and try again.  Stop.

Code:
root@node03:/usr/local/src/ixgbe-5.5.3/src# apt install linux-headers-$(uname -r)
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package linux-headers-4.15.18-9-pve
E: Couldn't find any package by glob 'linux-headers-4.15.18-9-pve'
E: Couldn't find any package by regex 'linux-headers-4.15.18-9-pve'
root@node03:/usr/local/src/ixgbe-5.5.3/src# apt-get install linux-headers-$(uname -r)
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package linux-headers-4.15.18-9-pve
E: Couldn't find any package by glob 'linux-headers-4.15.18-9-pve'
E: Couldn't find any package by regex 'linux-headers-4.15.18-9-pve'
 
just guessing from the error-messages - I guess you haven't installed the header-packges - for PVE the name of the package is
`pve-headers` (or for that version pve-headers-4.15.18-9-pve)

hope that helps
 
@Stoiko Ivanov tks for reply, but pve can not find package is pve-headers.
Code:
root@node03:~# apt-get install pve-headers-4.15.18-9-pve
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package pve-headers-4.15.18-9-pve
E: Couldn't find any package by glob 'pve-headers-4.15.18-9-pve'
E: Couldn't find any package by regex 'pve-headers-4.15.18-9-pve'
root@node03:~# apt-get install pve-headers
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package pve-headers
 
Seems you do not have a valid update repository configured?

Please run:

> apt update

and post the full output.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!