PVE 6.0-7 + ixgbe firmware errors

dm15

New Member
Mar 4, 2018
13
3
3
79
Since yesterday I am getting the following error spam in kernel messages:

[44650.577580] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000
[44650.741545] ixgbe 0000:05:00.1: Warning firmware error detected FWSM: 0x00000000
[44652.593549] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000
[44652.753532] ixgbe 0000:05:00.1: Warning firmware error detected FWSM: 0x00000000
[44654.609580] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000
[44654.769600] ixgbe 0000:05:00.1: Warning firmware error detected FWSM: 0x00000000
[44656.625582] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000
[44656.785601] ixgbe 0000:05:00.1: Warning firmware error detected FWSM: 0x00000000
[44658.641640] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000
[44658.801585] ixgbe 0000:05:00.1: Warning firmware error detected FWSM: 0x00000000
[44660.657626] ixgbe 0000:05:00.0: Warning firmware error detected FWSM: 0x00000000

The NICs (05:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)) randomly hang without any state changes, `ip link set ... up` brings them back without reboot.

The current PVE ixgbe driver looks a little bit outdated

# ethtool -i enp5s0f0
driver: ixgbe
version: 5.1.0-k
firmware-version: 0x000118b3
because the lastest version is 5.6.3, which is far away from being actual.

Also got the following errors on the login screen today

Screenshot from 2019-10-01 13-00-17.png

I think all those indicate that ixgbe driver included in the current kernel is outdated (5.0.21-2-pve #1 SMP PVE 5.0.21-6 (Fri, 27 Sep 2019 17:17:02 +0200) x86_64 GNU/Linux)

Is there any possibility you can ship an updated ixgbe driver within next update?

related: These NICs on CentOS with the same ixgbe driver version have same behaviour - https://bugs.centos.org/view.php?id=16495

p.s. just noticed that this could be a wrong forum to report this and 'Networking and firewall' would be more appropriate, moderators please move my topic if you feel like
 
Last edited:

dm15

New Member
Mar 4, 2018
13
3
3
79
I've just compiled the latest version of ixgbe driver from the Intel download site, installed it and rebooted the server, will report here if the firmware errors return.

# ethtool -i enp5s0f0
driver: ixgbe
version: 5.6.3
firmware-version: 0x18b30001
expansion-rom-version:
bus-info: 0000:05:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
 

stark

New Member
Feb 23, 2019
8
2
3
46
Since yesterday I am getting the following error spam in kernel messages:




The NICs (05:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)) randomly hang without any state changes, `ip link set ... up` brings them back without reboot.

The current PVE ixgbe driver looks a little bit outdated



because the lastest version is 5.6.3, which is far away from being actual.

Also got the following errors on the login screen today

View attachment 12067

I think all those indicate that ixgbe driver included in the current kernel is outdated (5.0.21-2-pve #1 SMP PVE 5.0.21-6 (Fri, 27 Sep 2019 17:17:02 +0200) x86_64 GNU/Linux)

Is there any possibility you can ship an updated ixgbe driver within next update?

related: These NICs on CentOS with the same ixgbe driver version have same behaviour - https://bugs.centos.org/view.php?id=16495

p.s. just noticed that this could be a wrong forum to report this and 'Networking and firewall' would be more appropriate, moderators please move my topic if you feel like
I get these errors as well. Though, for me, they don't appear to be causing any issues. I just filter them out so they don't make it to my logfiles and just put up with the syslog spam.
 

stark

New Member
Feb 23, 2019
8
2
3
46
I went ahead and compiled the driver from source and the errors went away. Have you thought about installing DKMS to keep the driver current with each new kernel release?
 

dm15

New Member
Mar 4, 2018
13
3
3
79
i Have the same error on this network-card. but in my case, the interfaces and Ceph monitors fall.
Yeah was my case as well. Compiling & installing this driver resolves the problem, proofed by me (reply #2) & stark (reply #4)


Have you thought about installing DKMS to keep the driver current with each new kernel release?
No, I did it on my production machine and was afraid installing with DKMS would break something... I will probably test it on a non-production machine and report back.
 
  • Like
Reactions: stark

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!