Error I40E_AQ_RC_ENOSPC, forcing overflow promiscuous on PF

For me issue kinda went away at some point with kernel upgrade, and I've just got plenty of that messages in syslog during bootup. I've also tried to upgrade X710 firmware a month ago with no improvement.
 
I manually loaded the driver under kernel 6.8.
Starting from 6.11, the issue disappeared on its own. I haven’t tested 6.14.
 
Urbaman said:
Also had the problem, with the system also going stale (backups to NFS storage blocked..)
Click to expand...
Code: 
journalctl -b-1
PVE-Backup: error fetching datastores - 500 Can't connect <---- Good times!

Code: 
dmesg | less
i40e 0000:03:00.0: Error I40E_AQ_RC_ENOSPC, forcing overflow promiscuous on PF <--- Snazzy! (PF=Physical Function (FYI))

Code: 
dmesg -Hl err -f kern
i40e 0000:03:00.0: Invalid VF Identifier 0 <------ Hmmm. "Invalid" Indeed! (VF=Virtual Function)

... who is this troubled 0000:3:00.0 I wonder...
Code: 
ls -l /sys/class/net/
enp3s0f0np0 -> ../../devices/pci0000:00/0000:00:06.2/0000:03:00.0/net/enp3s0f0np0
Ahhh the ole "VM-Private" IF w/ vmbr2 - super!

Xedon said:
I was only able to reproduce the problem with cards that have firmware version 9.40.
Click to expand...
Code: 
ethtool -i enp3s0f0np0
driver: i40e
version: 6.8.12-10-pve
firmware-version: 9.40 0x8000ecd6 0.0.0 <------- Lucky Me!

What is enabled/disabled??
Code: 
ethtool -k enp3s0f1np1 | grep rx-vlan
rx-vlan-offload: on
rx-vlan-filter: on [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]

tomtom13 said:
I've had similar problems and I've changed the interfaces file to what you have here, with only difference being:
Code: 
bridge-vids 2-4094
And today one of the the servers decided to spew..
Click to expand...

Code: 
cat /etc/network/interfaces
iface vmbr2 inet static
bridge-vlan-aware yes
bridge-vids 2-4094 <----- Hmm when did I set that?

iprowell said:
I updated /etc/network/interfaces as below, and it solved the problem...

Code: 
...
        bridge-vids 10 11 12 ...
        offload-rx-vlan-filter off
Click to expand...
&
Xedon said:
The problem should be solved with a newer driver: https://github.com/intel/ethernet-linux-i40e/releases/tag/v2.27.8
Click to expand...

Oh that Readme from Intel looks like a sexy bit of late night reading - Joy!

Once I wake up 5 times while reading, then get that hot new v2.27.8 driver slapped on and, get that config corrected, I'll report back. Thank you everyone from 2020 until today for sharing your findings <3
 
  • Like
Reactions: itNGO and xenon96
J-dub said:
Code: 
journalctl -b-1
PVE-Backup: error fetching datastores - 500 Can't connect <---- Good times!

Code: 
dmesg | less
i40e 0000:03:00.0: Error I40E_AQ_RC_ENOSPC, forcing overflow promiscuous on PF <--- Snazzy! (PF=Physical Function (FYI))

Code: 
dmesg -Hl err -f kern
i40e 0000:03:00.0: Invalid VF Identifier 0 <------ Hmmm. "Invalid" Indeed! (VF=Virtual Function)

... who is this troubled 0000:3:00.0 I wonder...
Code: 
ls -l /sys/class/net/
enp3s0f0np0 -> ../../devices/pci0000:00/0000:00:06.2/0000:03:00.0/net/enp3s0f0np0
Ahhh the ole "VM-Private" IF w/ vmbr2 - super!


Code: 
ethtool -i enp3s0f0np0
driver: i40e
version: 6.8.12-10-pve
firmware-version: 9.40 0x8000ecd6 0.0.0 <------- Lucky Me!

What is enabled/disabled??
Code: 
ethtool -k enp3s0f1np1 | grep rx-vlan
rx-vlan-offload: on
rx-vlan-filter: on [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]



Code: 
cat /etc/network/interfaces
iface vmbr2 inet static
bridge-vlan-aware yes
bridge-vids 2-4094 <----- Hmm when did I set that?


&


Oh that Readme from Intel looks like a sexy bit of late night reading - Joy!

Once I wake up 5 times while reading, then get that hot new v2.27.8 driver slapped on and, get that config corrected, I'll report back. Thank you everyone from 2020 until today for sharing your findings <3
Click to expand...
Any update on this?
 
itNGO said:
Any update on this?
Click to expand...
Yes! Sorry I got distracted..

I think the error is solved simply by changing the VLAN IDs setting (under each node's Networking --> vmbr*) from 2-4096 to whatever you're actually using.
So long as you don't have hundreds of VLANs...
If you do, you need to disable VLAN offloading to the NIC and instead use the CPU.
The 700 series NICs can only handle so many VLANs.

I gave it all an update
Bash: 
apt update && apt full-upgrade -y && apt autoremove -y && apt clean
I also updated the NIC driver...

Bash: 
wget https://github.com/intel/ethernet-linux-i40e/releases/download/v2.28.6/i40e-2.28.6.tar.gz

tar zxf i40e-2.28.6.tar.gz

rm i40e-2.28.6.tar.gz

cd i40e-2.28.6/src/

make install

update-initramfs -u

reboot

modinfo i40e

... and then the firmware of the NIC

Bash: 
apt install unzip -y

wget https://downloadmirror.intel.com/853788/700Series_NVMUpdatePackage_v9_54.zip

unzip 700Series_NVMUpdatePackage_v9_54.zip

tar zxf 700Series_NVMUpdatePackage_v9_54_Linux.tar.gz

rm 700Series_NVMUpdatePackage_v9_54_EFI.zip
rm 700Series_NVMUpdatePackage_v9_54_ESX.tar.gz
rm 700Series_NVMUpdatePackage_v9_54_FreeBSD.tar.gz
rm 700Series_NVMUpdatePackage_v9_54_Windows.zip
rm 700Series_NVMUpdatePackage_v9_54.zip
rm 700Series_NVMUpdatePackage_v9_54_Linux.tar.gz

cd 700Series/Linux_x64

chmod 755 nvmupdate64e

./nvmupdate64e

Select your NIC
01
Make a backup..
Y

<any key>

reboot

Everything is all good now!
 
  • Like
Reactions: itNGO and aRaRa_70
You must log in or register to reply here.
Top Bottom