Intel E810 NIC's

[adamb]

Anyone else using any of these E810 based NICs (25G & 100G)?

They are using the ice driver.

They show up in proxmox and look ok, but I can't for the life of me get them to light up.

Nothing in dmesg or any of the logs about transceiver mis matches.

Figured id see if anyone else is using them.

So far I have tried the latest 5.15 kernel and 6.1.x kernel's.

 

[adamb]

This ended up being a cable issue. However it does look like these NIC's don't allow proxmox to boot with the latest 5.15 and 6.x kernels.

 

[Docop2]

it work fine over a nuc skull , tested with 2 sfp. Or just update fw of the nic.

 

[AllanM]

We had to switch the FEC mode of the switch our E810's are connected to, to "RS" mode to get a link light.

 

[adresner]

Building a box now with Dell, should I avoid the E810 and go with XXV710?

 

[AllanM]

We had some growing pains trying to get E810 working but in the end, we did get them working. I don't think any of the issues we faced were actually related to Proxmox. Everything was related to low level hardware/port/operational/firmware settings at the cards and switches.

FEC mode may need to be changed on switch side to work with common 100Gb cards.

LLDP agent probably needs to be disabled on the cards.

Once we waded through the issues we're now enjoying pretty solid performance from a dual-port 100Gb card in each server node of the cluster. The specific card we went with has 100Gb total available bandwidth, but presents dual 100Gb interfaces, so it can "share" available bandwidth across them. This seems to work fine in our environment. If we were on a newer PCIE 4 or better platform a true dual 100Gb card would probably be more useful.