Problem with SDN QinQ and Emulex ethernet controllers

f.cuseo

Renowned Member
Feb 13, 2013
32
2
73
Hello.
I have a cluster with Dell R720/R730 with 4x10Gbit ethernet (single LACP bond with vlan for management and ceph) and sdn with 802.1q and VLAN zones, connected with cisco nexus switches

With sdn QinQ, network is not working (I have a monitor port, and no any arp traffic is received).
With sdn QinQ but using 802.1ad, works.
With sdn and VLAN, no any problem.

Of course, replacing Emulex controller with Broadcom controllers, all works like a charm.

from lspci:
01:00.0 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.1 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.2 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.3 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)

from dmesg:
4.517352] be2net 0000:01:00.0: FW config: function_mode=0x2010a02, function_caps=0x7
[ 4.629371] be2net 0000:01:00.0: Using profile 0x10
[ 4.689406] be2net 0000:01:00.0: Max: txqs 34, rxqs 32, rss 32, eqs 32, vfs 0
[ 4.689418] be2net 0000:01:00.0: Max: uc-macs 126, mc-macs 64, vlans 64
[ 4.690029] be2net 0000:01:00.0: enabled 10 MSI-x vector(s) for NIC
[ 5.441358] be2net 0000:01:00.0: created 10 TX queue(s)
[ 5.681349] be2net 0000:01:00.0: created 10 RX queue(s)
[ 5.736485] be2net 0000:01:00.0: FW version is 11.2.1197.13
[ 5.830397] be2net 0000:01:00.0: HW Flow control - TX:1 RX:1
[ 5.836173] be2net 0000:01:00.0: Emulex OneConnect(Skyhawk): PF port 1
 
With sdn QinQ, network is not working (I have a monitor port, and no any arp traffic is received).
With sdn QinQ but using 802.1ad, works.

Hi,

So, it's not working with emulex + qinq with 802.1q+802.1q ?

It's quite possible that it's offloading hardware driver related.

802.1ad is the new standard, maybe emulex don't support the old 802.1q+802.1q.