Problem with SDN QinQ and Emulex ethernet controllers

f.cuseo

Renowned Member
Feb 13, 2013
30
0
71
Hello.
I have a cluster with Dell R720/R730 with 4x10Gbit ethernet (single LACP bond with vlan for management and ceph) and sdn with 802.1q and VLAN zones, connected with cisco nexus switches

With sdn QinQ, network is not working (I have a monitor port, and no any arp traffic is received).
With sdn QinQ but using 802.1ad, works.
With sdn and VLAN, no any problem.

Of course, replacing Emulex controller with Broadcom controllers, all works like a charm.

from lspci:
01:00.0 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.1 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.2 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)
01:00.3 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 11)

from dmesg:
4.517352] be2net 0000:01:00.0: FW config: function_mode=0x2010a02, function_caps=0x7
[ 4.629371] be2net 0000:01:00.0: Using profile 0x10
[ 4.689406] be2net 0000:01:00.0: Max: txqs 34, rxqs 32, rss 32, eqs 32, vfs 0
[ 4.689418] be2net 0000:01:00.0: Max: uc-macs 126, mc-macs 64, vlans 64
[ 4.690029] be2net 0000:01:00.0: enabled 10 MSI-x vector(s) for NIC
[ 5.441358] be2net 0000:01:00.0: created 10 TX queue(s)
[ 5.681349] be2net 0000:01:00.0: created 10 RX queue(s)
[ 5.736485] be2net 0000:01:00.0: FW version is 11.2.1197.13
[ 5.830397] be2net 0000:01:00.0: HW Flow control - TX:1 RX:1
[ 5.836173] be2net 0000:01:00.0: Emulex OneConnect(Skyhawk): PF port 1
 
With sdn QinQ, network is not working (I have a monitor port, and no any arp traffic is received).
With sdn QinQ but using 802.1ad, works.

Hi,

So, it's not working with emulex + qinq with 802.1q+802.1q ?

It's quite possible that it's offloading hardware driver related.

802.1ad is the new standard, maybe emulex don't support the old 802.1q+802.1q.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!