[SOLVED] Dell R7525 : Proxmox 7.2 : Enable SR-IOV for Intel X710-T2L(10GBASE-T) : no sriov_numvfs in /sys/class/net/eno33/device/

T

tachionic

New Member
Jun 28, 2022
7
0
1
Hi,

While trying to enable SR-IOV for a fresh install of Proxmox 7.2 in Dell R7525, it is found that the NIC driver is not exposing sriov_numvfs in /sys/class/net/eno33/device. Please Help..

Bash: 
root@veena2:~# cd /sys/class/net/eno33/device/
root@veena2:/sys/class/net/eno33/device# ls
acpi_index                driver           msi_bus       resource3
aer_dev_correctable       driver_override  msi_irqs      resource3_wc
aer_dev_fatal             enable           net           revision
aer_dev_nonfatal          firmware_node    numa_node     rom
ari_enabled               iommu            power         subsystem
broken_parity_status      iommu_group      power_state   subsystem_device
class                     irq              ptp           subsystem_vendor
config                    label            remove        uevent
consistent_dma_mask_bits  link             rescan        vendor
current_link_speed        local_cpulist    reset         vpd
current_link_width        local_cpus       reset_method  wakeup
d3cold_allowed            max_link_speed   resource
device                    max_link_width   resource0
dma_mask_bits             modalias         resource0_wc
root@veena2:/sys/class/net/eno33/device#


The system environment is as below:

System

Bash: 
root@veena2:~# inxi -Fxz
System:
  Kernel: 5.15.30-2-pve x86_64 bits: 64 compiler: gcc v: 10.2.1
  Console: tty 0 Distro: Debian GNU/Linux 11 (bullseye)
Machine:
  Type: Server System: Dell product: PowerEdge R7525 v: N/A serial: <filter>
  Mobo: Dell model: 0590KW v: A04 serial: <filter> UEFI: Dell v: 2.6.6
  date: 01/13/2022
CPU:
  Info: 2x 64-Core (4-Die) model: AMD EPYC 7662 bits: 64
  type: MT MCP MCM SMP arch: Zen 2 rev: 0 L2 cache: 64 MiB
  flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
  bogomips: 1021146
  Speed: 1996 MHz min/max: N/A Core speeds (MHz): 1: 1996 2: 1996 3: 1996
  4: 1996 5: 1996 6: 1996 7: 1996 8: 1996 9: 1996 10: 1996 11: 1996 12: 1996
  13: 1996 14: 1996 15: 1996 16: 1996 17: 1996 18: 1996 19: 1996 20: 1996
  21: 1996 22: 1996 23: 1996 24: 1996 25: 1996 26: 1996 27: 1996 28: 1996
  29: 1912 30: 1996 31: 1996 32: 1996 33: 1996 34: 1996 35: 1996 36: 1996
  37: 1996 38: 1996 39: 1996 40: 1996 41: 1996 42: 1996 43: 1996 44: 1996
  45: 1996 46: 1996 47: 1996 48: 1996 49: 1996 50: 1996 51: 1996 52: 1996
  53: 1996 54: 1996 55: 1996 56: 1996 57: 1996 58: 1996 59: 1996 60: 1996
  61: 1996 62: 1996 63: 1996 64: 1996 65: 1996 66: 1996 67: 1996 68: 1996
  69: 1996 70: 1996 71: 1996 72: 1996 73: 1996 74: 1996 75: 1996 76: 1996
  77: 1996 78: 1996 79: 1996 80: 1996 81: 1996 82: 1996 83: 1996 84: 1996
  85: 1996 86: 1996 87: 1996 88: 1996 89: 1996 90: 1996 91: 1996 92: 1996
  93: 1996 94: 1996 95: 1996 96: 1996 97: 1996 98: 1996 99: 1996 100: 1996
  101: 1996 102: 1996 103: 1996 104: 1996 105: 1996 106: 1996 107: 1996
  108: 1996 109: 1996 110: 1996 111: 1996 112: 1996 113: 1996 114: 1996
  115: 1996 116: 1996 117: 1996 118: 1996 119: 1996 120: 1996 121: 1996
  122: 1996 123: 1996 124: 1996 125: 1996 126: 1996 127: 1996 128: 1996
  129: 1996 130: 1996 131: 1996 132: 1996 133: 1996 134: 1996 135: 1996
  136: 1996 137: 1996 138: 1996 139: 1996 140: 1996 141: 1996 142: 1996
  143: 1996 144: 1996 145: 1996 146: 1996 147: 1996 148: 1996 149: 1996
  150: 1996 151: 1996 152: 1996 153: 1996 154: 1996 155: 1996 156: 1996
  157: 1996 158: 1996 159: 1996 160: 1996 161: 1996 162: 1996 163: 1996
  164: 1996 165: 1996 166: 1996 167: 1996 168: 1996 169: 1996 170: 1996
  171: 1996 172: 1996 173: 1996 174: 1996 175: 1996 176: 1996 177: 1996
  178: 1996 179: 1996 180: 1996 181: 1996 182: 1996 183: 1996 184: 1996
  185: 1996 186: 1996 187: 1996 188: 1996 189: 1996 190: 1996 191: 1996
  192: 1996 193: 1996 194: 1996 195: 1996 196: 1996 197: 1996 198: 1996
  199: 1996 200: 1996 201: 1996 202: 1996 203: 1996 204: 1996 205: 1996
  206: 1996 207: 1996 208: 1996 209: 1996 210: 1996 211: 1996 212: 1996
  213: 1996 214: 1996 215: 1996 216: 1996 217: 1996 218: 1996 219: 1996
  220: 1996 221: 1996 222: 1996 223: 1996 224: 1996 225: 1996 226: 1996
  227: 1996 228: 1996 229: 1996 230: 1996 231: 1996 232: 1996 233: 1996
  234: 1996 235: 1996 236: 1996 237: 1996 238: 1996 239: 1996 240: 1996
  241: 1996 242: 1996 243: 1996 244: 1996 245: 1996 246: 1996 247: 1996
  248: 1996 249: 1996 250: 1996 251: 1996 252: 1996 253: 1996 254: 1996
  255: 1996 256: 1996
Graphics:
  Device-1: Matrox Systems Integrated Matrox G200eW3 Graphics driver: N/A
  bus ID: 63:00.0
  Display: server: No display server data found. Headless machine?
  tty: 80x24
  Message: Advanced graphics data unavailable in console for root.
Audio:
  Message: No Device data found.
Network:
  Device-1: Intel Ethernet X710 for 10GBASE-T driver: i40e v: kernel
  port: 1000 bus ID: 61:00.0
  IF: eno33 state: down mac: <filter>
  Device-2: Intel Ethernet X710 for 10GBASE-T driver: i40e v: kernel
  port: 1000 bus ID: 61:00.1
  IF: eno34 state: down mac: <filter>
  Device-3: Broadcom NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
  vendor: Dell PowerEdge Rx5xx LOM Board driver: tg3 v: kernel port: 1000
  bus ID: e1:00.0
  IF: eno1 state: up speed: 1000 Mbps duplex: full mac: <filter>
  Device-4: Broadcom NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
  vendor: Dell PowerEdge Rx5xx LOM Board driver: tg3 v: kernel port: 1000
  bus ID: e1:00.1
  IF: eno2 state: down mac: <filter>
  IF-ID-1: bonding_masters state: N/A speed: N/A duplex: N/A mac: N/A
  IF-ID-2: vmbr0 state: up speed: 1000 Mbps duplex: unknown mac: <filter>
Drives:
  Local Storage: total: 80.27 TiB lvm-free: 16 GiB used: 2.98 GiB (0.0%)
  ID-1: /dev/sda model: DELLBOSS VD size: 223.51 GiB
  ID-2: /dev/sdb vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-3: /dev/sdc vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-4: /dev/sdd vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-5: /dev/sde vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-6: /dev/sdf vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-7: /dev/sdg vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-8: /dev/sdh vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-9: /dev/sdi vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-10: /dev/sdj vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-11: /dev/sdk vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 31 C
  ID-12: /dev/sdl vendor: Seagate model: ST8000NM014A size: 7.28 TiB
  temp: 30 C
Partition:
  ID-1: / size: 54.57 GiB used: 2.98 GiB (5.5%) fs: ext4 dev: /dev/dm-1
  mapped: pve-root
  ID-2: /boot/efi size: 511 MiB used: 340 KiB (0.1%) fs: vfat dev: /dev/sda2
Swap:
  ID-1: swap-1 type: partition size: 8 GiB used: 0 KiB (0.0%) dev: /dev/dm-0
  mapped: pve-swap
Sensors:
  Message: No sensors data was found. Is sensors configured?
Info:
  Processes: 2156 Uptime: 23m Memory: 251.44 GiB used: 4.48 GiB (1.8%)
  Init: systemd runlevel: 5 Compilers: gcc: N/A Packages: 714 Shell: Bash
  v: 5.1.4 inxi: 3.3.01
root@veena2:~#

PVE

Bash: 
root@veena2:~# pveversion -v
proxmox-ve: 7.2-1 (running kernel: 5.15.30-2-pve)
pve-manager: 7.2-3 (running version: 7.2-3/c743d6c1)
pve-kernel-helper: 7.2-2
pve-kernel-5.15: 7.2-1
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph-fuse: 15.2.16-pve1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.22-pve2
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.2.0-1
libpve-access-control: 7.1-8
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.1-6
libpve-guest-common-perl: 4.1-2
libpve-http-server-perl: 4.1-1
libpve-storage-perl: 7.2-2
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 4.0.12-1
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.1.8-1
proxmox-backup-file-restore: 2.1.8-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.4-10
pve-cluster: 7.2-1
pve-container: 4.2-1
pve-docs: 7.2-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.4-1
pve-ha-manager: 3.3-4
pve-i18n: 2.7-1
pve-qemu-kvm: 6.2.0-5
pve-xtermjs: 4.16.0-1
qemu-server: 7.2-2
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.7.1~bpo11+1
vncterm: 1.7-1
zfsutils-linux: 2.1.4-pve1
root@veena2:~#

IOMMU

Bash: 
root@veena2:~# dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[    2.116500] pci 0000:60:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116530] pci 0000:40:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116546] pci 0000:20:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116563] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116584] pci 0000:e0:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116605] pci 0000:c0:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116633] pci 0000:a0:00.2: AMD-Vi: IOMMU performance counters supported
[    2.116652] pci 0000:80:00.2: AMD-Vi: IOMMU performance counters supported
[    2.121257] pci 0000:60:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121259] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121265] pci 0000:40:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121266] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121270] pci 0000:20:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121271] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121275] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121276] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121280] pci 0000:e0:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121280] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121284] pci 0000:c0:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121285] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121289] pci 0000:a0:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121290] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121294] pci 0000:80:00.2: AMD-Vi: Found IOMMU cap 0x40
[    2.121294] AMD-Vi: Extended features (0x58f77ef22294ade): PPR X2APIC NX GT IA GA PC GA_vAPIC
[    2.121298] AMD-Vi: Interrupt remapping enabled
[    2.121299] AMD-Vi: Virtual APIC enabled
[    2.121299] AMD-Vi: X2APIC enabled
[    2.125331] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[    2.125361] perf/amd_iommu: Detected AMD IOMMU #1 (2 banks, 4 counters/bank).
[    2.125393] perf/amd_iommu: Detected AMD IOMMU #2 (2 banks, 4 counters/bank).
[    2.125420] perf/amd_iommu: Detected AMD IOMMU #3 (2 banks, 4 counters/bank).
[    2.125486] perf/amd_iommu: Detected AMD IOMMU #4 (2 banks, 4 counters/bank).
[    2.125515] perf/amd_iommu: Detected AMD IOMMU #5 (2 banks, 4 counters/bank).
[    2.125542] perf/amd_iommu: Detected AMD IOMMU #6 (2 banks, 4 counters/bank).
[    2.125572] perf/amd_iommu: Detected AMD IOMMU #7 (2 banks, 4 counters/bank).
root@veena2:~#

Boot cmdline

Bash: 
root@veena2:~# cat /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-5.15.30-2-pve root=/dev/mapper/pve-root ro quiet nomodset mgag200.modeset=0 amd_iommu=on iommu=pt pci_pt_e820_access=on pci=assign-busses
root@veena2:~#
 
can you also post the output of 'lspci -vvv' ?
sometimes vendors (e.g. dell) rebrands those cards and do not enable all features in the firmware. e.g. we have a few I350-T2 here and not all are capable of SR-IOV (but some are)
 
  • Like
Reactions: Stoiko Ivanov
Bash: 
$ lspci -vvv > test.txt

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
    Subsystem: Dell Starship/Matisse Root Complex
    Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
    Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    NUMA node: 0

00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
    Subsystem: Dell Starship/Matisse IOMMU
    Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    NUMA node: 0
    Capabilities: [40] Secure device <?>
    Capabilities: [64] MSI: Enable- Count=1/4 Maskable- 64bit+
        Address: 0000000000000000  Data: 0000
    Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
    Capabilities: [c8] Vendor Specific Information: Len=18 <?>


****************    Clipped to reduce length  **********************************************



61:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
    DeviceName: Integrated NIC 1 Port 1
    Subsystem: Intel Corporation Ethernet 10G 2P X710-T2L-t OCP
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    Interrupt: pin A routed to IRQ 203
    NUMA node: 0
    IOMMU group: 59
    Region 0: Memory at 9a000000 (64-bit, prefetchable) [size=16M]
    Region 3: Memory at 9b008000 (64-bit, prefetchable) [size=32K]
    Expansion ROM at 97700000 [disabled] [size=512K]
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
    Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
        Vector table: BAR=3 offset=00000000
        PBA: BAR=3 offset=00001000
    Capabilities: [a0] Express (v2) Endpoint, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
            ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
        DevCtl:    CorrErr- NonFatalErr+ FatalErr+ UnsupReq+
            RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- FLReset-
            MaxPayload 512 bytes, MaxReadReq 512 bytes
        DevSta:    CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L1 <16us
            ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
        LnkCtl:    ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 8GT/s (ok), Width x8 (ok)
            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
        DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR-
             10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
             FRS- TPHComp- ExtTPHComp-
             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
        DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled,
             AtomicOpsCtl: ReqEn-
        LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
        LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
             Compliance De-emphasis: -6dB
        LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+ EqualizationPhase1+
             EqualizationPhase2+ EqualizationPhase3+ LinkEqualizationRequest-
             Retimer- 2Retimers- CrosslinkRes: unsupported
    Capabilities: [e0] Vital Product Data
        Product Name: X710 10GbE Controller
        Read-only fields:
            [V0] Vendor specific: FFV20.5.13
            [PN] Part number: F6X1R
            [MN] Manufacture ID: 1028
            [V1] Vendor specific: DSV1028VPDR.VER2.1
            [V3] Vendor specific: DTINIC
            [V4] Vendor specific: DCM1001FFFFFF2101FFFFFF
            [V5] Vendor specific: NPY2
            [V6] Vendor specific: PMT1
            [V7] Vendor specific: NMVIntel Corp
            [V8] Vendor specific: L1D0
            [RV] Reserved: checksum good, 1 byte(s) reserved
        Read/write fields:
            [Y1] System specific: CCF1
        End
    Capabilities: [100 v2] Advanced Error Reporting
        UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UESvrt:    DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
        CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
        CEMsk:    RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
        AERCap:    First Error Pointer: 00, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
        HeaderLog: 00000000 00000000 00000000 00000000
    Capabilities: [140 v1] Device Serial Number 68-7b-e9-ff-ff-91-96-b4
    Capabilities: [1a0 v1] Transaction Processing Hints
        Device specific mode supported
        No steering table available
    Capabilities: [1b0 v1] Access Control Services
        ACSCap:    SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        ACSCtl:    SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
    Capabilities: [1d0 v1] Secondary PCI Express
        LnkCtl3: LnkEquIntrruptEn- PerformEqu-
        LaneErrStat: 0
    Kernel driver in use: i40e
    Kernel modules: i40e

61:00.1 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
    DeviceName: Integrated NIC 1 Port 2
    Subsystem: Intel Corporation Ethernet Network Adapter X710-TL
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    Interrupt: pin A routed to IRQ 203
    NUMA node: 0
    IOMMU group: 60
    Region 0: Memory at 99000000 (64-bit, prefetchable) [size=16M]
    Region 3: Memory at 9b000000 (64-bit, prefetchable) [size=32K]
    Expansion ROM at 97780000 [disabled] [size=512K]
    Capabilities: [40] Power Management version 3
        Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
    Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Address: 0000000000000000  Data: 0000
        Masking: 00000000  Pending: 00000000
    Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
        Vector table: BAR=3 offset=00000000
        PBA: BAR=3 offset=00001000
    Capabilities: [a0] Express (v2) Endpoint, MSI 00
        DevCap:    MaxPayload 2048 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
            ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
        DevCtl:    CorrErr- NonFatalErr+ FatalErr+ UnsupReq+
            RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop- FLReset-
            MaxPayload 512 bytes, MaxReadReq 512 bytes
        DevSta:    CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
        LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L1 <16us
            ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
        LnkCtl:    ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 8GT/s (ok), Width x8 (ok)
            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
        DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR-
             10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
             FRS- TPHComp- ExtTPHComp-
             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
        DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled,
             AtomicOpsCtl: ReqEn-
        LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- EqualizationPhase1-
             EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
             Retimer- 2Retimers- CrosslinkRes: unsupported
    Capabilities: [e0] Vital Product Data
        Product Name: X710 10GbE Controller
        Read-only fields:
            [V0] Vendor specific: FFV20.5.13
            [PN] Part number: F6X1R
            [MN] Manufacture ID: 1028
            [V1] Vendor specific: DSV1028VPDR.VER2.1
            [V3] Vendor specific: DTINIC
            [V4] Vendor specific: DCM1001FFFFFF2101FFFFFF
            [V5] Vendor specific: NPY2
            [V6] Vendor specific: PMT1
            [V7] Vendor specific: NMVIntel Corp
            [V8] Vendor specific: L1D0
            [RV] Reserved: checksum good, 1 byte(s) reserved
        Read/write fields:
            [Y1] System specific: CCF1
        End
    Capabilities: [100 v2] Advanced Error Reporting
        UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UESvrt:    DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
        CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
        CEMsk:    RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
        AERCap:    First Error Pointer: 00, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
        HeaderLog: 00000000 00000000 00000000 00000000
    Capabilities: [140 v1] Device Serial Number 68-7b-e9-ff-ff-91-96-b4
    Capabilities: [1a0 v1] Transaction Processing Hints
        Device specific mode supported
        No steering table available
    Capabilities: [1b0 v1] Access Control Services
        ACSCap:    SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
        ACSCtl:    SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
    Kernel driver in use: i40e
    Kernel modules: i40e
 
Bash: 
*********************************** clipped to reduce length  *********************************************




e1:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
    DeviceName: Embedded NIC 1
    Subsystem: Dell PowerEdge Rx5xx LOM Board
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    Interrupt: pin A routed to IRQ 199
    NUMA node: 1
    IOMMU group: 117
    Region 0: Memory at 94830000 (64-bit, prefetchable) [size=64K]
    Region 2: Memory at 94840000 (64-bit, prefetchable) [size=64K]
    Region 4: Memory at 94850000 (64-bit, prefetchable) [size=64K]
    Expansion ROM at 94b00000 [disabled] [size=256K]
    Capabilities: [48] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
    Capabilities: [50] Vital Product Data
        Product Name: Broadcom NetXtreme Gigabit Ethernet
        Read-only fields:
            [PN] Part number: BCM95720
            [MN] Manufacture ID: 1028
            [V0] Vendor specific: FFV21.81.3
            [V1] Vendor specific: DSV1028VPDR.VER1.0
            [V2] Vendor specific: NPY2
            [V3] Vendor specific: PMT1
            [V4] Vendor specific: NMVBroadcom Corp
            [V5] Vendor specific: DTINIC
            [V6] Vendor specific: DCM1001008d452101008d45
            [RV] Reserved: checksum good, 233 byte(s) reserved
        End
    Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
        Address: 0000000000000000  Data: 0000
    Capabilities: [a0] MSI-X: Enable+ Count=17 Masked-
        Vector table: BAR=4 offset=00000000
        PBA: BAR=4 offset=00001000
    Capabilities: [ac] Express (v2) Endpoint, MSI 00
        DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
        DevCtl:    CorrErr- NonFatalErr+ FatalErr+ UnsupReq+
            RlxdOrd- ExtTag- PhantFunc- AuxPwr+ NoSnoop- FLReset-
            MaxPayload 256 bytes, MaxReadReq 512 bytes
        DevSta:    CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
        LnkCap:    Port #0, Speed 5GT/s, Width x2, ASPM not supported
            ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp-
        LnkCtl:    ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 5GT/s (ok), Width x1 (downgraded)
            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
        DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR-
             10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
             FRS- TPHComp- ExtTPHComp-
             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
        DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled,
             AtomicOpsCtl: ReqEn-
        LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
             Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
             Compliance De-emphasis: -6dB
        LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- EqualizationPhase1-
             EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
             Retimer- 2Retimers- CrosslinkRes: unsupported
    Capabilities: [100 v1] Advanced Error Reporting
        UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UESvrt:    DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
        CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
        CEMsk:    RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
        AERCap:    First Error Pointer: 00, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
        HeaderLog: 00000000 00000000 00000000 00000000
    Capabilities: [13c v1] Device Serial Number 00-00-ec-2a-72-19-46-9c
    Capabilities: [150 v1] Power Budgeting <?>
    Capabilities: [160 v1] Virtual Channel
        Caps:    LPEVC=0 RefClk=100ns PATEntryBits=1
        Arb:    Fixed- WRR32- WRR64- WRR128-
        Ctrl:    ArbSelect=Fixed
        Status:    InProgress-
        VC0:    Caps:    PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
            Ctrl:    Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
            Status:    NegoPending- InProgress-
    Kernel driver in use: tg3
    Kernel modules: tg3

e1:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5720 2-port Gigabit Ethernet PCIe
    DeviceName: Embedded NIC 2
    Subsystem: Dell PowerEdge Rx5xx LOM Board
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx-
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0
    Interrupt: pin B routed to IRQ 200
    NUMA node: 1
    IOMMU group: 117
    Region 0: Memory at 94800000 (64-bit, prefetchable) [size=64K]
    Region 2: Memory at 94810000 (64-bit, prefetchable) [size=64K]
    Region 4: Memory at 94820000 (64-bit, prefetchable) [size=64K]
    Expansion ROM at 94b40000 [disabled] [size=256K]
    Capabilities: [48] Power Management version 3
        Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
        Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
    Capabilities: [50] Vital Product Data
        Product Name: Broadcom NetXtreme Gigabit Ethernet
        Read-only fields:
            [PN] Part number: BCM95720
            [MN] Manufacture ID: 1028
            [V0] Vendor specific: FFV21.81.3
            [V1] Vendor specific: DSV1028VPDR.VER1.0
            [V2] Vendor specific: NPY2
            [V3] Vendor specific: PMT1
            [V4] Vendor specific: NMVBroadcom Corp
            [V5] Vendor specific: DTINIC
            [V6] Vendor specific: DCM1001008d452101008d45
            [RV] Reserved: checksum good, 233 byte(s) reserved
        End
    Capabilities: [58] MSI: Enable- Count=1/8 Maskable- 64bit+
        Address: 0000000000000000  Data: 0000
    Capabilities: [a0] MSI-X: Enable- Count=17 Masked-
        Vector table: BAR=4 offset=00000000
        PBA: BAR=4 offset=00001000
    Capabilities: [ac] Express (v2) Endpoint, MSI 00
        DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 <64us
            ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+ SlotPowerLimit 0.000W
        DevCtl:    CorrErr- NonFatalErr+ FatalErr+ UnsupReq+
            RlxdOrd+ ExtTag- PhantFunc- AuxPwr+ NoSnoop+ FLReset-
            MaxPayload 256 bytes, MaxReadReq 512 bytes
        DevSta:    CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr+ TransPend-
        LnkCap:    Port #0, Speed 5GT/s, Width x2, ASPM not supported
            ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp-
        LnkCtl:    ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
            ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
        LnkSta:    Speed 5GT/s (ok), Width x1 (downgraded)
            TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
        DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR-
             10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
             EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
             FRS- TPHComp- ExtTPHComp-
             AtomicOpsCap: 32bit- 64bit- 128bitCAS-
        DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- LTR- OBFF Disabled,
             AtomicOpsCtl: ReqEn-
        LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- EqualizationPhase1-
             EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
             Retimer- 2Retimers- CrosslinkRes: unsupported
    Capabilities: [100 v1] Advanced Error Reporting
        UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
        UESvrt:    DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt+ UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
        CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
        CEMsk:    RxErr- BadTLP+ BadDLLP+ Rollover+ Timeout+ AdvNonFatalErr+
        AERCap:    First Error Pointer: 00, ECRCGenCap+ ECRCGenEn+ ECRCChkCap+ ECRCChkEn+
            MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
        HeaderLog: 00000000 00000000 00000000 00000000
    Capabilities: [13c v1] Device Serial Number 00-00-ec-2a-72-19-46-9d
    Capabilities: [150 v1] Power Budgeting <?>
    Capabilities: [160 v1] Virtual Channel
        Caps:    LPEVC=0 RefClk=100ns PATEntryBits=1
        Arb:    Fixed- WRR32- WRR64- WRR128-
        Ctrl:    ArbSelect=Fixed
        Status:    InProgress-
        VC0:    Caps:    PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
            Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
            Ctrl:    Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
            Status:    NegoPending- InProgress-
    Kernel driver in use: tg3
    Kernel modules: tg3
 

Attachments

  • test.txt
    286.1 KB · Views: 1
What you said is correct... !!!!!
Dell has not enabled SR-IOV in the NIC firmware as lspci is not listing it as a capability...
Thanks a lot for the pointer.

We will contact dell about this...

Is it possible for us to upgrade the firmware ourselves ?? Will it void the warranty ??

-regards
Tachionic



Bash: 
root@veena2:~# lshw -c network -businfo
Bus info          Device     Class          Description
=======================================================
pci@0000:61:00.0  eno33      network        Ethernet Controller X710 for 10GBASE
pci@0000:61:00.1  eno34      network        Ethernet Controller X710 for 10GBASE
pci@0000:e1:00.0  eno1       network        NetXtreme BCM5720 2-port Gigabit Eth
pci@0000:e1:00.1  eno2       network        NetXtreme BCM5720 2-port Gigabit Eth
                  vmbr0      network        Ethernet interface
root@veena2:~#
root@veena2:~#
root@veena2:~#
root@veena2:~# lspci -vs 0000:61:00.0
61:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
        DeviceName: Integrated NIC 1 Port 1
        Subsystem: Intel Corporation Ethernet 10G 2P X710-T2L-t OCP
        Flags: bus master, fast devsel, latency 0, IRQ 203, NUMA node 0, IOMMU group 59
        Memory at 9a000000 (64-bit, prefetchable) [size=16M]
        Memory at 9b008000 (64-bit, prefetchable) [size=32K]
        Expansion ROM at 97700000 [disabled] [size=512K]
        Capabilities: [40] Power Management version 3
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [e0] Vital Product Data
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 68-7b-e9-ff-ff-91-96-b4
        Capabilities: [1a0] Transaction Processing Hints
        Capabilities: [1b0] Access Control Services
        Capabilities: [1d0] Secondary PCI Express
        Kernel driver in use: i40e
        Kernel modules: i40e

root@veena2:~# lspci -vs 0000:61:00.1
61:00.1 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
        DeviceName: Integrated NIC 1 Port 2
        Subsystem: Intel Corporation Ethernet Network Adapter X710-TL
        Flags: bus master, fast devsel, latency 0, IRQ 203, NUMA node 0, IOMMU group 60
        Memory at 99000000 (64-bit, prefetchable) [size=16M]
        Memory at 9b000000 (64-bit, prefetchable) [size=32K]
        Expansion ROM at 97780000 [disabled] [size=512K]
        Capabilities: [40] Power Management version 3
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [e0] Vital Product Data
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 68-7b-e9-ff-ff-91-96-b4
        Capabilities: [1a0] Transaction Processing Hints
        Capabilities: [1b0] Access Control Services
        Kernel driver in use: i40e
        Kernel modules: i40e

root@veena2:~#


A SR-IOV supported NIC should have below kind of result

Bash: 
root@jtac-ulab-vmx-2:~# lspci -vs 0000:04:00.0

04:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
        DeviceName: Embedded FlexibleLOM 1 Port 1
        Subsystem: Hewlett-Packard Company Ethernet 10Gb 2-port 560FLR-SFP+ Adapter
        Flags: bus master, fast devsel, latency 0, IRQ 17
        Memory at 97b00000 (32-bit, non-prefetchable) [size=1M]
        I/O ports at 2020 [size=32]
        Memory at 97c04000 (32-bit, non-prefetchable) [size=16K]
        [virtual] Expansion ROM at 97c80000 [disabled] [size=512K]
        Capabilities: [40] Power Management version 3
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [70] MSI-X: Enable+ Count=64 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [e0] Vital Product Data
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 00-00-00-ff-ff-00-00-00
        Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
        Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
        Kernel driver in use: ixgbe
        Kernel modules: ixgbe
 
Last edited:
Hi dcsapak

It was not a Dell mistake, rather lack of my patience. For a 128 core mammoth, it doesn't make sense not to provide a NIC with SR-IOV enabled when BIOS have a global SR-IOV enable setting.

In my attempt to contact Dell, after sending an initial email, I was roaming around in the BIOS for reporting the current NIC firmware for Intel X710T2L NIC.... There deep inside a setting was hiding where I should enable SR-IOV for the NIC.

Once enabled, I could get sriov_numvfs in /sys/class/net/eno33/device


Bash: 
root@veena2:~#
root@veena2:~# cd /sys/class/net/eno33/device/
root@veena2:/sys/class/net/eno33/device#
root@veena2:/sys/class/net/eno33/device# ls sr*
sriov_drivers_autoprobe  sriov_numvfs  sriov_offset  sriov_stride  sriov_totalvfs  sriov_vf_device  sriov_vf_total_msix
root@veena2:/sys/class/net/eno33/device#


Bash: 
root@veena2:/sys/class/net/eno33/device# lspci -vs 0000:61:00.0
61:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GBASE-T (rev 02)
        DeviceName: Integrated NIC 1 Port 1
        Subsystem: Intel Corporation Ethernet 10G 2P X710-T2L-t OCP
        Flags: bus master, fast devsel, latency 0, IRQ 203, NUMA node 0, IOMMU group 59
        Memory at 9a000000 (64-bit, prefetchable) [size=16M]
        Memory at 9b408000 (64-bit, prefetchable) [size=32K]
        Expansion ROM at 97700000 [disabled] [size=512K]
        Capabilities: [40] Power Management version 3
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
        Capabilities: [a0] Express Endpoint, MSI 00
        Capabilities: [e0] Vital Product Data
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [140] Device Serial Number 68-7b-e9-ff-ff-91-96-b4
        Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
        Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
        Capabilities: [1a0] Transaction Processing Hints
        Capabilities: [1b0] Access Control Services
        Capabilities: [1d0] Secondary PCI Express
        Kernel driver in use: i40e
        Kernel modules: i40e

See above that SR-IOV capability is advertised.

Sorry for suspecting Dell for my mistake.

-regards
Tachionic
 

Attachments

  • rpviewer (14).png
    rpviewer (14).png
    37.7 KB · Views: 46
tachionic said:
See above that SR-IOV capability is advertised.

Sorry for suspecting Dell for my mistake.
Click to expand...
great that it works now.

regardless if it is enabled on this model, there are cases where dell/hp/etc. disable such features, for whatever reason...
 
regardless if it is enabled on this model, there are cases where dell/hp/etc. disable such features, for whatever reason...
Click to expand...

For same model having differently featured exact h/w NIC is rather surprising !!! and rationale rather puzzling.. Did a firmware upgrade worked for you to solve the issue ? Did those companies provided them or you did at your own risk ??

But differently priced models differentiated based on selective feature disable is common in consumer products. For example one famous japanese camera company whom i had worked for, have same SOC inside their most expensive and least expensive cameras with almost same firmware. Only features are enabled or disabled based on CMOS sensors, other sensors and pricing. In short, from electronics point of view their product cost are the same, while the look, feel, experience and pricing vary vastly.

-regards
Tachionic
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back