10G NIC but No 10G Speed

[virtualtechie]

Hey all. So I have PVE running on an HP Proliant DL360 G6 with Dual Xeon X5670 @ 2.93Ghz CPUs, 144GB of RAM, NC522SFP 10Gb Fiber NIC. I recently upgraded to 10Gb. I got a fiber SFP+ NIC installed and connected to a MicroTik CRS305-1G-4S+IN 4 Port 10G Switch. I have two other servers running TrueNAS, both with 10Gb NICs. When doing iPerf speed tests between either of the TrueNAS servers to the PVE host, I'm only getting around 6.5Gbps speeds.

I ran another iPerf test on the PVE host while running from a Live Linux disc and got 9.36Gbps. Something in Proxmox is preventing the NIC from getting the faster speeds. Looking for some advice/suggestions/opinions as to what within Proxmox is causing this.

 

[Hannes Laimer]

Hey,

just so I understood this correctly,

PVE <-> TrueNAS: 6.5Gbps
PVE <-> something else on the same network: 9.36Gbps

right? PVE, especially on the host itself, is just the linux networking stack. Do you have anything setup that would interact with the traffic?

What is ethtool <NIC> saying?

 

[virtualtechie]

Hey,

just so I understood this correctly,

PVE <-> TrueNAS: 6.5Gbps
PVE <-> something else on the same network: 9.36Gbps

right? PVE, especially on the host itself, is just the linux networking stack. Do you have anything setup that would interact with the traffic?

What is ethtool <NIC> saying?

Not quite...
PVE < - > TrueNAS: 6.5Gbps
TrueNAS < - > TrueNAS: 9.36Gbps

When running live disc on PVE host, I also get 9.36Gbps. So issue is only when running PVE on host, Nothing is setup that would interact with traffic. Everything is pretty vanilla as of right now.

root@pve:~# ethtool ens1f0
Settings for ens1f0:
Supported ports: [ TP FIBRE ]
Supported link modes: 10000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: 10000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 10000Mb/s
Duplex: Full
Auto-negotiation: off
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: g
Wake-on: g
Link detected: yes