IPERF3 not exceeding the bandwidth beyond 10G even if proxmox hosts are connected on 25G

ermanishchawla

Renowned Member
Mar 23, 2020
335
38
68
39
Sender Side

iperf3 -c 10.XX.YY.8 -u -b 10G -i 1 -t 10000 -P2
Connecting to host 10.25.240.8, port 5201
[ 5] local 10.25.240.7 port 49254 connected to 10.25.240.8 port 5201
[ 7] local 10.25.240.7 port 48981 connected to 10.25.240.8 port 5201
[ ID] Interval Transfer Bitrate Total Datagrams
[ 5] 0.00-1.00 sec 57.2 MBytes 479 Mbits/sec 41427
[ 7] 0.00-1.00 sec 57.1 MBytes 479 Mbits/sec 41361
[SUM] 0.00-1.00 sec 114 MBytes 958 Mbits/sec 82788
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 1.00-2.00 sec 56.9 MBytes 477 Mbits/sec 41193
[ 7] 1.00-2.00 sec 57.0 MBytes 479 Mbits/sec 41313
[SUM] 1.00-2.00 sec 114 MBytes 956 Mbits/sec 82506
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 2.00-3.00 sec 59.1 MBytes 496 Mbits/sec 42827
[ 7] 2.00-3.00 sec 54.9 MBytes 460 Mbits/sec 39749
[SUM] 2.00-3.00 sec 114 MBytes 957 Mbits/sec 82576
^C- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 3.00-3.34 sec 20.3 MBytes 501 Mbits/sec 14702
[ 7] 3.00-3.34 sec 18.5 MBytes 457 Mbits/sec 13400
[SUM] 3.00-3.34 sec 38.8 MBytes 957 Mbits/sec 28102


Receiver side

Server listening on 5201 (test #1)
-----------------------------------------------------------
Accepted connection from 10.XX.YY.7, port 53584
[ 5] local 10.25.240.8 port 5201 connected to 10.25.240.7 port 49254
[ 6] local 10.25.240.8 port 5201 connected to 10.25.240.7 port 48981
[ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams
[ 5] 0.00-1.00 sec 57.0 MBytes 478 Mbits/sec 0.030 ms 0/41306 (0%)
[ 6] 0.00-1.00 sec 57.0 MBytes 478 Mbits/sec 0.035 ms 0/41284 (0%)
[SUM] 0.00-1.00 sec 114 MBytes 956 Mbits/sec 0.032 ms 0/82590 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 1.00-2.00 sec 57.0 MBytes 478 Mbits/sec 0.009 ms 0/41289 (0%)
[ 6] 1.00-2.00 sec 57.0 MBytes 478 Mbits/sec 0.019 ms 0/41296 (0%)
[SUM] 1.00-2.00 sec 114 MBytes 956 Mbits/sec 0.014 ms 0/82585 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 2.00-3.00 sec 59.1 MBytes 496 Mbits/sec 0.024 ms 0/42792 (0%)
[ 6] 2.00-3.00 sec 54.9 MBytes 461 Mbits/sec 0.032 ms 0/39771 (0%)
[SUM] 2.00-3.00 sec 114 MBytes 956 Mbits/sec 0.028 ms 0/82563 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ 5] 2.00-3.00 sec 59.1 MBytes 496 Mbits/sec 0.024 ms 0/42792 (0%)
[ 6] 2.00-3.00 sec 54.9 MBytes 461 Mbits/sec 0.032 ms 0/39771 (0%)
[SUM] 2.00-3.00 sec 114 MBytes 956 Mbits/sec 0.028 ms 0/82563 (0%)


- - - - - - - - - - - - - - - - - - - - - - - -

NIC Configuration

Settings for nic0:
Supported ports: [ FIBRE ]
Supported link modes: 25000baseSR/Full
10000baseSR/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Supported FEC modes: RS BASER
Advertised link modes: 25000baseSR/Full
10000baseSR/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Speed: 25000Mb/s
Lanes: 1
Duplex: Full
Auto-negotiation: on
Port: FIBRE
PHYAD: 1
Transceiver: internal
Supports Wake-on: g
Wake-on: g
Current message level: 0x00002081 (8321)
drv tx_err hw
Link detected: yes



Settings for bond0:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 25000Mb/s
Duplex: Full
Auto-negotiation: off
Port: Other
PHYAD: 0
Transceiver: internal
Link detected: yes
 
iperf 3.18 (cJSON 1.7.15)
Linux inc2pve1 6.17.9-1-pve #1 SMP PREEMPT_DYNAMIC PMX 6.17.9-1 (2026-01-12T16:25Z) x86_64
Optional features available: CPU affinity setting, IPv6 flow label, SCTP, TCP congestion algorithm setting, sendfile / zerocopy, socket pacing, authentication, bind to device, support IPv4 don't fragment, POSIX threads