Hi All
Using MTU 9000 and Cisco 3850 10gbit switches, my PC (physical windows 11 machine with Mellanox 10Gbit nic), Proxmox and the Truenas VM all running MTU 9000 and 10gbit. No errors, optical interfaces.
Proxmox showing good performance , Truenas definitely slower. Windows 10 VM on proxmox is also around that 2.9Gbits mark.
Any suggestions? Multqueue is turned on - CPU is AMD eypc , 32cores, lots of ram etc. Definitely not a hardware limitation - i feel its a software setting
Proxmox Host to Windows 11 Physical PC
TrueNas Proxmox VM to Windows 11 Physical PC
TrueNas Proxmox VM to Windows 10 Proxmox VM
Using MTU 9000 and Cisco 3850 10gbit switches, my PC (physical windows 11 machine with Mellanox 10Gbit nic), Proxmox and the Truenas VM all running MTU 9000 and 10gbit. No errors, optical interfaces.
Proxmox showing good performance , Truenas definitely slower. Windows 10 VM on proxmox is also around that 2.9Gbits mark.
Any suggestions? Multqueue is turned on - CPU is AMD eypc , 32cores, lots of ram etc. Definitely not a hardware limitation - i feel its a software setting
Proxmox Host to Windows 11 Physical PC
Code:
root@Proxmox:/etc/network# iperf3 -c 192.168.0.10 -u -b 10G
Connecting to host 192.168.0.10, port 5201
[ 5] local 192.168.0.9 port 49030 connected to 192.168.0.10 port 5201
[ ID] Interval Transfer Bitrate Total Datagrams
[ 5] 0.00-1.00 sec 998 MBytes 8.36 Gbits/sec 116920
[ 5] 1.00-2.00 sec 1008 MBytes 8.46 Gbits/sec 118134
[ 5] 2.00-3.00 sec 1002 MBytes 8.41 Gbits/sec 117440
[ 5] 3.00-4.00 sec 986 MBytes 8.27 Gbits/sec 115506
[ 5] 4.00-5.00 sec 973 MBytes 8.16 Gbits/sec 113984
[ 5] 5.00-6.00 sec 988 MBytes 8.29 Gbits/sec 115790
[ 5] 6.00-7.00 sec 974 MBytes 8.17 Gbits/sec 114192
[ 5] 7.00-8.00 sec 992 MBytes 8.32 Gbits/sec 116257
[ 5] 8.00-9.00 sec 996 MBytes 8.36 Gbits/sec 116761
[ 5] 9.00-10.00 sec 999 MBytes 8.38 Gbits/sec 117067
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams
[ 5] 0.00-10.00 sec 9.68 GBytes 8.32 Gbits/sec 0.000 ms 0/1162051 (0%) sender
[ 5] 0.00-10.00 sec 8.52 GBytes 7.32 Gbits/sec 0.007 ms 139588/1162051 (12%) receiver
iperf Done.
root@Proxmox:/etc/network#TrueNas Proxmox VM to Windows 11 Physical PC
Code:
truenas_admin@truenas[~]$ sudo iperf3 -c 192.168.0.10 -u -b 10G
[sudo] password for truenas_admin:
Connecting to host 192.168.0.10, port 5201
[ 5] local 192.168.0.27 port 57768 connected to 192.168.0.10 port 5201
[ ID] Interval Transfer Bitrate Total Datagrams
[ 5] 0.00-1.00 sec 341 MBytes 2.86 Gbits/sec 246712
[ 5] 1.00-2.00 sec 351 MBytes 2.94 Gbits/sec 253839
[ 5] 2.00-3.00 sec 341 MBytes 2.86 Gbits/sec 247038
[ 5] 3.00-4.00 sec 341 MBytes 2.86 Gbits/sec 247075
[ 5] 4.00-5.00 sec 347 MBytes 2.91 Gbits/sec 251484
[ 5] 5.00-6.00 sec 353 MBytes 2.96 Gbits/sec 255735
[ 5] 6.00-7.00 sec 343 MBytes 2.87 Gbits/sec 248099
[ 5] 7.00-8.00 sec 332 MBytes 2.79 Gbits/sec 240465
[ 5] 8.00-9.00 sec 353 MBytes 2.96 Gbits/sec 255429
[ 5] 9.00-10.00 sec 349 MBytes 2.92 Gbits/sec 252395
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams
[ 5] 0.00-10.00 sec 3.37 GBytes 2.89 Gbits/sec 0.000 ms 0/2498271 (0%) sender
[ 5] 0.00-10.00 sec 2.91 GBytes 2.50 Gbits/sec 0.006 ms 336922/2498230 (13%) receiver
iperf Done.
truenas_admin@truenas[~]$TrueNas Proxmox VM to Windows 10 Proxmox VM
Code:
truenas_admin@truenas[~]$ sudo iperf3 -c 192.168.0.4 -u -b 10G
Connecting to host 192.168.0.4, port 5201
[ 5] local 192.168.0.27 port 53709 connected to 192.168.0.4 port 5201
[ ID] Interval Transfer Bitrate Total Datagrams
[ 5] 0.00-1.00 sec 315 MBytes 2.64 Gbits/sec 226218
[ 5] 1.00-2.00 sec 328 MBytes 2.75 Gbits/sec 235235
[ 5] 2.00-3.00 sec 333 MBytes 2.80 Gbits/sec 239352
[ 5] 3.00-4.00 sec 331 MBytes 2.77 Gbits/sec 237385
[ 5] 4.00-5.00 sec 326 MBytes 2.73 Gbits/sec 233889
[ 5] 5.00-6.00 sec 325 MBytes 2.72 Gbits/sec 233113
[ 5] 6.00-7.00 sec 324 MBytes 2.71 Gbits/sec 232422
[ 5] 7.00-8.00 sec 327 MBytes 2.74 Gbits/sec 234533
[ 5] 8.00-9.00 sec 353 MBytes 2.96 Gbits/sec 253267
[ 5] 9.00-10.00 sec 319 MBytes 2.68 Gbits/sec 229094
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams
[ 5] 0.00-10.00 sec 3.20 GBytes 2.75 Gbits/sec 0.000 ms 0/2354508 (0%) sender
[ 5] 0.00-10.00 sec 864 MBytes 725 Mbits/sec 0.024 ms 1719520/2340139 (73%) receiver
iperf Done.
truenas_admin@truenas[~]$
Last edited: