Unstable Transferspeed/Network (Windows Server 2016)

Hi, devlis advocate, question -- I wonder if ZFS is adding complexity here / and might it just work 'simpler and better' with vanilla HW Raid. Or you can do HW Raid of (rust disks) and HW raid of (SSD disks) and do a debian-install proxmox; configure bcache layer to get SSD boost over the bare-rust-raid-disk performance; and - should be good ?

Tim
 
drno said:
Whenever I try to copy a file from a client pc (tried that from different pcs) to the server, I get very weird tranferspeeds and it even freezes (drops down few kb/s) at the middle of the transfer.

Also it uses VirtIO Ethernet and 4 Broadcom Limited NetXtreme II BCM5709 Gigabit Ethernet Adapters in LACP.
Click to expand...

Do you known that with lacp, you can't use more than 1 nic for 1 tcp/udp connection ?

you need to use iperf with multiple connections. (don't remember the option)
 
spirit said:
Do you known that with lacp, you can't use more than 1 nic for 1 tcp/udp connection ?

you need to use iperf with multiple connections. (don't remember the option)
Click to expand...
Sure, but shouldnt I still get the full Gigabit speed or is this a Windows issue?
When I do a test to one of my other Machines (Debian), I get the full gigabit.

Debian Machine
Code: 
iperf3.exe -c 192.168.1.6
Connecting to host 192.168.1.6, port 5201
[  4] local 192.168.1.38 port 55237 connected to 192.168.1.6 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   112 MBytes   944 Mbits/sec
[  4]   1.00-2.00   sec   112 MBytes   942 Mbits/sec
[  4]   2.00-3.00   sec   112 MBytes   943 Mbits/sec
[  4]   3.00-4.00   sec   112 MBytes   942 Mbits/sec
[  4]   4.00-5.00   sec   112 MBytes   941 Mbits/sec
[  4]   5.00-6.00   sec   112 MBytes   937 Mbits/sec
[  4]   6.00-7.00   sec   112 MBytes   943 Mbits/sec
[  4]   7.00-8.00   sec   112 MBytes   944 Mbits/sec
[  4]   8.00-9.00   sec   112 MBytes   944 Mbits/sec
[  4]   9.00-10.00  sec   112 MBytes   940 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec                  sender
[  4]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec                  receiver

Windows Machine

Code: 
iperf3.exe -c 192.168.1.4
Connecting to host 192.168.1.4, port 5201
[  4] local 192.168.1.38 port 55381 connected to 192.168.1.4 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  91.6 MBytes   768 Mbits/sec
[  4]   1.00-2.00   sec  88.0 MBytes   738 Mbits/sec
[  4]   2.00-3.00   sec  95.5 MBytes   802 Mbits/sec
[  4]   3.00-4.00   sec  91.6 MBytes   769 Mbits/sec
[  4]   4.00-5.00   sec  93.5 MBytes   784 Mbits/sec
[  4]   5.00-6.00   sec  95.0 MBytes   797 Mbits/sec
[  4]   6.00-7.00   sec  94.6 MBytes   794 Mbits/sec
[  4]   7.00-8.00   sec  94.4 MBytes   791 Mbits/sec
[  4]   8.00-9.00   sec  95.5 MBytes   801 Mbits/sec
[  4]   9.00-10.00  sec  92.5 MBytes   775 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   932 MBytes   782 Mbits/sec                  sender
[  4]   0.00-10.00  sec   932 MBytes   782 Mbits/sec                  receiver

Now with -P 2

Code: 
iperf3.exe -P 2 -c 192.168.1.4
Connecting to host 192.168.1.4, port 5201
[  4] local 192.168.1.38 port 55426 connected to 192.168.1.4 port 5201
[  6] local 192.168.1.38 port 55427 connected to 192.168.1.4 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  55.2 MBytes   463 Mbits/sec
[  6]   0.00-1.00   sec  55.2 MBytes   463 Mbits/sec
[SUM]   0.00-1.00   sec   110 MBytes   926 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec  54.6 MBytes   458 Mbits/sec
[  6]   1.00-2.00   sec  54.4 MBytes   456 Mbits/sec
[SUM]   1.00-2.00   sec   109 MBytes   915 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec  55.1 MBytes   462 Mbits/sec
[  6]   2.00-3.00   sec  55.4 MBytes   465 Mbits/sec
[SUM]   2.00-3.00   sec   110 MBytes   927 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  55.4 MBytes   465 Mbits/sec
[  6]   3.00-4.00   sec  55.1 MBytes   463 Mbits/sec
[SUM]   3.00-4.00   sec   110 MBytes   928 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  55.2 MBytes   463 Mbits/sec
[  6]   4.00-5.00   sec  55.1 MBytes   462 Mbits/sec
[SUM]   4.00-5.00   sec   110 MBytes   925 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  55.0 MBytes   462 Mbits/sec
[  6]   5.00-6.00   sec  55.0 MBytes   462 Mbits/sec
[SUM]   5.00-6.00   sec   110 MBytes   924 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec  55.6 MBytes   467 Mbits/sec
[  6]   6.00-7.00   sec  55.8 MBytes   468 Mbits/sec
[SUM]   6.00-7.00   sec   111 MBytes   934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec  54.5 MBytes   457 Mbits/sec
[  6]   7.00-8.00   sec  54.5 MBytes   457 Mbits/sec
[SUM]   7.00-8.00   sec   109 MBytes   914 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  55.6 MBytes   467 Mbits/sec
[  6]   8.00-9.00   sec  55.6 MBytes   467 Mbits/sec
[SUM]   8.00-9.00   sec   111 MBytes   933 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  55.2 MBytes   464 Mbits/sec
[  6]   9.00-10.00  sec  55.1 MBytes   463 Mbits/sec
[SUM]   9.00-10.00  sec   110 MBytes   926 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   552 MBytes   463 Mbits/sec                  sender
[  4]   0.00-10.00  sec   552 MBytes   463 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   551 MBytes   462 Mbits/sec                  sender
[  6]   0.00-10.00  sec   551 MBytes   462 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  1.08 GBytes   925 Mbits/sec                  sender
[SUM]   0.00-10.00  sec  1.08 GBytes   925 Mbits/sec                  receiver
 
also, for the lacp, you need to check the hash method on your switch lacp configuration.

on the host, layer3+4, will hash from source ip + destination ip + tcp ports for the outgoing traffic.

but you need a similar hash in the switch, for the outgoing traffic from switch (so the incoming traffic to your host). (some swich can only hash at layer2 (mac address) or layer3 (only ip). You really need ip + ports hash on your switch.
 
spirit said:
also, for the lacp, you need to check the hash method on your switch lacp configuration.

on the host, layer3+4, will hash from source ip + destination ip + tcp ports for the outgoing traffic.

but you need a similar hash in the switch, for the outgoing traffic from switch (so the incoming traffic to your host). (some swich can only hash at layer2 (mac address) or layer3 (only ip). You really need ip + ports hash on your switch.
Click to expand...
I already set it to "Source/Destination IP and TCP/UDP Port Fields"
 
Hi, just to confirm; you were not originally using VirtIO-scsi inside your guest, now you are, and performance improved "significantly" but you wonder if can make better still ?

My guess is that - you probably are not going to get too much better than where you have it now.
(85+MB/s writes and 112MB/s reads)

Tim
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back