Eth rate limit -> unstable bandwidth

sigxcpu · Oct 17, 2015

Windows 10 VM, bw limit set to 3MB/sec. Both the download and upload had a flat top, so it wasn't bursty.
Here's the result: http://www.speedtest.net/my-result/4753486788

sigxcpu · Oct 17, 2015

FreeBSD VM and external laptop. VM limited to 1MB/sec

From VM:

Code:

# iperf -c 192.168.27.106 -t 10 -i 1
------------------------------------------------------------
Client connecting to 192.168.27.106, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.27.119 port 14548 connected with 192.168.27.106 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  1.75 MBytes  14.7 Mbits/sec
[  3]  1.0- 2.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  2.0- 3.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  3.0- 4.0 sec  1.12 MBytes  9.44 Mbits/sec
[  3]  4.0- 5.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  5.0- 6.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  6.0- 7.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  7.0- 8.0 sec   896 KBytes  7.34 Mbits/sec
[  3]  8.0- 9.0 sec  1.00 MBytes  8.39 Mbits/sec
[  3]  9.0-10.0 sec   768 KBytes  6.29 Mbits/sec
[  3]  0.0-10.0 sec  10.6 MBytes  8.91 Mbits/sec

To VM:

Code:

# iperf -c 192.168.27.119 -t 10 -i 1
------------------------------------------------------------
Client connecting to 192.168.27.119, TCP port 5001
TCP window size: 1.00 MByte (default)
------------------------------------------------------------
[  4] local 192.168.27.106 port 50367 connected with 192.168.27.119 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0- 1.0 sec  1.88 MBytes  15.7 Mbits/sec
[  4]  1.0- 2.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  2.0- 3.0 sec   896 KBytes  7.34 Mbits/sec
[  4]  3.0- 4.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  4.0- 5.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  5.0- 6.0 sec   896 KBytes  7.34 Mbits/sec
[  4]  6.0- 7.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  7.0- 8.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  8.0- 9.0 sec   896 KBytes  7.34 Mbits/sec
[  4]  9.0-10.0 sec  1.00 MBytes  8.39 Mbits/sec
[  4]  0.0-10.1 sec  10.6 MBytes  8.84 Mbits/sec

Without limits

To VM:

Code:

iperf -c 192.168.27.119 -t 10 -i 1
------------------------------------------------------------
Client connecting to 192.168.27.119, TCP port 5001
TCP window size: 1.00 MByte (default)
------------------------------------------------------------
[  4] local 192.168.27.106 port 50388 connected with 192.168.27.119 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0- 1.0 sec  67.0 MBytes   562 Mbits/sec
[  4]  1.0- 2.0 sec  72.5 MBytes   608 Mbits/sec
[  4]  2.0- 3.0 sec  73.4 MBytes   616 Mbits/sec
[  4]  3.0- 4.0 sec  71.6 MBytes   601 Mbits/sec
[  4]  4.0- 5.0 sec  72.0 MBytes   604 Mbits/sec
[  4]  5.0- 6.0 sec  72.4 MBytes   607 Mbits/sec
[  4]  6.0- 7.0 sec  72.1 MBytes   605 Mbits/sec
[  4]  7.0- 8.0 sec  72.2 MBytes   606 Mbits/sec
[  4]  8.0- 9.0 sec  71.6 MBytes   601 Mbits/sec
[  4]  9.0-10.0 sec  73.5 MBytes   617 Mbits/sec
[  4]  0.0-10.0 sec   718 MBytes   602 Mbits/sec

From VM:

Code:

# iperf -c 192.168.27.106 -t 10 -i 1
------------------------------------------------------------
Client connecting to 192.168.27.106, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.27.119 port 18246 connected with 192.168.27.106 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 1.0 sec  20.6 MBytes   173 Mbits/sec
[  3]  1.0- 2.0 sec  31.2 MBytes   262 Mbits/sec
[  3]  2.0- 3.0 sec  38.4 MBytes   322 Mbits/sec
[  3]  3.0- 4.0 sec  38.5 MBytes   323 Mbits/sec
[  3]  4.0- 5.0 sec  40.9 MBytes   343 Mbits/sec
[  3]  5.0- 6.0 sec  43.4 MBytes   364 Mbits/sec
[  3]  6.0- 7.0 sec  46.1 MBytes   387 Mbits/sec
[  3]  7.0- 8.0 sec  47.8 MBytes   401 Mbits/sec
[  3]  8.0- 9.0 sec  47.2 MBytes   396 Mbits/sec
[  3]  9.0-10.0 sec  48.8 MBytes   409 Mbits/sec
[  3]  0.0-10.0 sec   403 MBytes   338 Mbits/sec

wolfgang · Oct 19, 2015

Hi Sigxcpu,

what version you are using(pveversion -v) and please send the vm.conf.

spirit · Oct 19, 2015

I think we should look at libvirt code

src/util/virnetdevbandwidth.c

the qos tree is a little bit different than proxmox.

sigxcpu · Oct 19, 2015

wolfgang said:
Hi Sigxcpu,

what version you are using(pveversion -v) and please send the vm.conf.

Code:

root@gen8:~# pveversion -v
proxmox-ve: 4.0-16 (running kernel: 4.2.2-1-pve)
pve-manager: 4.0-48 (running version: 4.0-48/0d8559d0)
pve-kernel-4.1.3-1-pve: 4.1.3-7
pve-kernel-4.2.0-1-pve: 4.2.0-13
pve-kernel-4.2.1-1-pve: 4.2.1-14
pve-kernel-4.2.2-1-pve: 4.2.2-16
lvm2: 2.02.116-pve1
corosync-pve: 2.3.5-1
libqb0: 0.17.2-1
pve-cluster: 4.0-22
qemu-server: 4.0-30
pve-firmware: 1.1-7
libpve-common-perl: 4.0-30
libpve-access-control: 4.0-9
libpve-storage-perl: 4.0-26
pve-libspice-server1: 0.12.5-1
vncterm: 1.2-1
pve-qemu-kvm: 2.4-9
pve-container: 1.0-7
pve-firewall: 2.0-12
pve-ha-manager: 1.0-9
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u1
lxc-pve: 1.1.3-1
lxcfs: 0.9-pve2
cgmanager: 0.37-pve2
criu: 1.6.0-1
zfsutils: 0.6.5-pve4~jessie

wolfgang · Oct 21, 2015

After a log search it locks like it is a iproute problem what is fixed in PVE 4.0.
So we will not try to fix this in PVE 3.4, because we have make or own iproute packed.
And in PVE 4 it is working.

spirit · Oct 21, 2015

wolfgang said:
After a log search it locks like it is a iproute problem what is fixed in PVE 4.0.
So we will not try to fix this in PVE 3.4, because we have make or own iproute packed.
And in PVE 4 it is working.

Thanks Wolfgang for debug this !

For proxmox 3.0, maybe iproute2 from wheezy-backport could help ?

https://packages.debian.org/wheezy-backports/iproute2

Search

Search

Eth rate limit -> unstable bandwidth

sigxcpu

Well-Known Member

sigxcpu

Well-Known Member

wolfgang

Proxmox Retired Staff

spirit

Distinguished Member

sigxcpu

Well-Known Member

wolfgang

Proxmox Retired Staff

spirit

Distinguished Member