10 G Link - KVM VM

[MichaelSchinzel]

Hello,

i have a Proxmox Host with 10 G Fiber Uplink and want to have this 10 G Fiber Uplink at a KVM Virtual Maschine as Network device.

As some special thing, we have differen V-LANs at this 10 G Link, so we have added bridged V-LAN Ports.

Has someone an idea for best practise? I see in the Proxmox Panel only the way to add 1 G Devices.

Yours sincerely

Michael Schinzel

 

[tom]

Do you use virtio network? If not, try it.

 

[MichaelSchinzel]

Do you use virtio network? If not, try it.

https://www.ip-projects.de/astaro-config.png

I have

 

[MichaelSchinzel]

I have tested it, the link speed of virto drive is only 1 G

output.dat 1% 121MB 11.4MB/s

 

[tom]

Can you test your network with a Debian Wheezy as guest (instead of astaro)?

 

[MichaelSchinzel]

ok, i have installed a Debian 7 VM.

Same configuration with Network Devices and KVM.

QSC Testfile: 2% [===> ] 126.825.600 10,2M/s ETA 7m 34s
OVH Testfile: 0% [> ] 97.446.656 10,3M/s

It dont looks like 10.000 Mbit/s Or the Download Mirrors are very small. Mmm difficult to test it. I will try it with the second 10 G Server.

 

[tom]

seems the limit are not the KVM nics. measure the nic performance between two Wheezy KVM guests with virtio, using iperf.

update:

just installed two wheezy on a 5 years old server test machine, here is the iperf result between them.

root@weheezy-iperf2:~# iperf  -c 192.168.2.198
------------------------------------------------------------
Client connecting to 192.168.2.198, TCP port 5001
TCP window size: 23.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.2.199 port 56007 connected with 192.168.2.198 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  6.75 GBytes  5.80 Gbits/sec

 

[bert64]

If you have 2x 10G servers, try running iperf between them?
Downloading from external mirror sites will rarely be that fast, most of them will be 100mb or 1gb at best and could be highly loaded by other users (your examples look like 100mb).

 

[MichaelSchinzel]

Hello Guys,

Sry for the late response. Much work with business last days.

I think i am on the way to solve the problem I think it is the port Bonding i added at proxmox host 1 which is the problem. I configured the network like http://pve.proxmox.com/wiki/Vlans but THIS IS NOT THE BEST CASE!

I have now done the following testing:

Configured Proxmox Host 2 with the following configuration:

# Netzwerkkartenauto lo
iface lo inet loopback


iface eth0 inet manual


iface eth1 inet manual


iface eth2 inet manual


auto eth3
iface eth3 inet manual




# V-LAN 165
auto eth3.165
iface eth3.165 inet manual


# V-LAN 240
auto eth3.240
iface eth3.240 inet manual


# Admin Interface Proxmox
auto vmbr0
iface vmbr0 inet static
address <IP>
netmask 255.255.255.0
gateway <Gateway>
bridge_ports eth3.165
bridge_stp off
bridge_fd 0


auto vmbr240
iface vmbr240 inet static
address 10.0.2.41
netmask 255.255.255.252
bridge_ports eth3.240
bridge_stp off
bridge_fd 0

V-LAN 240 is one of our V-LANs. After this, i have installed a VM on Proxmox Host 2 at V-LAN 240 and installed Apache + a File with 10 G.

The Result:
Download at Host 1 directly at Proxmox Debian ->
31% [==========> ] 2,628,841,272 107M/s eta 43s

--- Do it baby! ---

Download at Host 1 at one Debian Test VM, same configuration linke Proxmox Host 2
3% [> ] 323.472.632 34,3M/s ETA 3m 24s

How Shocking. It seems that its not good

The network Configuration at Proxmox Host 1 is:

# network interface settings
auto bond0.165
iface bond0.165 inet manual
vlan-raw-device bond0


auto bond0.240
iface bond0.240 inet manual
vlan-raw-device bond0


auto bond0.704
iface bond0.704 inet manual
vlan-raw-device bond0


auto bond0.707
iface bond0.707 inet manual
vlan-raw-device bond0


auto bond0.726
iface bond0.726 inet manual
vlan-raw-device bond0


auto bond0.730
iface bond0.730 inet manual
vlan-raw-device bond0


auto bond0.900
iface bond0.900 inet manual
vlan-raw-device bond0


auto lo
iface lo inet loopback


iface eth0 inet manual


iface eth1 inet manual


iface eth2 inet manual


iface eth3 inet manual

auto bond0
iface bond0 inet manual
slaves eth3
bond_miimon 100
bond_mode balance-tlb




#MGMT-Interface
auto vmbr0
iface vmbr0 inet static
address <IP>
netmask 255.255.255.0
gateway <Gateway>
# bridge_ports eth0
bridge_ports bond0.165
bridge_stp off
bridge_fd 0




#VM-Interfaces
auto vmbr240
iface vmbr240 inet static
address 10.0.2.40
netmask 255.255.255.252
bridge_ports bond0.240
bridge_stp off
bridge_fd 0


auto vmbr704
iface vmbr704 inet static
address 10.0.70.4
netmask 255.255.255.252
bridge_ports bond0.704
bridge_stp off
bridge_fd 0

i think, this configuration is the problem, so i will try the next days to change this configuration to the same configuration like host 2. This take some days because it is a productive System with active Customers on it

 

[MichaelSchinzel]

ok, the change of the network configuration has nothing changed at the situation. Interessting.


So actually there is the following Problem.

Proxmox Host 1
--> Download directly at the Host from Test VM: TOP SPEED - over 140 MB/s ...
----> Download at installed Debian VM, same like at Host 2: No good Speed - about 30-40 MB/s with first Peak over 100 MB/s after 1 second 30-40 MB/s

Proxmox Host 2
--> Test VM with Debian and Downloadfile


It seems like a traffic shaper, but nothing is installed and if the problem is before the Traffic come to the Server, the download speed of the Proxmox Host 1 would be not good. So there must be something between Host and VM ... but what, thats the Question.

Some more details to the VM:
There are 8 KVM VMs installed on the Server. - Stopping the Other VMs and only run the test VM has nothing changed at the situation - Each VM has 10 Virtual Network Devices - Virtio. There are 6 V-LANs tagged in the network configuration.


Has somebody any idea?

 

[MichaelSchinzel]

Ok, nobody? I had an idea.

Drive Speed. I have installed the test VM at host 1 with sata drive, and the vm at host2 with Virtio HDD Drive. I have now changed test VM on Host 1 and TADA! 100 MB/s speed.

At the Server, we have installed SAS Discs in Hardware RAID 10, good way So perfect! It works now and i must only change all the VMs to Virtio HDD Drive.


Learnings: For Low Performance - Use SATA and Intel Cards, For High Performance - only use Virtio Drives!

I hope, this help other People with Problems like this in Future.