strange lan performance ...

[El Muchacho]

i'm currently testing proxmox 3.1
(i3 with raid10, realtek-nic for wan access, intel gb nic for lan access ...)
1st VM is OpenMediaVault ... connected to the intel nic with VirtIO
transfer of a 1 GB file from a win7-host to a smb-share works with only 11 MB/s ...
so i installed samba direct on proxmox an tested with same file ... result: about 100MB/s!

checked also bandwith with iperf ...

win7 -> omv ~850 Mbits/sec
backwards the same ...

win7 -> proxmox-host ~ 900 MBits/sec
backwards the same ...

omv -> proxmox-host ~ 4.5 GBits/sec
backwards the same ...

question now:

if iperf on win7 -> omv results in about 850MBits/sec, how can the transfer-rate to the smb-share be so low?
tested also with backport-kernel on omv, because it's still debian squeeze ... result: transfer rate slowed down to 4 MBits/sec!

tested again with a win7-vm with virtio nic ...
same result ...
iperf shows top scores ... real transfer slowed down ...

tested also pure omv-install on same hardware ... top results ... iperf great, transfer-rate 100 MBits/sec ...

so i think, this can't be a "simple" hardware problem ...
looks like a driver-problem or a config error ...

but where ???

any ideas ???

regards

Rico

 

[udo]

i'm currently testing proxmox 3.1
(i3 with raid10, realtek-nic for wan access, intel gb nic for lan access ...)
1st VM is OpenMediaVault ... connected to the intel nic with VirtIO
transfer of a 1 GB file from a win7-host to a smb-share works with only 11 MB/s ...
so i installed samba direct on proxmox an tested with same file ... result: about 100MB/s!

checked also bandwith with iperf ...

win7 -> omv ~850 Mbits/sec
backwards the same ...

win7 -> proxmox-host ~ 900 MBits/sec
backwards the same ...

omv -> proxmox-host ~ 4.5 GBits/sec
backwards the same ...

question now:

if iperf on win7 -> omv results in about 850MBits/sec, how can the transfer-rate to the smb-share be so low?
tested also with backport-kernel on omv, because it's still debian squeeze ... result: transfer rate slowed down to 4 MBits/sec!

tested again with a win7-vm with virtio nic ...
same result ...
iperf shows top scores ... real transfer slowed down ...

tested also pure omv-install on same hardware ... top results ... iperf great, transfer-rate 100 MBits/sec ...

so i think, this can't be a "simple" hardware problem ...
looks like a driver-problem or a config error ...

but where ???

any ideas ???

regards

Rico

Hi Rico,
your network speed looks good, so perhaps it's an IO-Problem?
How fast is your storage (from host and VM)? (with sync)
How looks your VM-config?

Have you tried open-attic instead of OMV ?

Udo

 

[El Muchacho]

IO-problem ... thought of that too ...
hdparm on host and guest shows nearly identic rates ...

host (/var/lib/vz)

root@proxmox2:~# hdparm -tT /dev/sdb

/dev/sdb:
Timing cached reads: 14990 MB in 2.00 seconds = 7499.39 MB/sec
Timing buffered disk reads: 984 MB in 3.01 seconds = 327.44 MB/sec

omv (virtio-drive)

root@srvomv:~# hdparm -tT /dev/vdb

/dev/vdb:
Timing cached reads: 13380 MB in 2.00 seconds = 6701.67 MB/sec
Timing buffered disk reads: 1056 MB in 3.00 seconds = 351.80 MB/sec

i'm sorry ... but i don't know how to check sync ...

pveperf

root@proxmox2:~# pveperf
CPU BOGOMIPS: 26340.48
REGEX/SECOND: 1547360
HD SIZE: 57.09 GB (/dev/mapper/pve-root)
BUFFERED READS: 60.97 MB/sec
AVERAGE SEEK TIME: 13.93 ms
FSYNCS/SECOND: 825.56
DNS EXT: 46.18 ms
DNS INT: 0.85 ms (test.lan)

qm config

root@proxmox2:~# qm config 101
bootdisk: virtio0
cores: 1
ide2: isos:iso/openmediavault_0.5.0.24_i386.iso,media=cdrom
keyboard: de
memory: 1024
name: openmediavault
net0: virtio=42:AE:62:79:99:1F,bridge=vmbr0
onboot: 1
ostype: l26
sockets: 1
vga: std
virtio0: vm101:101/vm-101-disk-1.qcow2,format=qcow2,size=10G
virtio1: vm101:101/vm-101-disk-2.raw,format=raw,size=500G

 

[udo]

Hi,
you meassure cache speed!

Try this on the host - and (with different path inside the VM):

dd if=/dev/zero of=/var/lib/vz/bigfile bs=1024k count=8192 conv=fdatasync

 echo 3 > /proc/sys/vm/drop_caches 

dd if=/var/lib/vz/bigfile of=/dev/null  bs=1024k

Udo

 

[El Muchacho]

sry 4 late reply ...
here we go :
HOST :

dd if=/dev/zero of=/var/lib/vz/bigfile bs=1024k count=8192 conv=fdatasync
8192+0 records in
8192+0 records out
8589934592 bytes (8.6 GB) copied, 34.7308 s, 247 MB/s

dd if=/var/lib/vz/bigfile of=/dev/null bs=1024k
8192+0 records in
8192+0 records out
8589934592 bytes (8.6 GB) copied, 26.9389 s, 319 MB/s

VM :

dd if=/dev/zero of=/media/6ef61676-d928-4e93-916f-a127f47b7315/storage/bigfile bs=1024k count=8192 conv=fdatasync
8192+0 Datensätze ein
8192+0 Datensätze aus
8589934592 Bytes (8,6 GB) kopiert, 73,0809 s, 118 MB/s

dd if=/media/6ef61676-d928-4e93-916f-a127f47b7315/storage/bigfile of=/dev/null bs=1024k
8192+0 Datensätze ein
8192+0 Datensätze aus
8589934592 Bytes (8,6 GB) kopiert, 29,0284 s, 296 MB/s

I/O prob in VM ...

write : 118 MB/s
read : 296 MB/s

 

[kobuki]

I think your 850Mb is fine. I'm achieving full Gbit on a Debian 7 Wheezy VM (my home nas VM), but OMV uses only Debian 6 Squeeze. Maybe the Virtio driver is older so performance is a little worse. Try a new Debian installation.

 

[ScOut3R]

I've also experienced network and IO performance problems with "older" linux kernels. Try something 3.8+ and you'll see the difference!