slow transfer speed - help

R

raqdedicados

Renowned Member
Nov 26, 2008
85
0
71
HI there

I wonder if u could help me regarding this issue, we 're running promox ve on a dell 1950 16gb ram 2 x 300 SAS raid 1 perc 6 and two quad core 2.0 with 2 nics broadcom 1 gbit

We re using the bare metal edition of promox with this kernel
Linux raq102 2.6.24-1-pve #1 SMP PREEMPT Fri Oct 24 11:34:13 CEST 2008 x86_64 GNU/Linux

Smoothly we create 4 vm machines, al goes ok except for the speed of the nic adapters inside the vm' None one can achieve a transfer speed more than 1004k, the interface we use in every vm is venet: also we try transfer things betwheen servers that are on the same vlan, and the limit is 1004/6 as i told u.

Example . migrating a plesk server same vlan, without any speed limitation

200.49.152.99 (physical server) -----> 200.49.152.100 (VM promox)

both hardware are dell 1950 gigabit, but none vm can achieve more than 1004k tranfer

Here is an output of the ifconfig on the hardare node

raq102:~# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:21:9B:89:C9:6E
inet6 addr: fe80::221:9bff:fe89:c96e/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:29532378 errors:0 dropped:0 overruns:0 frame:0
TX packets:16459852 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:38241524665 (35.6 GiB) TX bytes:4008963759 (3.7 GiB)
Interrupt:16 Memory:f4000000-f4012100

eth1 Link encap:Ethernet HWaddr 00:21:9B:89:C9:6C
BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:16 Memory:f8000000-f8012100

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:192817 errors:0 dropped:0 overruns:0 frame:0
TX packets:192817 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:57097890 (54.4 MiB) TX bytes:57097890 (54.4 MiB)

venet0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
UP BROADCAST POINTOPOINT RUNNING NOARP MTU:1500 Metric:1
RX packets:16042957 errors:0 dropped:0 overruns:0 frame:0
TX packets:28142050 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:3616654920 (3.3 GiB) TX bytes:37557264517 (34.9 GiB)

vmbr0 Link encap:Ethernet HWaddr 00:21:9B:89:C9:6E
inet addr:200.49.152.102 Bcast:200.49.152.127 Mask:255.255.255.224
inet6 addr: fe80::221:9bff:fe89:c96e/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:28979045 errors:0 dropped:0 overruns:0 frame:0
TX packets:16445469 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:37629812324 (35.0 GiB) TX bytes:3940015712 (3.6 GiB)

* eth1 is not configured, we;re only using eht0.
* switch is linking at 1Gbit full duplex.
* downloading from the HN SSH to another server (physical or virtual but not promox) goes smooth and fast
* transferring things from vm to vm (promox) are at the same speed 1000k limit
* this behave is the same on ther 4 vm machines running
* beancounters are ok
* vm are template centos 5.2 32 bit

Any idea how to improve,fix this ?

Thanks !
 
Last edited:
Its the "Interrupt:16 Memory:f4000000-f4012100" you see in the ifconfig -a
I have install a cluster of 2 proxmox servers at my office as well.
1 acer server no problems, the other one is a dell poweredge with a gigabit nic shows also interupt 16. From time to time most of the packages are lost.

I have not figured it out, but i think it is a driver issue.
 
do u know some how to fix it ?
we have all dell powerdge servers, by the time only one with proxmox, the one that has the problem, if we can't fix this we will not install proxmox in the rest... :(
 
Tomorrow when i'm at the office i will give it a try.
If it doesn't work i replace them with a intel gb nic ;)

Because i like to keeps things default. If it isn't gonna be fixed in the bare metal installation of proxmox i'll go for a replacement nic.
 
In my case it's the:

lspci:
04:00.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5721 Gigabit Ethernet PCI Express (rev 11)

Dell uses most of the time this BCM57XX cards i believe
 
i think it's off because i cannot retrieve offload information with ethtool
No access to the bios right now i'm afraid.

Strange thing is, this server did run vmware, xenserver, freebsd for
years now and never had any problem with the onboard nic.
 
don't know what to do

Yes... same ... damm

07:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)

The extrange thing is that in same hardware we have been using vmware without problems, windows, or virtuozzo; we use venet adapter in the vm's , also try with bridge but is the same ... :(

i think that this is also causing the io delays that are reported in the web control panel...
 
raqdedicados said:
The extrange thing is that in same hardware we have been using vmware without problems, windows, or virtuozzo; we use venet adapter in the vm's , also try with bridge but is the same ... :(
Click to expand...

With amd64 architecture, and kernel 2.6.24?
 
Linux raq102 2.6.24-1-pve #1 SMP PREEMPT Fri Oct 24 11:34:13 CEST 2008 x86_64 GNU/Linux

2 x quad core 2.0 xeon
 
Sure, but you reported that it previously worked without problem. Does your 'previous' tests was on amd64 with 2.6.24 kernels too?
 
Yes, sorry for that, when we increase the ve0 units on the vz.conf we think that the matter was solved but then discover that the transfer speed was not working well too, not in a sustain way, we have several breakdowns... from 23mbits goes down suddenly to 4mbits...so we believe the problem persits...

we discard the switch coz with other servers, with other os, the file transfer is ok
 
I checked the sources again, and we use the standard bnx2 driver.

# modinfo bnx2

states that there is one parameter - disable_msi

Please can one of you test if that avoids the problem?

- Dietmar
 
lsmod doesn't show the bnx2, it does show the tg3. Isn't that also used for the broadcom cards?, or must i first have some extra cups of coffee :)
 
Ok, so you use different card with different drivers:

NetXtreme = tg3
NetXtreme II = bnx2

So I guess your bugs are not related at all.
 
o ok,

well i think i'm gonna disable the onboard card and install an Intel nic,

This server is a production server and cost to much time at the moment
and going to find the solution on a spare dell server i will install this week.

I will of course try to resolve such issues to do something back for your great work on this product. I use it more and more now at my clients.
If there is anything else i can help you with, i would like to do so.
 
here is the output we have two nextetreem ii cards

raq102:~# modinfo bnx2
filename: /lib/modules/2.6.24-1-pve/kernel/drivers/net/bnx2.ko
author: Michael Chan <mchan@broadcom.com>
description: Broadcom NetXtreme II BCM5706/5708 Driver
license: GPL
version: 1.6.9
vermagic: 2.6.24-1-pve SMP preempt mod_unload
depends:
alias: pci:v000014E4d0000164Asv0000103Csd00003101bc*sc*i*
alias: pci:v000014E4d0000164Asv0000103Csd00003106bc*sc*i*
alias: pci:v000014E4d0000164Asv*sd*bc*sc*i*
alias: pci:v000014E4d0000164Csv*sd*bc*sc*i*
alias: pci:v000014E4d000016AAsv0000103Csd00003102bc*sc*i*
alias: pci:v000014E4d000016AAsv*sd*bc*sc*i*
alias: pci:v000014E4d000016ACsv*sd*bc*sc*i*
alias: pci:v000014E4d00001639sv*sd*bc*sc*i*
alias: pci:v000014E4d0000163Asv*sd*bc*sc*i*
srcversion: 11CBDC5DF45973B5CB3C913
parm: disable_msi:Disable Message Signaled Interrupt (MSI) (int)

How do i disable this ?? thankss? more coffeeeee tooo!
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom