10GB Ethernet issues.

[chorata]

Hello to all,



I have two servers with Proxmox 4.1



Server One:

CPU: 2x Intel Xeon E5-2620 2.00GHz

RAM: 125GB

HDD: 16x 2GB = Raid6 = 24TB

Symbios Logic MegaRAID SAS 2208



Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)



Server two(Backup Server For HA):

CPU: 2x Intel Xeon E5335 2.00GHz

RAM: 32GB

HDD: 16x 2GB = raid6 = 24TB

3ware se9650



Broadcom Corporation BCM57840 NetXtreme II 10 Gigabit Ethernet



The main issue is that whatever do Proxmox server 01 is moving or backup Virtual Machines to Proxmox server 02 with network speed of 34MB to 102MB witch is very slow. Iven with NFS Share from Proxmox server 02 to Proxmox server 01 the speed is slow.



If the card MTU is 1500 or 3900 or 9200 it does not matter.



IPerf results:

------------------------------------------------------------

Client connecting to 10.10.169.1, TCP port 5001

TCP window size: 85.0 KByte (default)

------------------------------------------------------------

[ 3] local 10.10.169.2 port 55752 connected with 10.10.169.1 port 5001

[ ID] Interval Transfer Bandwidth

[ 3] 0.0-10.0 sec 10.9 GBytes 9.39 Gbits/sec



PLS Help.

 

[chorata]

INFO: status = running
INFO: update VM 108: -lock backup
INFO: backup mode: suspend
INFO: bandwidth limit: 100000000 KB/s
INFO: ionice priority: 7
INFO: started backup task 'e49774dc-35e6-43dc-91d1-dfd4e35ce58e'
INFO: status: 0% (53215232/162135015424), sparse 0% (15618048), duration 3, 17/12 MB/s
INFO: status: 1% (1653473280/162135015424), sparse 0% (139915264), duration 31, 57/52 MB/s
INFO: status: 2% (3249930240/162135015424), sparse 0% (190189568), duration 75, 36/35 MB/s
INFO: status: 3% (4884398080/162135015424), sparse 0% (248782848), duration 104, 56/54 MB/s
INFO: status: 4% (6488457216/162135015424), sparse 0% (290648064), duration 135, 51/50 MB/s
INFO: status: 5% (8130527232/162135015424), sparse 0% (342196224), duration 164, 56/54 MB/s
INFO: status: 6% (9764995072/162135015424), sparse 0% (392429568), duration 193, 56/54 MB/s
INFO: status: 7% (11376656384/162135015424), sparse 0% (470654976), duration 232, 41/39 MB/s
INFO: status: 8% (13022527488/162135015424), sparse 0% (548163584), duration 262, 54/52 MB/s
INFO: status: 9% (14596177920/162135015424), sparse 0% (594141184), duration 292, 52/50 MB/s
INFO: status: 10% (16219242496/162135015424), sparse 0% (644141056), duration 366, 21/21 MB/s
INFO: status: 11% (17842307072/162135015424), sparse 0% (694554624), duration 455, 18/17 MB/s
INFO: status: 12% (19488178176/162135015424), sparse 0% (738631680), duration 494, 42/41 MB/s
INFO: status: 13% (21103640576/162135015424), sparse 0% (786886656), duration 563, 23/22 MB/s
INFO: status: 14% (22742040576/162135015424), sparse 0% (837066752), duration 596, 49/48 MB/s
INFO: status: 15% (24326963200/162135015424), sparse 0% (887246848), duration 639, 36/35 MB/s
INFO: status: 16% (25942425600/162135015424), sparse 0% (937422848), duration 753, 14/13 MB/s

 

[iptgeek]

I'm not sure this is a proxmox issue - iperf shows your network is working ok.

how does local disk performance look?

 

[chorata]

This is the preformance of the local disk.

hdparm -Tt /dev/mapper/pve-data

/dev/mapper/pve-data:
Timing cached reads: 13494 MB in 2.00 seconds = 6753.47 MB/sec
Timing buffered disk reads: 3100 MB in 3.00 seconds = 1033.20 MB/sec

And what this looks like?
INFO: status: 55% (5047769235456/9174050144256), sparse 48% (4472829063168), duration 54925, 2564/0 MB/s
INFO: status: 56% (5137854824448/9174050144256), sparse 49% (4562909155328), duration 54960, 2573/0 MB/s
INFO: status: 57% (5231503278080/9174050144256), sparse 50% (4656551890944), duration 54998, 2464/0 MB/s
INFO: status: 58% (5322078617600/9174050144256), sparse 51% (4747121700864), duration 55035, 2447/0 MB/s
INFO: status: 59% (5414602866688/9174050144256), sparse 52% (4839640305664), duration 55072, 2500/0 MB/s

 

[chorata]

This is local disk working now and a backup is preforming.
xDiskName Busy Read WriteMB|0 |25 |50 |75 100| x
xsda 29% 26.1 0.1|RRRRRRRRRRRRRRR > | x
xsda1 0% 0.0 0.0|> | qqqqqqqqx
xsda2 1% 0.0 0.0|> | x
xsda3 28% 26.1 0.1|RRRRRRRRRRRRRRR > | x
xdm-0 4% 0.0 0.1|RW > | x
xdm-1 0% 0.0 0.0|> | x
xdm-2 24% 26.1 0.0|RRRRRRRRRRRR > |

 

[chorata]

I fix it with. https://forum.proxmox.com/threads/speed-up-vzdump-using-pigz.5967/

 

[emiliano]

Hi, I want to use my network device in 1gb speed and not the options that come with proxmox by default. How can I configure what I need?