Poor performance on HP ProLiant DL385 G7 12-core

[jaimito]

::RESOLVED SEE BELOW::

Hi,

After some successful testing on a smaller box I have purchased an HP G7 for hosting a small XP remote access farm.

Proxmox installs just fine, but the performance is poor, as the vm responsiveness is very slow. I appreciate that there are various possible issues with such new hardware.

I have tried with the three current kernels (KVM only obviously) and in no case is the perfomance right.

The box is currently set up with 5 disk RAID5 no hot spare and has BBC (p410i).

Here are some stats:

Linux proxmox1 2.6.24-11-pve #1 SMP PREEMPT Fri May 14 09:28:08 CEST 2010 x86_64
The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Fri Aug 27 16:12:05 2010 from 192.168.111.192
proxmox1:~# pveperf
CPU BOGOMIPS: 55203.30
REGEX/SECOND: 495327
HD SIZE: 94.49 GB (/dev/mapper/pve-root)
BUFFERED READS: 204.56 MB/sec
AVERAGE SEEK TIME: 5.30 ms
FSYNCS/SECOND: 127.46
DNS EXT: 78.31 ms
DNS INT: 16.81 ms (client.co.uk)

Linux proxmox1 2.6.32-2-pve #1 SMP Thu Apr 15 10:22:46 CEST 2010 x86_64
The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Mon Aug 30 06:38:00 2010 from 192.168.111.193
proxmox1:~# pveperf
CPU BOGOMIPS: 55202.66
REGEX/SECOND: 693088
HD SIZE: 94.49 GB (/dev/mapper/pve-root)
BUFFERED READS: 99.25 MB/sec
AVERAGE SEEK TIME: 5.46 ms
FSYNCS/SECOND: 25.17
DNS EXT: 312.13 ms
DNS INT: 19.14 ms (client.co.uk)

(second immediate run)
proxmox1:~# pveperf
CPU BOGOMIPS: 55202.66
REGEX/SECOND: 690405
HD SIZE: 94.49 GB (/dev/mapper/pve-root)
BUFFERED READS: 225.72 MB/sec
AVERAGE SEEK TIME: 5.27 ms
FSYNCS/SECOND: 27.71
DNS EXT: 160.16 ms
DNS INT: 18.35 ms (client.co.uk)

The fsyncs are horrible.

I would very much appreciate any hints as to what to chase to better the performance; I'm pretty new to Proxmox and KVM but have seen very good performance on other hardware.

TIA.

 

[tom]

....

The fsyncs are horrible.
TIA.

check if if you raid volume has the cache enabled (write-back). AFAIK HP servers does not aktivate the cache if the BBU is not fully charged, so you need to wait a bit. just see the messages on the console on server boot.

 

[jaimito]

Thanks for that. I'm currently on holiday and accessing via dial up modem (which restricts management possibilities somewhat but will check everything as soon as I am able and respond.

 

[jaimito]

Well,

this was a real slap-head issue. The server came WITH battery-backed cache and RAM but WITHOUT the battery. I forgive Purchasing for not detecting this!

Results after ordering and installing the battery and it getting charged (on 1.51 kernel):

proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      749114
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    212.33 MB/sec
AVERAGE SEEK TIME: 5.55 ms
FSYNCS/SECOND:     1250.30
DNS EXT:           111.93 ms
DNS INT:           20.09 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      708966
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    141.16 MB/sec
AVERAGE SEEK TIME: 5.48 ms
FSYNCS/SECOND:     1525.27
DNS EXT:           81.20 ms
DNS INT:           19.91 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      691842
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    177.02 MB/sec
AVERAGE SEEK TIME: 6.71 ms
FSYNCS/SECOND:     1310.30
DNS EXT:           88.52 ms
DNS INT:           37.69 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      705352
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    55.29 MB/sec
AVERAGE SEEK TIME: 8.34 ms
FSYNCS/SECOND:     1305.44
DNS EXT:           215.24 ms
DNS INT:           19.52 ms (client.co.uk)

With latest kernel:

proxmox1:~# pveversion -v
pve-manager: 1.6-2 (pve-manager/1.6/5087)
running kernel: 2.6.32-3-pve
proxmox-ve-2.6.32: 1.6-14
pve-kernel-2.6.32-3-pve: 2.6.32-14
pve-kernel-2.6.18-2-pve: 2.6.18-5
qemu-server: 1.1-18
pve-firmware: 1.0-7
libpve-storage-perl: 1.0-13
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-7
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.12.5-1
ksm-control-daemon: 1.0-4

proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      682186
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    239.51 MB/sec
AVERAGE SEEK TIME: 5.35 ms
FSYNCS/SECOND:     1182.09
DNS EXT:           1510.61 ms
DNS INT:           39.50 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      709069
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    222.60 MB/sec
AVERAGE SEEK TIME: 5.37 ms
FSYNCS/SECOND:     1225.39
DNS EXT:           583.96 ms
DNS INT:           144.76 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      728746
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    237.31 MB/sec
AVERAGE SEEK TIME: 5.35 ms
FSYNCS/SECOND:     1221.57
DNS EXT:           795.76 ms
DNS INT:           19.36 ms (client.co.uk)

Thanks for the support.

 

[ptlinva]

Thank you.

I just received (2) DL385 G7's with one 6172 12-core processor in each.

Performance was HORRIBLE and I couldn't figure out why...

I checked and I'm encountering your same issue... No battery present on the p410i accelerator card.

Why would HP ship the p410i without a battery on the accelerator? I don't get it...

Would you happen to have a part number?

Thanks!
Paul L.

 

[BiagioParuolo]

Well,

this was a real slap-head issue. The server came WITH battery-backed cache and RAM but WITHOUT the battery. I forgive Purchasing for not detecting this!

Results after ordering and installing the battery and it getting charged (on 1.51 kernel):

proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      749114
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    212.33 MB/sec
AVERAGE SEEK TIME: 5.55 ms
FSYNCS/SECOND:     1250.30
DNS EXT:           111.93 ms
DNS INT:           20.09 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      708966
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    141.16 MB/sec
AVERAGE SEEK TIME: 5.48 ms
FSYNCS/SECOND:     1525.27
DNS EXT:           81.20 ms
DNS INT:           19.91 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      691842
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    177.02 MB/sec
AVERAGE SEEK TIME: 6.71 ms
FSYNCS/SECOND:     1310.30
DNS EXT:           88.52 ms
DNS INT:           37.69 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.16
REGEX/SECOND:      705352
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    55.29 MB/sec
AVERAGE SEEK TIME: 8.34 ms
FSYNCS/SECOND:     1305.44
DNS EXT:           215.24 ms
DNS INT:           19.52 ms (client.co.uk)

With latest kernel:

proxmox1:~# pveversion -v
pve-manager: 1.6-2 (pve-manager/1.6/5087)
running kernel: 2.6.32-3-pve
proxmox-ve-2.6.32: 1.6-14
pve-kernel-2.6.32-3-pve: 2.6.32-14
pve-kernel-2.6.18-2-pve: 2.6.18-5
qemu-server: 1.1-18
pve-firmware: 1.0-7
libpve-storage-perl: 1.0-13
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-7
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.12.5-1
ksm-control-daemon: 1.0-4

proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      682186
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    239.51 MB/sec
AVERAGE SEEK TIME: 5.35 ms
FSYNCS/SECOND:     1182.09
DNS EXT:           1510.61 ms
DNS INT:           39.50 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      709069
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    222.60 MB/sec
AVERAGE SEEK TIME: 5.37 ms
FSYNCS/SECOND:     1225.39
DNS EXT:           583.96 ms
DNS INT:           144.76 ms (client.co.uk)
proxmox1:~# pveperf
CPU BOGOMIPS:      55202.39
REGEX/SECOND:      728746
HD SIZE:           94.49 GB (/dev/mapper/pve-root)
BUFFERED READS:    237.31 MB/sec
AVERAGE SEEK TIME: 5.35 ms
FSYNCS/SECOND:     1221.57
DNS EXT:           795.76 ms
DNS INT:           19.36 ms (client.co.uk)

Thanks for the support.

Gooooood Perf!