Adaptec 6xxx Performance

[svenr]

Intel S1200BTL Xeon 1220 8GB
Adaptec 6405 with ZMM
4x WD 5003ABYX

pve-manager: 1.8-18 (pve-manager/1.8/6070)
running kernel: 2.6.32-4-pve
proxmox-ve-2.6.32: 1.8-33
pve-kernel-2.6.32-4-pve: 2.6.32-33
qemu-server: 1.1-30
pve-firmware: 1.0-11
libpve-storage-perl: 1.0-17
vncterm: 0.9-2
vzctl: 3.0.27-1pve1
vzdump: 1.2-13
vzprocps: 2.0.11-2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.14.1-1
ksm-control-daemon: 1.0-6

Raid 5
pveperf:
BUFFERED READS: 380.76 MB/sec
AVERAGE SEEK TIME: 7.66 ms
FSYNCS/SECOND: 2148.42

hdparm:
Timing cached reads: 23646 MB in 2.00 seconds = 11841.29 MB/sec
Timing buffered disk reads: 1200 MB in 3.00 seconds = 399.84 MB/sec


Raid 5EE
pveperf:
BUFFERED READS: 251.21 MB/sec
AVERAGE SEEK TIME: 8.02 ms
FSYNCS/SECOND: 2094.53

hdparm:
Timing cached reads: 23638 MB in 2.00 seconds = 11834.81 MB/sec
Timing buffered disk reads: 772 MB in 3.00 seconds = 257.32 MB/sec


Raid 6
pveperf:BUFFERED READS: 255.16 MB/sec
AVERAGE SEEK TIME: 7.86 ms
FSYNCS/SECOND: 1884.16
hdparm:
Timing cached reads: 23614 MB in 2.00 seconds = 11822.96 MB/sec
Timing buffered disk reads: 782 MB in 3.00 seconds = 260.53 MB/sec


Raid 10
pveperf:
BUFFERED READS: 444.36 MB/sec
AVERAGE SEEK TIME: 7.60 ms
FSYNCS/SECOND: 2451.59

hdparm:
Timing cached reads: 24448 MB in 2.00 seconds = 12240.76 MB/sec
Timing buffered disk reads: 1498 MB in 3.00 seconds = 499.27 MB/sec

 

[svenr]

added raid10
now building raid 5ee

 

[svenr]

added raid6 values

 

[Oosterheert]

I hope you don't mind a short test for comparison:
HP DL-160, 2x Xeon quadcore E5405 @ 2.00GHz with 12GB RAM
3ware 9690SA with BBU
4x WD 500 GB (WD5002ABYS) in Raid 5
(currently running 6 active (K)VM's, none of them very heavy)

pveversion -v:
pve-manager: 1.7-10 (pve-manager/1.7/5323)
running kernel: 2.6.35-1-pve
proxmox-ve-2.6.35: 1.7-9
pve-kernel-2.6.32-4-pve: 2.6.32-30
pve-kernel-2.6.35-1-pve: 2.6.35-9
qemu-server: 1.1-25
pve-firmware: 1.0-10
libpve-storage-perl: 1.0-16
vncterm: 0.9-2
vzctl: 3.0.24-1pve4
vzdump: 1.2-10
vzprocps: 2.0.11-1dso2
vzquota: 3.0.11-1
pve-qemu-kvm: 0.13.0-3
ksm-control-daemon: 1.0-4

pveperf:
CPU BOGOMIPS: 31920.17
REGEX/SECOND: 653154
HD SIZE: 39.37 GB (/dev/mapper/pve-root)
BUFFERED READS: 251.48 MB/sec
AVERAGE SEEK TIME: 8.38 ms
FSYNCS/SECOND: 1343.03

Timing cached reads: 8494 MB in 2.00 seconds = 4251.83 MB/sec
Timing buffered disk reads: 856 MB in 3.00 seconds = 285.18 MB/sec

 

[frantek]

I've just installed a new 6405 controller with 6gbs disks:

CPU BOGOMIPS: 19998.24
REGEX/SECOND: 831972
HD SIZE: 9.99 GB (/dev/mapper/pve01-root)
BUFFERED READS: 142.45 MB/sec
AVERAGE SEEK TIME: 10.52 ms
FSYNCS/SECOND: 4711.97
DNS EXT: 164.75 ms

pretty cool for a 300 EUR device.

 

[FAN]

this is very small
6805 + 8 sas2 Seagate on raid 0

BUFFERED READS: 415 - 450 MB/sec

 

[frantek]

For me FSYNCS/SECOND has shown to be most important ... and I've 4 Seagate disks in one RAID 5

 

[FAN]

4 x 12 core AMD 6174
32 x 8Gb ddr3 ecc
RAID - Adaptec 6805
HDD raid - 8 x 1Tb Seagate SAS2 - stripe 512k
HDD sata - 320Gb WD (system)

# pveversion -v
pve-manager: 1.8-19 (pve-manager/1.8/6379)
running kernel: 2.6.35-2-pve
proxmox-ve-2.6.35: 1.8-12
pve-kernel-2.6.32-4-pve: 2.6.32-33
pve-kernel-2.6.35-2-pve: 2.6.35-12
qemu-server: 1.1-30
pve-firmware: 1.0-12
libpve-storage-perl: 1.0-17
vncterm: 0.9-2
vzctl: 3.0.28-1pve1
vzdump: 1.2.6-1
vzprocps: 2.0.11-2
vzquota: 3.0.12-3
pve-qemu-kvm: 0.14.1-1
ksm-control-daemon: 1.0-6


2 HDD - Raid 0 (Stripe)
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211205.27
REGEX/SECOND: 816797
HD SIZE: 1504.76 GB (/dev/mapper/pve-data)
BUFFERED READS: 395.42 MB/sec
AVERAGE SEEK TIME: 12.70 ms
FSYNCS/SECOND: 1344.73
DNS EXT: 64.28 ms
DNS INT: 2.24 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 6120 MB in 2.00 seconds = 3061.59 MB/sec
Timing buffered disk reads: 1230 MB in 3.00 seconds = 409.71 MB/sec

2 HDD - Raid 1 (Mirror)
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211204.77
REGEX/SECOND: 827927
HD SIZE: 885.88 GB (/dev/mapper/pve-data)
BUFFERED READS: 223.53 MB/sec
AVERAGE SEEK TIME: 13.26 ms
FSYNCS/SECOND: 1246.07
DNS EXT: 61.75 ms
DNS INT: 1.97 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 5942 MB in 2.00 seconds = 2972.46 MB/sec
Timing buffered disk reads: 654 MB in 3.15 seconds = 207.42 MB/sec

4 HDD - Raid 0
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211204.58
REGEX/SECOND: 810189
HD SIZE: 3665.31 GB (/dev/mapper/pve-data)
BUFFERED READS: 523.51 MB/sec
AVERAGE SEEK TIME: 16.32 ms
FSYNCS/SECOND: 1418.45
DNS EXT: 56.89 ms
DNS INT: 9.78 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 5980 MB in 2.00 seconds = 2991.66 MB/sec
Timing buffered disk reads: 1508 MB in 3.00 seconds = 502.19 MB/sec


4 HDD - Raid 5
============================
~# pveperf /var/lib/vz
CPU BOGOMIPS: 211203.71
REGEX/SECOND: 821567
HD SIZE: 2748.92 GB (/dev/mapper/pve-data)
BUFFERED READS: 147.24 MB/sec
AVERAGE SEEK TIME: 17.31 ms
FSYNCS/SECOND: 858.13
DNS EXT: 62.47 ms
DNS INT: 2.21 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 5760 MB in 2.00 seconds = 2881.29 MB/sec
Timing buffered disk reads: 470 MB in 3.00 seconds = 156.62 MB/sec

4 HDD - Raid 10
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211204.78
REGEX/SECOND: 851031
HD SIZE: 1832.53 GB (/dev/mapper/pve-data)
BUFFERED READS: 429.81 MB/sec
AVERAGE SEEK TIME: 11.30 ms
FSYNCS/SECOND: 1230.69
DNS EXT: 59.28 ms
DNS INT: 2.43 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 5994 MB in 2.00 seconds = 2998.16 MB/sec
Timing buffered disk reads: 1380 MB in 3.00 seconds = 459.50 MB/sec

8 HDD - Raid 0
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211204.81
REGEX/SECOND: 826875
HD SIZE: 3023.80 GB (/dev/mapper/pve-data)
BUFFERED READS: 559.78 MB/sec
AVERAGE SEEK TIME: 11.41 ms
FSYNCS/SECOND: 1266.66
DNS EXT: 60.01 ms
DNS INT: 2.26 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 6120 MB in 2.00 seconds = 3061.70 MB/sec
Timing buffered disk reads: 1596 MB in 3.00 seconds = 531.77 MB/sec


8 HDD - Raid 5
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211204.90
REGEX/SECOND: 814466
HD SIZE: 6414.48 GB (/dev/mapper/pve-data)
BUFFERED READS: 163.15 MB/sec
AVERAGE SEEK TIME: 15.33 ms
FSYNCS/SECOND: 976.45
DNS EXT: 60.19 ms
DNS INT: 1.97 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 6268 MB in 2.00 seconds = 3135.31 MB/sec
Timing buffered disk reads: 504 MB in 3.00 seconds = 167.83 MB/sec


8 HDD - Raid 10
============================
# pveperf /var/lib/vz
CPU BOGOMIPS: 211205.03
REGEX/SECOND: 815552
HD SIZE: 3665.32 GB (/dev/mapper/pve-data)
BUFFERED READS: 464.32 MB/sec
AVERAGE SEEK TIME: 11.65 ms
FSYNCS/SECOND: 1231.32
DNS EXT: 58.99 ms
DNS INT: 2.01 ms (xxx)

# hdparm -tT /dev/pve/data

/dev/pve/data:
Timing cached reads: 6186 MB in 2.00 seconds = 3094.88 MB/sec
Timing buffered disk reads: 1430 MB in 3.00 seconds = 476.55 MB/sec