Performance with write cache on hp smart array p410i ?

I dont think this problem is related to your controller. We run around 20 Proliant servers with smart array controllers and we dont have any issue with proxmox.
Yes, if a newer firmware is available, perform the update.
 
Hi sumsum,

thanls for reply, but if hdd run on 1.5 and not on 6GBPS, what can we do, we have normal connect the hdd´s to hdd cage, how can we change 1.5 to 6GBPS?

regards
 
no problem, i would contact hp for this question. thanks for your infos and have a nice day.

best regards
 
@sumsum

I got the battery, must I wait the charging or can I activate the cache right now ?

Code:
root@proxmox2:~# hpacucli ctrl all show detail

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: Temporarily Disabled
   Cache Status Details: Cache disabled; low batteries.
   Cache Ratio: 0% Read / 100% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: Recharging
   SATA NCQ Supported: True
 
When batteries are fully charged your cache should be enabled.

Btw. your cache ratio seems weird. You have 0% Read / 100% Write I would expect something like 50% < Read < 75%
 
OK, I made a quick and dirty testscript...


Code:
#!/bin/bash


rm -rf tune-hp-server.txt


for i in $(seq 5 10 100)
do
        k=`expr 100 - $i`

        hpacucli ctrl slot=0 modify cacheratio=$i/$k >> tune-hp-server.txt

        echo "--------------------------------------------------------------------------------------------" >> tune-hp-server.txt

        hpacucli ctrl all show detail >> tune-hp-server.txt

        echo "--------------------------------------------------------------------------------------------" >> tune-hp-server.txt

        pveperf  >> tune-hp-server.txt

        echo "--------------------------------------------------------------------------------------------" >> tune-hp-server.txt
        echo "--------------------------------------------------------------------------------------------" >> tune-hp-server.txt

done


exit 0





Please take a look on it and give me a hint, I like to use two win7 clients with ms-sql-db and one linux fileserver (sme8).


Code:
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 5% Read / 95% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      870102
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    643.39 MB/sec
AVERAGE SEEK TIME: 5.68 ms
FSYNCS/SECOND:     2375.20
DNS EXT:           210.28 ms
DNS INT:           65.34 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 15% Read / 85% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      835913
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    721.65 MB/sec
AVERAGE SEEK TIME: 5.71 ms
FSYNCS/SECOND:     2218.89
DNS EXT:           79.03 ms
DNS INT:           51.99 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 25% Read / 75% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      851571
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    741.38 MB/sec
AVERAGE SEEK TIME: 10.70 ms
FSYNCS/SECOND:     2210.80
DNS EXT:           79.00 ms
DNS INT:           35.45 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 35% Read / 65% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      854589
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    738.19 MB/sec
AVERAGE SEEK TIME: 6.38 ms
FSYNCS/SECOND:     2267.43
DNS EXT:           63.58 ms
DNS INT:           68.86 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 45% Read / 55% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      872389
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    720.97 MB/sec
AVERAGE SEEK TIME: 5.52 ms
FSYNCS/SECOND:     2316.35
DNS EXT:           89.34 ms
DNS INT:           36.27 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 55% Read / 45% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      837067
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    693.93 MB/sec
AVERAGE SEEK TIME: 8.63 ms
FSYNCS/SECOND:     2174.51
DNS EXT:           72.22 ms
DNS INT:           43.07 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 65% Read / 35% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      834209
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    751.16 MB/sec
AVERAGE SEEK TIME: 5.61 ms
FSYNCS/SECOND:     2359.88
DNS EXT:           100.61 ms
DNS INT:           52.80 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 75% Read / 25% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      838711
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    727.88 MB/sec
AVERAGE SEEK TIME: 4.93 ms
FSYNCS/SECOND:     2237.45
DNS EXT:           70.43 ms
DNS INT:           41.26 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 85% Read / 15% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      853333
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    725.65 MB/sec
AVERAGE SEEK TIME: 5.50 ms
FSYNCS/SECOND:     1464.94
DNS EXT:           76.63 ms
DNS INT:           40.20 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------

Smart Array P410i in Slot 0 (Embedded)
   Bus Interface: PCI
   Slot: 0
   Serial Number: 50014380145BE9A0
   Cache Serial Number: PACCQ9SXTI23
   RAID 6 (ADG) Status: Enabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.40
   Rebuild Priority: Medium
   Expand Priority: Medium
   Surface Scan Delay: 15 secs
   Surface Scan Mode: Idle
   Queue Depth: Automatic
   Monitor and Performance Delay: 60  min
   Elevator Sort: Enabled
   Degraded Performance Optimization: Disabled
   Inconsistency Repair Policy: Disabled
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: OK
   Cache Ratio: 95% Read /  5% Write
   Drive Write Cache: Enabled
   Total Cache Size: 256 MB
   Total Cache Memory Available: 144 MB
   No-Battery Write Cache: Disabled
   Cache Backup Power Source: Batteries
   Battery/Capacitor Count: 1
   Battery/Capacitor Status: OK
   SATA NCQ Supported: True

--------------------------------------------------------------------------------------------
CPU BOGOMIPS:      17060.44
REGEX/SECOND:      841159
HD SIZE:           19.69 GB (/dev/mapper/pve-root)
BUFFERED READS:    717.17 MB/sec
AVERAGE SEEK TIME: 5.03 ms
FSYNCS/SECOND:     2307.18
DNS EXT:           72.33 ms
DNS INT:           35.36 ms (domain.at)
--------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------
 
your fsync is much improved so now we can look at other issues.

1) What file system is on /var/lib/vz?
2) What are the mount options on /var/lib/vz?
 
Code:
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=3597672,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=2880192k,mode=755)
/dev/mapper/pve-root on / type ext3 (rw,relatime,errors=remount-ro,user_xattr,acl,barrier=0,data=ordered)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /run/shm type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5760360k)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
/dev/mapper/pve-data on /var/lib/vz type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=0,data=ordered)
/dev/sda2 on /boot type ext3 (rw,relatime,errors=continue,user_xattr,acl,barrier=0,data=ordered)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
beancounter on /proc/vz/beancounter type cgroup (rw,relatime,blkio,name=beancounter)
container on /proc/vz/container type cgroup (rw,relatime,freezer,devices,name=container)
fairsched on /proc/vz/fairsched type cgroup (rw,relatime,cpuacct,cpu,cpuset,name=fairsched)




Code:
Filesystem            Size  Used Avail Use% Mounted on
udev                   10M     0   10M   0% /dev
tmpfs                 2.8G  368K  2.8G   1% /run
/dev/mapper/pve-root   20G  1.3G   18G   7% /
tmpfs                 5.0M     0  5.0M   0% /run/lock
tmpfs                 5.5G  3.1M  5.5G   1% /run/shm
/dev/mapper/pve-data  5.7T   94G  5.6T   2% /var/lib/vz
/dev/sda2             494M   58M  411M  13% /boot
/dev/fuse              30M   16K   30M   1% /etc/pve
 
Yes, I made a 2nd Guest with only 500GB hdd, this works just normal but the 1TB Guest is still not working ???

I think I should build a 3rd with 1TB and test the qmrestore again ?
 
I would like to test pve-data but got an error:

Code:
pveperf /dev/mapper/pve-data

CPU BOGOMIPS:      17062.96
REGEX/SECOND:      847841
HD SIZE:           5759.09 GB (/dev/mapper/pve-data)
BUFFERED READS:    715.12 MB/sec
AVERAGE SEEK TIME: 6.89 ms
open failed at /usr/bin/pveperf line 83.


pve-root works just fine...
 
OK, thank you... The output is:

Code:
root@proxmox2:~# pveperf /var/lib/vz/
CPU BOGOMIPS:      17062.76
REGEX/SECOND:      838501
HD SIZE:           5759.09 GB (/dev/mapper/pve-data)
BUFFERED READS:    727.22 MB/sec
AVERAGE SEEK TIME: 6.82 ms
FSYNCS/SECOND:     2226.42
DNS EXT:           46.89 ms
DNS INT:           18.13 ms
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!