Kernel Panic crash troubleshooting help

[artisticab]

My system locked up middle of June, I read thru the forums and I found a similar post to my issue in that there was a possible bug with a previous pve 37 kernel; so I updated and didn't think anything about it. It looks like my system locked again yesterday around 15:39 and looks like a kernel panic again.

My system is a 4 server cluster, 2 servers Dell PowerEdge R720's, and 2 Dell PowerEdge 2950 III's. Only the two new Dell R720 servers kernel panic on in the cluster, the older servers are fine don't seem to do this...

I am not sure what I am looking for to identify where the problem is? I have posted the two log files here:

Syslog Log (15:39) http://pastebin.com/a6VJvSEK

Message Log (15:39) http://pastebin.com/eVQHk68D

I am running this build:

proxmox-ve-2.6.32: 3.4-156 (running kernel: 2.6.32-39-pve)
pve-manager: 3.4-6 (running version: 3.4-6/102d4547)
pve-kernel-2.6.32-39-pve: 2.6.32-157
lvm2: 2.02.98-pve4
clvm: 2.02.98-pve4
corosync-pve: 1.4.7-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.10-2
pve-cluster: 3.0-18
qemu-server: 3.4-6
pve-firmware: 1.1-4
libpve-common-perl: 3.0-24
libpve-access-control: 3.0-16
libpve-storage-perl: 3.0-33
pve-libspice-server1: 0.12.4-3
vncterm: 1.1-8
vzctl: 4.0-1pve6
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 2.2-10
ksm-control-daemon: 1.1-1
glusterfs-client: 3.5.2-1​

Any other suggestions where I should look would be appreciated.

 

[dietmar]

Saw this in the logs:

Storage Service The current firmware version 21.1.0-0007 is older than the required firmware version 21.2.0-0007 for a controller of model 0x1F38: Controller 0 (PERC H710 Mini)

 

[artisticab]

Dietmar, would this cause the issue?

Thank you for your help.

 

[dietmar]

You can find out by fixing the problem, the test again...