Proxmox 2 SBS 2011 kvm installation kernel panic

[glanc]

Proxmox 2.0 updated to today goes in kernel panic during sbs 2011 standard installation. Used virtio both block and net. Tried two times with same issue. Installed Windows 7 Pro with virtio block/net without any problem. Server is a Fujitsu Primergy TX200 S6 with Raid Megasas controller 32GB RAM. Proxmox installed on a single drive and kvm images on lvm raid5 array. Attached pve version, kernel panic log and screenshot. Where to start to troubleshoot? Thanks a lot.

root@proxmox:~# pveversion -v
pve-manager: 2.0-37 (pve-manager/2.0/d6e2622b)
running kernel: 2.6.32-7-pve
proxmox-ve-2.6.32: 2.0-60
pve-kernel-2.6.32-7-pve: 2.6.32-60
lvm2: 2.02.88-2pve1
clvm: 2.02.88-2pve1
corosync-pve: 1.4.1-1
openais-pve: 1.1.4-2
libqb: 0.10.1-2
redhat-cluster-pve: 3.1.8-3
resource-agents-pve: 3.9.2-3
fence-agents-pve: 3.1.7-1
pve-cluster: 1.0-23
qemu-server: 2.0-23
pve-firmware: 1.0-15
libpve-common-perl: 1.0-15
libpve-access-control: 1.0-16
libpve-storage-perl: 2.0-12
vncterm: 1.0-2
vzctl: 3.0.30-2pve1
vzprocps: 2.0.11-2
vzquota: 3.0.12-3
pve-qemu-kvm: 1.0-5
ksm-control-daemon: 1.1-1
--------------------------------
Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:Oops: 0000 [#1] SMP

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:last sysfs file: /sys/kernel/uevent_seqnum

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:Stack:

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:Call Trace:

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:Code: ff ff ff ff 50 18 83 f8 01 0f 84 85 00 00 00 48 8b b5 40 ff ff ff 48 8b 86 08 01 00 00 48 8b 90 08 01 00 00 48 8b 88 a0 02 00 00 <48> 8b 42 58 48 85 c0 0f 85 d1 04 00 00 48 8b 95 70 ff ff ff 48

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:CR2: 0000000000000058

Message from syslogd@proxmox at Mar 1 15:35:54 ...
kernel:Kernel panic - not syncing: Fatal exception


Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:Oops: 0000 [#1] SMP

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:last sysfs file: /sys/kernel/uevent_seqnum

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:Stack:

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:Call Trace:

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:Code: ff ff ff ff 50 18 83 f8 01 0f 84 85 00 00 00 48 8b b5 40 ff ff ff 48 8b 86 08 01 00 00 48 8b 90 08 01 00 00 48 8b 88 a0 02 00 00 <48> 8b 42 58 48 85 c0 0f 85 d1 04 00 00 48 8b 95 70 ff ff ff 48

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:CR2: 0000000000000058

Message from syslogd@proxmox at Mar 1 17:33:57 ...
kernel:Kernel panic - not syncing: Fatal exception

 

[dietmar]

Seems you use ext4 on the host? Please can you test with ext3 instead?

 

[glanc]

Thanks for replying, do you mean on the lvm kvm image storage?

 

[dietmar]

Thanks for replying, do you mean on the lvm kvm image storage?

Yes. Or where do you use ext4?

 

[glanc]

Ok I'll try with to reformat my image lvm storage to xfs or ext3 and report back. But the win7 guest install worked with no trouble. The sbs install cause kernel panic during install always at the same point!

 

[dietmar]

But the win7 guest install worked with no trouble. The sbs install cause kernel panic during install always at the same point!

Yes, but the panic you posted seem to be ext4 related, so we should test that.

 

[glanc]

Yes, but the panic you posted seem to be ext4 related, so we should test that.

Sorry, I see you looked at the panic image posted, for the ext4. But for the kvm image storage I use a raid5 LVM group, so no filesystem there because virtual hardisk are created as devices like this:

--- Logical volume ---
LV Name /dev/DATASTORAGE/vm-100-disk-2
VG Name DATASTORAGE
LV UUID 4WmLZR-qXF5-3W6B-tXB3-Rr82-R66I-x4vzNd
LV Write Access read/write
LV Status NOT available
LV Size 500.00 GiB
Current LE 128000
Segments 1
Allocation inherit
Read ahead sectors auto

But I do get ext4 formatted USB HD used for dump backup! I'll try to remove it and see what happens!

 

[glanc]

Sorry, I see you looked at the panic image posted, for the ext4. But for the kvm image storage I use a raid5 LVM group, so no filesystem there because virtual hardisk are created as devices like this:

--- Logical volume ---
LV Name /dev/DATASTORAGE/vm-100-disk-2
VG Name DATASTORAGE
LV UUID 4WmLZR-qXF5-3W6B-tXB3-Rr82-R66I-x4vzNd
LV Write Access read/write
LV Status NOT available
LV Size 500.00 GiB
Current LE 128000
Segments 1
Allocation inherit
Read ahead sectors auto

But I do get ext4 formatted USB HD used for dump backup! I'll try to remove it and see what happens!

Hello,

I formatted my USB HD configured as a backup destination, to XFS, and during the sbs install proxmox begun to report problem with the usb device. But probably because XFS filesystem is more stable fs than ext4, the kernel didn't panic but xfs just disconnected the device and the sbs install finished without problems. You can find down what happened to the usb hd (probably a bad usb hd or not well supported on this debian version! A Freecom Mobile Drive XXS drive.) Thanks a lot for pointing me to the solution, I own you a beer! cya

---------

sd 5:0:0:0: Device offlined - not ready after error recovery
sd 5:0:0:0: [sdc] Unhandled error code
sd 5:0:0:0: [sdc] Result: hostbyte=DID_ABORT driverbyte=DRIVER_OK
sd 5:0:0:0: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
end_request: I/O error, dev sdc, sector 0
XFS (sdc1): xfs_do_force_shutdown(0x1) called from line 1056 of file fs/xfs/linux-2.6/xfs_buf.c. Return address = 0xffffffffa076c263
XFS (sdc1): I/O Error Detected. Shutting down filesystem
XFS (sdc1): Please umount the filesystem and rectify the problem(s)
VFS: Busy inodes after unmount. sb = ffff88083dc9e800, fs type = xfs, sb count = 1073741825, sb->s_root = /
inode = ffff88052e934a50, inode->i_count = 2, inode->i_nlink = 3, inode->i_mode = 16877, inode->i_state = 0, inode->i_flags = 0, inode->i_devices.next = ffff88052e934c48, inode->i_devices.prev = ffff88052e934c48, inode->i_ino = 128
inode dump: 00 00 00 00 00 00 00 00 28 a9 59 02 00 c9 ff ff 58 05 53 b4 01 88 ff ff 30 65 03 3b 04 88 ff ff c8 e8 c9 3d 08 88 ff ff 70 7a 76 53 03 88 ff ff f0 bb 39 3e 08 88 ff ff f0 bb 39 3e 08 88 ff ff 80 00 00 00 00 00 00 00 02 00 00 00 03 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 af d8 4f 4f 00 00 00 00 4b 94 ad 0e 00 00 00 00 af d8 4f 4f 00 00 00 00 4b 94 ad 0e 00 00 00 00 00 00 00 00 00 00 00 00 0c 00 00 00 00 00 ed 41 ac 01 ac 01 00 00 00 00 01 00 00 00 00 00 00 00 10 4b 93 2e 05 88 ff ff 10 4b 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 38 4b 93 2e 05 88 ff ff 38 4b 93 2e 05 88 ff ff 60 94 77 a0 ff ff ff ff c0 91 77 a0 ff ff ff ff 00 e8 c9 3d 08 88 ff ff 00 00 00 00 00 00 00 00 70 4b 93 2e 05 88 ff ff 50 4a 93 2e 05 88 ff ff 00 00 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 00 01 00 00 00 00 00 a0 4b 93 2e 05 88 ff ff a0 4b 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 a0 ea 3c 82 ff ff ff ff da 00 02 00 00 00 00 00 98 61 88 3b 08 88 ff ff 00 00 00 00 00 00 00 00 e8 4b 93 2e 05 88 ff ff e8 4b 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 48 4c 93 2e 05 88 ff ff 48 4c 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 70 4c 93 2e 05 88 ff ff 70 4c 93 2e 05 88 ff ff 01 00 00 00 00 00 00 00 88 4c 93 2e 05 88 ff ff 88 4c 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d_alias / d_count=2 d_flags=110
02 00 00 00 10 01 00 00 02 00 02 00 00 00 00 00 50 4a 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 70 bb 39 3e 08 88 ff ff 00 00 00 00 01 00 00 00 28 bc 39 3e 08 88 ff ff b0 bb 39 3e 08 88 ff ff b0 bb 39 3e 08 88 ff ff 90 2b aa 81 ff ff ff ff 70 0d 31 3b 04 88 ff ff d0 bb 39 3e 08 88 ff ff d0 bb 39 3e 08 88 ff ff e0 bb 39 3e 08 88 ff ff e0 bb 39 3e 08 88 ff ff 80 4a 93 2e 05 88 ff ff 80 4a 93 2e 05 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 e8 c9 3d 08 88 ff ff 00 00 00 00 00 00 00 00 e0 28 aa 81 ff ff ff ff 2f 00 6c 65 73 79 73 74 65 6d 73 00 64 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
mnt=ffff88083c10f800 count=1 flags=20 exp_mask=0
10 48 45 3e 08 88 ff ff 10 48 45 3e 08 88 ff ff 00 ab 45 3e 08 88 ff ff 00 a3 0c 3b 04 88 ff ff 70 bb 39 3e 08 88 ff ff 00 e8 c9 3d 08 88 ff ff 30 f8 10 3c 08 88 ff ff 30 f8 10 3c 08 88 ff ff 30 ab 45 3e 08 88 ff ff 40 ff 10 3c 08 88 ff ff 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 80 19 d5 3b 08 88 ff ff 10 5d c0 3f 08 88 ff ff 68 92 b5 3c 04 88 ff ff 78 f8 10 3c 08 88 ff ff 78 f8 10 3c 08 88 ff ff 88 f8 10 3c 08 88 ff ff 88 f8 10 3c 08 88 ff ff 98 f8 10 3c 08 88 ff ff 98 f8 10 3c 08 88 ff ff a8 f8 10 3c 08 88 ff ff a8 f8 10 3c 08 88 ff ff 00 00 00 00 00 00 00 00 00 5d c0 3f 08 88 ff ff 1a 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 54 27 60 af fb 60 00 00 00 00 00 00 00 00 00 00
usb 2-1: new high speed USB device using ehci_hcd and address 4
usb 2-1: device descriptor read/64, error -32
usb 2-1: device descriptor read/64, error -32
usb 2-1: new high speed USB device using ehci_hcd and address 5
usb 2-1: device descriptor read/64, error -32
usb 2-1: device descriptor read/64, error -32
usb 2-1: new high speed USB device using ehci_hcd and address 6
usb 2-1: device descriptor read/8, error -71
usb 2-1: device descriptor read/8, error -71
usb 2-1: new high speed USB device using ehci_hcd and address 7
usb 2-1: device descriptor read/8, error -71
usb 2-1: device descriptor read/8, error -71
hub 2-0:1.0: unable to enumerate USB device on port 1
usb 6-1: new full speed USB device using uhci_hcd and address 2
usb 6-1: device descriptor read/64, error -32
usb 6-1: device descriptor read/64, error -32
usb 6-1: new full speed USB device using uhci_hcd and address 3
usb 6-1: device descriptor read/64, error -32
usb 6-1: device descriptor read/64, error -32
usb 6-1: new full speed USB device using uhci_hcd and address 4
usb 6-1: device descriptor read/8, error -71
usb 6-1: device descriptor read/8, error -71
usb 6-1: new full speed USB device using uhci_hcd and address 5
usb 6-1: device descriptor read/8, error -71
usb 6-1: device descriptor read/8, error -71
hub 6-0:1.0: unable to enumerate USB device on port 1
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.
XFS (sdc1): xfs_log_force: error 5 returned.