Search results

I tried everything to resolve this on Proxmox 3.4. Finally resorted to switching to RedHat's oVirt. The I/O issues are gone. Same hardware, similar setup.

Have you folks altered your guest VM i/o scheduler and/or timing of cron.daily (mlocate/logrotate)?

I'm starting to wonder if my similar issues are NFS related as well. I'm not getting any errors on the host like you, but I do backups to an NFS mount, and crashes happen much more often during backups. I've un-mounted the NFS and haven't had any crashes since. (Though I'm looking to move to...

root@proxmox4:~# pveperf /var/lib/vz CPU BOGOMIPS: 67029.36 REGEX/SECOND: 992711 HD SIZE: 1506.85 GB (/dev/mapper/pve-data) BUFFERED READS: 379.42 MB/sec AVERAGE SEEK TIME: 7.01 ms FSYNCS/SECOND: 3189.62 DNS EXT: 218.45 ms DNS INT: 3.02 ms (lewis.local)

Good question! Megacli reports battery status optimal on all servers.

Perhaps some similar issues: http://forum.proxmox.com/threads/20372-Linux-guest-problems-on-new-Haswell-EP-processors http://forum.proxmox.com/threads/22488-VM-blocked-due-to-hung_task_timeout_secs http://forum.proxmox.com/threads/22573-NFS-freezes-Proxmox-WebGUI-and-fails-to-backup What...

root@proxmox4:~# pveversion -v proxmox-ve-2.6.32: 3.4-157 (running kernel: 3.10.0-10-pve) pve-manager: 3.4-6 (running version: 3.4-6/102d4547) pve-kernel-2.6.32-39-pve: 2.6.32-157 pve-kernel-3.10.0-10-pve: 3.10.0-34 lvm2: 2.02.98-pve4 clvm: 2.02.98-pve4 corosync-pve: 1.4.7-1 openais-pve: 1.1.4-3...

What kind of storage are you folks running? At the moment I'm using local storage: RAID6 on 10k SAS drives with the Dell Perc 6i. Servers are two Dell 2970's (AMD) and one 2950 (Intel) and all three boxes are exhibiting this hanging bug. All firmware is up-to-date.

I'm seeing it on guests with a variety of Ubuntu versions and Debian as well. Hardware-wise, I have two Dell 2970's (AMD) and one 2950 (Intel) and all three boxes are exhibiting this hanging bug. Storage is local RAID6 on Dell Perc6/i with 10k SAS drives. All firmware is up-to-date.

I've actually noticed the opposite: the hangs correlate with heavy I/O. ;-) Definitely happens more often during backups.

Yeah. That's been my observation, too. Ugly workaround, though. :( *Edit* I've tried SCSI, too. Only IDE works around the bug.

Proxmox has had issues recovering from failed backups for a long time. I hit this pretty often for various reasons and have to SSH in and use "qm unlock". :( http://forum.proxmox.com/threads/14249-Nightly-backup-causes-KVM-to-die-requiring-qm-unlock-to-restart...

I'm actually on AMD Opteron 2439 CPUs and having these hanging issues.

Worth a try... This change was on the host, not inside the VM, right?

Hmm... After we switched back to the 2.6 kernel the problem has actually gotten much worse. VMs hanging every few hours.

Any more updates on this? Still seems to be an issue judging by this recent thread: http://forum.proxmox.com/threads/22488-VM-blocked-due-to-hung_task_timeout_secs

Switching back to 2.6 kernel did not resolve. :( Cross referencing with another thread for more evidence on this bug: http://forum.proxmox.com/threads/20372-Linux-guest-problems-on-new-Haswell-EP-processors

That's good info, thanks! You mean the Proxmox kernel, not the kernel inside the VMs, right? So you were on the 3.x Proxmox kernel before?

Update: I had two more VMs crash over the weekend in this way. It's as if the virtio disk is just yanked out every once in a while. Interesting note: Doing a "reset" doesn't resolve it. I get disk errors after grub. I have to do a full stop, then start.

Possibly related? http://forum.proxmox.com/threads/22488-VM-blocked-due-to-hung_task_timeout_secs