1.9 host freezing up, eventually rebooting

nekatreven

Member
Aug 31, 2010
31
0
6
I'm having an issue where one of the two hosts in our 1.9 cluster (the slave) is freezing up. When this is happening there is no video output and apparently no disk or network activity. The first time was during the day so I restarted it but the second time I wasn't able to get to it for a few hours. Much to my surprise it rebooted itself during/after this second time.

uname -a
Linux hostname 2.6.32-7-pve #1 SMP Mon Feb 13 07:33:21 CET 2012 x86_64 GNU/Linux

part of /var/log/messages:
Code:
Jul 25 19:14:28 dal-prox2 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
Jul 25 19:14:28 dal-prox2 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input2
Jul 25 19:14:28 dal-prox2 kernel: Adding 5242872k swap on /dev/mapper/pve-swap.  Priority:-1 extents:1 across:5242872k
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs (dm-1): using internal journal
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs: barriers disabled
Jul 25 19:14:28 dal-prox2 kernel: kjournald starting.  Commit interval 5 seconds
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs (dm-2): using internal journal
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs (dm-2): mounted filesystem with ordered data mode
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs: barriers disabled
Jul 25 19:14:28 dal-prox2 kernel: kjournald starting.  Commit interval 5 seconds
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs (sda1): using internal journal
Jul 25 19:14:28 dal-prox2 kernel: EXT3-fs (sda1): mounted filesystem with ordered data mode
Jul 25 19:14:28 dal-prox2 kernel: EXT4-fs (sdc1): mounted filesystem with ordered data mode. Opts:
Jul 25 19:14:28 dal-prox2 kernel: EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts:
Jul 25 19:14:28 dal-prox2 kernel: Bridge firewalling registered
Jul 25 19:14:28 dal-prox2 kernel: device eth0 entered promiscuous mode
Jul 25 19:14:28 dal-prox2 kernel: bnx2 0000:01:00.0: eth0: using MSIX
Jul 25 19:14:28 dal-prox2 kernel: Loading iSCSI transport class v2.0-870.
Jul 25 19:14:28 dal-prox2 kernel: iscsi: registered transport (tcp)
Jul 25 19:14:28 dal-prox2 kernel: NET: Registered protocol family 10
Jul 25 19:14:28 dal-prox2 kernel: ADDRCONF(NETDEV_UP): eth0: link is not ready
Jul 25 19:14:28 dal-prox2 kernel: iscsi: registered transport (iser)
Jul 25 19:14:29 dal-prox2 kernel: bnx2 0000:01:00.0: eth0: NIC Copper Link is Up, 1000 Mbps full duplex
Jul 25 19:14:29 dal-prox2 kernel: vmbr0: port 1(eth0) entering forwarding state
Jul 25 19:14:29 dal-prox2 kernel: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Jul 25 19:14:30 dal-prox2 kernel: ip_tables: (C) 2000-2006 Netfilter Core Team
Jul 25 19:14:30 dal-prox2 kernel: ip6_tables: (C) 2000-2006 Netfilter Core Team
Jul 25 19:14:30 dal-prox2 kernel: RPC: Registered udp transport module.
Jul 25 19:14:30 dal-prox2 kernel: RPC: Registered tcp transport module.
Jul 25 19:14:30 dal-prox2 kernel: RPC: Registered tcp NFSv4.1 backchannel transport module.
Jul 25 19:14:30 dal-prox2 kernel: Slow work thread pool: Starting up
Jul 25 19:14:30 dal-prox2 kernel: Slow work thread pool: Ready
Jul 25 19:14:30 dal-prox2 kernel: FS-Cache: Loaded
Jul 25 19:14:30 dal-prox2 kernel: FS-Cache: Netfs 'nfs' registered for caching
Jul 25 19:14:30 dal-prox2 kernel: nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
Jul 25 19:14:33 dal-prox2 kernel: warning: `vzctl' uses 32-bit capabilities (legacy support in use)
Jul 25 19:14:33 dal-prox2 kernel: CT: 101: started
Jul 25 19:14:34 dal-prox2 kernel: device veth101.0 entered promiscuous mode
Jul 25 19:14:34 dal-prox2 kernel: vmbr0: port 2(veth101.0) entering forwarding state
Jul 25 19:14:34 dal-prox2 kernel: New device veth101.0 does not support netpoll
Jul 25 19:14:34 dal-prox2 kernel: Disabling netpoll for vmbr0
Jul 25 19:14:36 dal-prox2 kernel: CT: 105: started
Jul 25 19:14:36 dal-prox2 kernel: device veth105.0 entered promiscuous mode
Jul 25 19:14:36 dal-prox2 kernel: vmbr0: port 3(veth105.0) entering forwarding state
Jul 25 19:14:37 dal-prox2 kernel: kvm: Nested Virtualization enabled
Jul 25 19:14:37 dal-prox2 kernel: kvm: Nested Paging enabled
Jul 25 19:14:37 dal-prox2 kernel: tun: Universal TUN/TAP device driver, 1.6
Jul 25 19:14:37 dal-prox2 kernel: tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
Jul 25 19:14:38 dal-prox2 kernel: device tap108i0d0 entered promiscuous mode
Jul 25 19:14:38 dal-prox2 kernel: vmbr0: port 4(tap108i0d0) entering forwarding state
Jul 25 19:17:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:17:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:17:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:17:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:17:57 dal-prox2 kernel: Call Trace:
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:17:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:19:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:19:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:19:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:19:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:19:57 dal-prox2 kernel: Call Trace:
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:19:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:21:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:21:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:21:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:21:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:21:57 dal-prox2 kernel: Call Trace:
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:21:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:23:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:23:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:23:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:23:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:23:57 dal-prox2 kernel: Call Trace:
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:23:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:25:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:25:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:25:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:25:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:25:57 dal-prox2 kernel: Call Trace:
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:25:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:27:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:27:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:27:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:27:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:27:57 dal-prox2 kernel: Call Trace:
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:27:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:29:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:29:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:29:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:29:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:29:57 dal-prox2 kernel: Call Trace:
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:29:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:30:04 dal-prox2 kernel: EXT3-fs: barriers disabled
Jul 25 19:30:04 dal-prox2 kernel: kjournald starting.  Commit interval 5 seconds
Jul 25 19:30:04 dal-prox2 kernel: EXT3-fs (dm-3): using internal journal
Jul 25 19:30:04 dal-prox2 kernel: EXT3-fs (dm-3): 5 orphan inodes deleted
Jul 25 19:30:04 dal-prox2 kernel: EXT3-fs (dm-3): recovery complete
Jul 25 19:30:04 dal-prox2 kernel: EXT3-fs (dm-3): mounted filesystem with ordered data mode
Jul 25 19:31:34 dal-prox2 kernel: EXT3-fs: barriers disabled
Jul 25 19:31:34 dal-prox2 kernel: kjournald starting.  Commit interval 5 seconds
Jul 25 19:31:34 dal-prox2 kernel: EXT3-fs (dm-3): using internal journal
Jul 25 19:31:34 dal-prox2 kernel: EXT3-fs (dm-3): 5 orphan inodes deleted
Jul 25 19:31:34 dal-prox2 kernel: EXT3-fs (dm-3): recovery complete
Jul 25 19:31:34 dal-prox2 kernel: EXT3-fs (dm-3): mounted filesystem with ordered data mode
Jul 25 19:31:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:31:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:31:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:31:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:31:57 dal-prox2 kernel: Call Trace:
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:31:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:33:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:33:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:33:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:33:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:33:57 dal-prox2 kernel: Call Trace:
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:33:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20
Jul 25 19:35:23 dal-prox2 kernel: EXT3-fs: barriers disabled
Jul 25 19:35:23 dal-prox2 kernel: kjournald starting.  Commit interval 5 seconds
Jul 25 19:35:23 dal-prox2 kernel: EXT3-fs (dm-3): using internal journal
Jul 25 19:35:23 dal-prox2 kernel: EXT3-fs (dm-3): 5 orphan inodes deleted
Jul 25 19:35:23 dal-prox2 kernel: EXT3-fs (dm-3): recovery complete
Jul 25 19:35:23 dal-prox2 kernel: EXT3-fs (dm-3): mounted filesystem with ordered data mode
Jul 25 19:35:57 dal-prox2 kernel: khubd         D ffff88011f2852d0     0   143      2    0 0x00000000
Jul 25 19:35:57 dal-prox2 kernel: ffff88011f287b20 0000000000000046 0000000000000000 0000000000000286
Jul 25 19:35:57 dal-prox2 kernel: ffff88011f287a10 000000000000f6c8 ffff88011f287fd8 ffff88011f287fd8
Jul 25 19:35:57 dal-prox2 kernel: ffff88011f2852d0 ffffffff81a8d020 ffff88011f285888 00000000fffb8a02
Jul 25 19:35:57 dal-prox2 kernel: Call Trace:
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff81080aa2>] ? del_timer_sync+0x22/0x30
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff815118d9>] ? schedule_timeout+0x1d9/0x2d0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813d74cc>] ? ohci_urb_dequeue+0x7c/0x110
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff81268387>] ? kobject_put+0x27/0x60
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b6125>] usb_kill_urb+0x95/0xd0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b7e10>] usb_start_wait_urb+0xf0/0x1c0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff8151020a>] ? printk+0x6c/0x72
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b6928>] ? usb_init_urb+0x28/0x40
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b8190>] usb_control_msg+0x140/0x170
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813ad032>] hub_port_init+0x3c2/0x9a0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b174a>] hub_thread+0xf8a/0x1e70
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff810972d0>] ? autoremove_wake_function+0x0/0x40
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff813b07c0>] ? hub_thread+0x0/0x1e70
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff81096ca6>] kthread+0x96/0xb0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff8100c34a>] child_rip+0xa/0x20
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff81096c10>] ? kthread+0x0/0xb0
Jul 25 19:35:57 dal-prox2 kernel: [<ffffffff8100c340>] ? child_rip+0x0/0x20

--edit: I believe this is where it rebooted, but even though it came right back up there were no messages until the next day(?)--

Jul 26 06:25:05 dal-prox2 kernel: Kernel logging (proc) stopped.
Jul 26 06:25:05 dal-prox2 kernel: imklog 3.18.6, log source = /proc/kmsg started.

Would anyone have any ideas based on that or is there some other information I could provide?

Thank you,
Mark
 
We have power issues here from time to time and I noticed that one of the times this happened was right after one of the brief flickers. None of the UPS units were showing an overload but I added another and redistributed the load just to be sure. No issues since adding another UPS, whereas before it had crashed three times since the issue started a few weeks ago. Fingers crossed.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!