Kernel: INFO: task pvestatd:3209 blocked for more than 120 seconds

[shartenauer]

Hi there,
tonight we have problems with 2 of our 3 Proxmox 3.0 Servers:
Proxmox Server 1:
CPU i7-4770 (Haswell CPU)
2 VM's are shown in Webinterface as shutdown. Only the VMID is presented, the VM names have disappeared.
Performace Graphs are empty.
The VMs are performing normal.
The VMs could not stopped via GUI or console -> Timeout
Only killing the Tasks worked.
Proxmox Server 2:
CPU i7-4770 (Haswell CPU)
3 VM's are shown in Webinterface as shutdown. Only the VMID is presented, the VM names have disappeared.
Performace Graphs are empty.
The VMs are performing normal.
The VMs could not stopped via GUI or console -> Timeout
Only killing the Tasks worked.
Proxmox Server 3:
CPU i7-3770
Everything runs fine.
pveversion -v (identical for all 3 servers):
pve-manager: 3.0-23 (pve-manager/3.0/957f0862)
running kernel: 2.6.32-22-pve
proxmox-ve-2.6.32: 3.0-107
pve-kernel-2.6.32-22-pve: 2.6.32-107
lvm2: 2.02.95-pve3
clvm: 2.02.95-pve3
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.0-1
pve-cluster: 3.0-4
qemu-server: 3.0-20
pve-firmware: 1.0-23
libpve-common-perl: 3.0-4
libpve-access-control: 3.0-4
libpve-storage-perl: 3.0-8
vncterm: 1.1-4
vzctl: 4.0-1pve3
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.4-13
ksm-control-daemon: 1.1-1
After reboot the 2 Proxmox Server Show the normal behaviour.
In the kenel log I can see these entries:
PROXMOX001:
Aug 15 03:14:40 proxmox001 kernel: INFO: task pvestatd:3209 blocked for more than 120 seconds.

Aug 15 03:14:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:14:40 proxmox001 kernel: pvestatd D ffff88081b21c340 0 3209 1 0 0x00000000

Aug 15 03:14:40 proxmox001 kernel: ffff880813ea78f8 0000000000000082 ffff880819f09180 0000000000011200

Aug 15 03:14:40 proxmox001 kernel: 0000000000000246 0000000000011200 ffff880813ea78a8 0000000000000246

Aug 15 03:14:40 proxmox001 kernel: ffff8800283deaa8 0000000122f9cd3c ffff880813ea7fd8 ffff880813ea7fd8

Aug 15 03:14:40 proxmox001 kernel: Call Trace:

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8109b24e>] ? prepare_to_wait+0x4e/0x80

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fc8dd>] wait_for_free_request.part.0+0x9d/0x130 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fc983>] wait_for_free_request+0x13/0x30 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fd390>] SendReceive+0x90/0x360 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05e26f8>] CIFSSMBUnixQPathInfo+0x148/0x2c0 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05f6d17>] cifs_get_inode_info_unix+0x87/0x1b0 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05ee1c1>] ? build_path_from_dentry+0xf1/0x250 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05ee283>] ? build_path_from_dentry+0x1b3/0x250 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05f86e7>] cifs_revalidate_dentry_attr+0xc7/0x1c0 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811b9369>] ? dput_nocache+0xc9/0x250

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05f8837>] cifs_revalidate_dentry+0x17/0x40 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05ee024>] cifs_d_revalidate+0x24/0xd0 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811ad17b>] do_lookup+0x6b/0x2b0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811ac5c4>] ? generic_permission+0x24/0xd0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811af231>] __link_path_walk+0x5f1/0xf30

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811afbc5>] path_walk+0x55/0xb0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811afd4b>] do_path_lookup+0x5b/0xa0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811b01e9>] user_path_at+0x59/0xa0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff81279d35>] ? _atomic_dec_and_lock+0x55/0x80

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811a467a>] vfs_fstatat+0x2a/0x60

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811a05e9>] ? __fput+0x199/0x220

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811a46eb>] vfs_stat+0x1b/0x20

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811a4b6a>] sys_newstat+0x1a/0x40

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff815455ab>] ? do_page_fault+0x3b/0xa0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff815429c5>] ? page_fault+0x25/0x30

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b

Aug 15 03:14:40 proxmox001 kernel: INFO: task gzip:199417 blocked for more than 120 seconds.

Aug 15 03:14:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:14:40 proxmox001 kernel: gzip D ffff880813a40a00 0 199417 199409 0 0x00000000

Aug 15 03:14:40 proxmox001 kernel: ffff88029facfb08 0000000000000082 0000000000000000 ffffffff81143900

Aug 15 03:14:40 proxmox001 kernel: ffff880813a413d0 ffff880813a413d0 ffffffff823d2780 ffff88024ad36e08

Aug 15 03:14:40 proxmox001 kernel: ffff88029facfaa8 0000000122f9a8e5 ffff88029facffd8 ffff88029facffd8

Aug 15 03:14:40 proxmox001 kernel: Call Trace:

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff81143900>] ? __lru_cache_add+0x40/0x90

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fc8dd>] wait_for_free_request.part.0+0x9d/0x130 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fc983>] wait_for_free_request+0x13/0x30 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05fcd85>] cifs_call_async+0x45/0x190 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05ef824>] ? cifs_writepages_marshal_iov+0x94/0xe0 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05dc3c0>] ? cifs_writev_callback+0x0/0x110 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05defad>] cifs_async_writev+0x18d/0x260 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05f31e2>] cifs_writepages+0x3d2/0x650 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8114194f>] do_writepages+0x1f/0x50

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8112b22b>] __filemap_fdatawrite_range+0x5b/0x60

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8112b24f>] filemap_fdatawrite+0x1f/0x30

Aug 15 03:14:40 proxmox001 kernel: [<ffffffffa05db10c>] cifs_file_aio_write+0x4c/0x80 [cifs]

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8119e42e>] do_sync_write+0xfe/0x140

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff81058bb3>] ? perf_event_task_sched_out+0x33/0xa0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8153f7fc>] ? thread_return+0xbc/0x870

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8119ebc1>] vfs_write+0xa1/0x190

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff811a02de>] ? fget_light+0x4e/0xa0

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8119ef1a>] sys_write+0x4a/0x90

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8154350e>] ? do_device_not_available+0xe/0x10

Aug 15 03:14:40 proxmox001 kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b

Aug 15 03:16:28 proxmox001 kernel: CIFS VFS: Server u70544.your-backup.de has not responded in 300 seconds. Reconnecting...

Aug 15 03:17:01 proxmox001 /USR/SBIN/CRON[199676]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Aug 15 03:18:40 proxmox001 kernel: INFO: task kslowd007:171016 blocked for more than 120 seconds.

Aug 15 03:18:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:18:40 proxmox001 kernel: kslowd007 D ffff88081b21ce20 0 171016 2 0 0x00000000

Aug 15 03:18:40 proxmox001 kernel: ffff8802721b7c30 0000000000000046 0000000000000000 0000000000000286

Aug 15 03:18:40 proxmox001 kernel: ffff8802721b7bc0 ffffffff81080ea8 ffff8802721b7c48 ffff8802721b7c48

Aug 15 03:18:40 proxmox001 kernel: 0000000122fe6894 0000000122fe407d ffff8802721b7fd8 ffff8802721b7fd8

Aug 15 03:18:40 proxmox001 kernel: Call Trace:

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81080ea8>] ? lock_timer_base.isra.52+0x38/0x70

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05df220>] cifs_writev_complete+0x1a0/0x210 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f58f>] slow_work_execute+0x2bf/0x2f0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f707>] slow_work_thread+0x147/0x330

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f5c0>] ? slow_work_thread+0x0/0x330

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109ace8>] kthread+0x88/0x90

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100989e>] ? __switch_to+0x28e/0x2f0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100c22a>] child_rip+0xa/0x20

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109ac60>] ? kthread+0x0/0x90

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100c220>] ? child_rip+0x0/0x20

Aug 15 03:18:40 proxmox001 kernel: INFO: task gzip:199417 blocked for more than 120 seconds.

Aug 15 03:18:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:18:40 proxmox001 kernel: gzip D ffff880813a40a00 0 199417 199409 0 0x00000000

Aug 15 03:18:40 proxmox001 kernel: ffff88029facfa98 0000000000000082 0000000000000000 ffffffff81154aae

Aug 15 03:18:40 proxmox001 kernel: ffff88029facfa38 ffffffff8112c00d 0000000000000000 ffffea0009f26100

Aug 15 03:18:40 proxmox001 kernel: ffffffff81aa6d40 0000000122fe4186 ffff88029facffd8 ffff88029facffd8

Aug 15 03:18:40 proxmox001 kernel: Call Trace:

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81154aae>] ? __inc_zone_page_state+0x2e/0x30

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8112c00d>] ? add_to_page_cache_nogang+0x9d/0xe0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05f31e2>] cifs_writepages+0x3d2/0x650 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8114194f>] do_writepages+0x1f/0x50

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8112b22b>] __filemap_fdatawrite_range+0x5b/0x60

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8112b24f>] filemap_fdatawrite+0x1f/0x30

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05db10c>] cifs_file_aio_write+0x4c/0x80 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8119e42e>] do_sync_write+0xfe/0x140

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81058bb3>] ? perf_event_task_sched_out+0x33/0xa0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8153f7fc>] ? thread_return+0xbc/0x870

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8119ebc1>] vfs_write+0xa1/0x190

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8119ef1a>] sys_write+0x4a/0x90

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b

Aug 15 03:18:40 proxmox001 kernel: INFO: task kslowd003:199437 blocked for more than 120 seconds.

Aug 15 03:18:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:18:40 proxmox001 kernel: kslowd003 D ffff880818794580 0 199437 2 0 0x00000000

Aug 15 03:18:40 proxmox001 kernel: ffff8802bc8edc30 0000000000000046 0000000000000000 0000000000000286

Aug 15 03:18:40 proxmox001 kernel: ffff8802bc8edbc0 ffffffff81080ea8 ffff8802bc8edc48 ffff8802bc8edc48

Aug 15 03:18:40 proxmox001 kernel: 0000000122fe6894 0000000122fe40f8 ffff8802bc8edfd8 ffff8802bc8edfd8

Aug 15 03:18:40 proxmox001 kernel: Call Trace:

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81080ea8>] ? lock_timer_base.isra.52+0x38/0x70

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffffa05df220>] cifs_writev_complete+0x1a0/0x210 [cifs]

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f58f>] slow_work_execute+0x2bf/0x2f0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f707>] slow_work_thread+0x147/0x330

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8111f5c0>] ? slow_work_thread+0x0/0x330

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109ace8>] kthread+0x88/0x90

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100989e>] ? __switch_to+0x28e/0x2f0

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100c22a>] child_rip+0xa/0x20

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8109ac60>] ? kthread+0x0/0x90

Aug 15 03:18:40 proxmox001 kernel: [<ffffffff8100c220>] ? child_rip+0x0/0x20

Aug 15 03:20:40 proxmox001 kernel: INFO: task kslowd007:171016 blocked for more than 120 seconds.

Aug 15 03:20:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:20:40 proxmox001 kernel: kslowd007 D ffff88081b21ce20 0 171016 2 0 0x00000000

Aug 15 03:20:40 proxmox001 kernel: ffff8802721b7c30 0000000000000046 0000000000000000 0000000000000286

Aug 15 03:20:40 proxmox001 kernel: ffff8802721b7bc0 ffffffff81080ea8 ffff8802721b7c48 ffff8802721b7c48

Aug 15 03:20:40 proxmox001 kernel: 0000000122fe6894 0000000122fe407d ffff8802721b7fd8 ffff8802721b7fd8

Aug 15 03:20:40 proxmox001 kernel: Call Trace:

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81080ea8>] ? lock_timer_base.isra.52+0x38/0x70

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05df220>] cifs_writev_complete+0x1a0/0x210 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f58f>] slow_work_execute+0x2bf/0x2f0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f707>] slow_work_thread+0x147/0x330

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f5c0>] ? slow_work_thread+0x0/0x330

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109ace8>] kthread+0x88/0x90

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100989e>] ? __switch_to+0x28e/0x2f0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100c22a>] child_rip+0xa/0x20

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109ac60>] ? kthread+0x0/0x90

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100c220>] ? child_rip+0x0/0x20

Aug 15 03:20:40 proxmox001 kernel: INFO: task gzip:199417 blocked for more than 120 seconds.

Aug 15 03:20:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:20:40 proxmox001 kernel: gzip D ffff880813a40a00 0 199417 199409 0 0x00000000

Aug 15 03:20:40 proxmox001 kernel: ffff88029facfa98 0000000000000082 0000000000000000 ffffffff81154aae

Aug 15 03:20:40 proxmox001 kernel: ffff88029facfa38 ffffffff8112c00d 0000000000000000 ffffea0009f26100

Aug 15 03:20:40 proxmox001 kernel: ffffffff81aa6d40 0000000122fe4186 ffff88029facffd8 ffff88029facffd8

Aug 15 03:20:40 proxmox001 kernel: Call Trace:

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81154aae>] ? __inc_zone_page_state+0x2e/0x30

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8112c00d>] ? add_to_page_cache_nogang+0x9d/0xe0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05f31e2>] cifs_writepages+0x3d2/0x650 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8114194f>] do_writepages+0x1f/0x50

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8112b22b>] __filemap_fdatawrite_range+0x5b/0x60

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8112b24f>] filemap_fdatawrite+0x1f/0x30

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05db10c>] cifs_file_aio_write+0x4c/0x80 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8119e42e>] do_sync_write+0xfe/0x140

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81058bb3>] ? perf_event_task_sched_out+0x33/0xa0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8153f7fc>] ? thread_return+0xbc/0x870

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8119ebc1>] vfs_write+0xa1/0x190

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8119ef1a>] sys_write+0x4a/0x90

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b

Aug 15 03:20:40 proxmox001 kernel: INFO: task kslowd003:199437 blocked for more than 120 seconds.

Aug 15 03:20:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:20:40 proxmox001 kernel: kslowd003 D ffff880818794580 0 199437 2 0 0x00000000

Aug 15 03:20:40 proxmox001 kernel: ffff8802bc8edc30 0000000000000046 0000000000000000 0000000000000286

Aug 15 03:20:40 proxmox001 kernel: ffff8802bc8edbc0 ffffffff81080ea8 ffff8802bc8edc48 ffff8802bc8edc48

Aug 15 03:20:40 proxmox001 kernel: 0000000122fe6894 0000000122fe40f8 ffff8802bc8edfd8 ffff8802bc8edfd8

Aug 15 03:20:40 proxmox001 kernel: Call Trace:

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81080ea8>] ? lock_timer_base.isra.52+0x38/0x70

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffffa05df220>] cifs_writev_complete+0x1a0/0x210 [cifs]

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f58f>] slow_work_execute+0x2bf/0x2f0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f707>] slow_work_thread+0x147/0x330

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8111f5c0>] ? slow_work_thread+0x0/0x330

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109ace8>] kthread+0x88/0x90

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100989e>] ? __switch_to+0x28e/0x2f0

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100c22a>] child_rip+0xa/0x20

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8109ac60>] ? kthread+0x0/0x90

Aug 15 03:20:40 proxmox001 kernel: [<ffffffff8100c220>] ? child_rip+0x0/0x20

Aug 15 03:22:40 proxmox001 kernel: INFO: task kslowd007:171016 blocked for more than 120 seconds.

Aug 15 03:22:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:22:40 proxmox001 kernel: kslowd007 D ffff88081b21ce20 0 171016 2 0 0x00000000

Aug 15 03:22:40 proxmox001 kernel: ffff8802721b7c30 0000000000000046 0000000000000000 0000000000000286

Aug 15 03:22:40 proxmox001 kernel: ffff8802721b7bc0 ffffffff81080ea8 ffff8802721b7c48 ffff8802721b7c48

Aug 15 03:22:40 proxmox001 kernel: 0000000122fe6894 0000000122fe407d ffff8802721b7fd8 ffff8802721b7fd8

Aug 15 03:22:40 proxmox001 kernel: Call Trace:

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff81080ea8>] ? lock_timer_base.isra.52+0x38/0x70

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05df220>] cifs_writev_complete+0x1a0/0x210 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8111f58f>] slow_work_execute+0x2bf/0x2f0

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8111f707>] slow_work_thread+0x147/0x330

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8111f5c0>] ? slow_work_thread+0x0/0x330

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8109ace8>] kthread+0x88/0x90

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8100989e>] ? __switch_to+0x28e/0x2f0

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8100c22a>] child_rip+0xa/0x20

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8109ac60>] ? kthread+0x0/0x90

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8100c220>] ? child_rip+0x0/0x20

Aug 15 03:22:40 proxmox001 kernel: INFO: task gzip:199417 blocked for more than 120 seconds.

Aug 15 03:22:40 proxmox001 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Aug 15 03:22:40 proxmox001 kernel: gzip D ffff880813a40a00 0 199417 199409 0 0x00000000

Aug 15 03:22:40 proxmox001 kernel: ffff88029facfa98 0000000000000082 0000000000000000 ffffffff81154aae

Aug 15 03:22:40 proxmox001 kernel: ffff88029facfa38 ffffffff8112c00d 0000000000000000 ffffea0009f26100

Aug 15 03:22:40 proxmox001 kernel: ffffffff81aa6d40 0000000122fe4186 ffff88029facffd8 ffff88029facffd8

Aug 15 03:22:40 proxmox001 kernel: Call Trace:

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff81154aae>] ? __inc_zone_page_state+0x2e/0x30

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8112c00d>] ? add_to_page_cache_nogang+0x9d/0xe0

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff81541622>] __mutex_lock_slowpath+0x122/0x170

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8154103a>] mutex_lock+0x2a/0x50

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dc756>] cifs_reconnect_tcon+0x196/0x320 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dc987>] small_smb_init+0x37/0xa0 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05dee91>] cifs_async_writev+0x71/0x260 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05f31e2>] cifs_writepages+0x3d2/0x650 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8114194f>] do_writepages+0x1f/0x50

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8112b22b>] __filemap_fdatawrite_range+0x5b/0x60

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8112b24f>] filemap_fdatawrite+0x1f/0x30

Aug 15 03:22:40 proxmox001 kernel: [<ffffffffa05db10c>] cifs_file_aio_write+0x4c/0x80 [cifs]

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8119e42e>] do_sync_write+0xfe/0x140

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff81058bb3>] ? perf_event_task_sched_out+0x33/0xa0

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8109b280>] ? autoremove_wake_function+0x0/0x40

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8153f7fc>] ? thread_return+0xbc/0x870

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8119ebc1>] vfs_write+0xa1/0x190

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8119ef1a>] sys_write+0x4a/0x90

Aug 15 03:22:40 proxmox001 kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b

Best regards Stephan

 

[tom]

do you run LVM snapshots backups at night (OpenVZ container)?

 

[shartenauer]

Nö there is an LVM Snapshot in 2 KVM VMs
Best Erhards Stephan

 

[tom]

Nö there is an LVM Snapshot in 2 KVM VMs
Best Erhards Stephan

what do you mean with LVM snapshots in 2 KVM VMs`?

also post the output of 'lspci -v' (info about your hardware)

 

[shartenauer]

what do you mean with LVM snapshots in 2 KVM VMs`?

also post the output of 'lspci -v' (info about your hardware)

Hello Tom,

Every VM are from Type VM (KVM). The backups are done with mode: snapshot.
the 3 systems are running fine since 5 weeks, but tonight on server 1 and we had problems.
server 1 backup 2 VMs (Typ VM) start 03:00 Uhr, not finished until restart of proxmox server.
After the restart the vm was locked.
server 2 backups 3 VMs (Typ VM) start 00:00 Uhr Finished 00:52 Uhr, everything ok
server 3 backup 1 VM (Typ VM) start 00:00 Uhr, Finished 00:12 Uhr, everything ok

Proxmox Server 1: Hetzner Root Server EX40-SSD
Proxmox Server 2: Hetzner Root Server EX40-SSD
Proxmox Server 3: Hetzner Root Server EX4

Proxmox Server 1
lspci -v
00:00.0 Host bridge: Intel Corporation Haswell DRAM Controller (rev 06)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:02.0 VGA compatible controller: Intel Corporation Haswell Integrated Graphics Controller (rev 06) (prog-if 00 [VGA controller])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: fast devsel, IRQ 16
Memory at f7800000 (64-bit, non-prefetchable) [size=4M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
I/O ports at f000
Expansion ROM at <unassigned> [disabled]
Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [d0] Power Management version 2
Capabilities: [a4] PCI Advanced Features

00:14.0 USB controller: Intel Corporation Lynx Point USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 31
Memory at f7c00000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [70] Power Management version 2
Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
Kernel driver in use: xhci_hcd

00:16.0 Communication controller: Intel Corporation Lynx Point MEI Controller #1 (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at f7c15000 (64-bit, non-prefetchable)
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:1a.0 USB controller: Intel Corporation Lynx Point USB Enhanced Host Controller #2 (rev 04) (prog-if 20 [EHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 16
Memory at f7c14000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1c.0 PCI bridge: Intel Corporation Lynx Point PCI Express Root Port #1 (rev d4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 00002000-00002fff
Memory behind bridge: df200000-df3fffff
Prefetchable memory behind bridge: 00000000df400000-00000000df5fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1c.1 PCI bridge: Intel Corporation Lynx Point PCI Express Root Port #2 (rev d4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Prefetchable memory behind bridge: 00000000f0000000-00000000f00fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1c.3 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d4) (prog-if 01 [Subtractive decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=03, subordinate=04, sec-latency=0
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1d.0 USB controller: Intel Corporation Lynx Point USB Enhanced Host Controller #1 (rev 04) (prog-if 20 [EHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 23
Memory at f7c13000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1f.0 ISA bridge: Intel Corporation Lynx Point LPC Controller (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:1f.2 SATA controller: Intel Corporation Lynx Point 6-port SATA Controller 1 [AHCI mode] (rev 04) (prog-if 01 [AHCI 1.0])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 32
I/O ports at f0b0
I/O ports at f0a0
I/O ports at f090
I/O ports at f080
I/O ports at f060
Memory at f7c12000 (32-bit, non-prefetchable) [size=2K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Kernel driver in use: ahci

00:1f.3 SMBus: Intel Corporation Lynx Point SMBus Controller (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: medium devsel, IRQ 18
Memory at f7c11000 (64-bit, non-prefetchable)
I/O ports at f040

02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 06)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0, IRQ 33
I/O ports at e000
Memory at f0004000 (64-bit, prefetchable) [size=4K]
Memory at f0000000 (64-bit, prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 01
Capabilities: [b0] MSI-X: Enable- Count=4 Masked-
Capabilities: [d0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Virtual Channel
Capabilities: [160] Device Serial Number 01-00-00-00-68-4c-e0-00
Kernel driver in use: r8169

03:00.0 PCI bridge: ASMedia Technology Inc. ASM1083/1085 PCIe to PCI Bridge (rev 03) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=03, secondary=04, subordinate=04, sec-latency=32
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Power Management version 3
Capabilities: [80] Express PCI/PCI-X Bridge, MSI 00
Capabilities: [c0] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [100] Virtual Channel





Proxmox Server 2
lspci -v
00:00.0 Host bridge: Intel Corporation Haswell DRAM Controller (rev 06)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:02.0 VGA compatible controller: Intel Corporation Haswell Integrated Graphics Controller (rev 06) (prog-if 00 [VGA controller])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: fast devsel, IRQ 16
Memory at f7800000 (64-bit, non-prefetchable) [size=4M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
I/O ports at f000
Expansion ROM at <unassigned> [disabled]
Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [d0] Power Management version 2
Capabilities: [a4] PCI Advanced Features

00:03.0 Audio device: Intel Corporation Haswell HD Audio Controller (rev 06)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0, IRQ 34
Memory at f7c10000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [50] Power Management version 2
Capabilities: [60] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: snd_hda_intel

00:14.0 USB controller: Intel Corporation Lynx Point USB xHCI Host Controller (rev 04) (prog-if 30 [XHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 31
Memory at f7c00000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [70] Power Management version 2
Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
Kernel driver in use: xhci_hcd

00:16.0 Communication controller: Intel Corporation Lynx Point MEI Controller #1 (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at f7c19000 (64-bit, non-prefetchable)
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:1a.0 USB controller: Intel Corporation Lynx Point USB Enhanced Host Controller #2 (rev 04) (prog-if 20 [EHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 16
Memory at f7c18000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1c.0 PCI bridge: Intel Corporation Lynx Point PCI Express Root Port #1 (rev d4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 00002000-00002fff
Memory behind bridge: df200000-df3fffff
Prefetchable memory behind bridge: 00000000df400000-00000000df5fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1c.1 PCI bridge: Intel Corporation Lynx Point PCI Express Root Port #2 (rev d4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Prefetchable memory behind bridge: 00000000f0000000-00000000f00fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1c.3 PCI bridge: Intel Corporation 82801 PCI Bridge (rev d4) (prog-if 01 [Subtractive decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=03, subordinate=04, sec-latency=0
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [a0] Power Management version 3

00:1d.0 USB controller: Intel Corporation Lynx Point USB Enhanced Host Controller #1 (rev 04) (prog-if 20 [EHCI])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0, IRQ 23
Memory at f7c17000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1f.0 ISA bridge: Intel Corporation Lynx Point LPC Controller (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, medium devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:1f.2 SATA controller: Intel Corporation Lynx Point 6-port SATA Controller 1 [AHCI mode] (rev 04) (prog-if 01 [AHCI 1.0])
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 32
I/O ports at f0b0
I/O ports at f0a0
I/O ports at f090
I/O ports at f080
I/O ports at f060
Memory at f7c16000 (32-bit, non-prefetchable) [size=2K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Kernel driver in use: ahci

00:1f.3 SMBus: Intel Corporation Lynx Point SMBus Controller (rev 04)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: medium devsel, IRQ 18
Memory at f7c15000 (64-bit, non-prefetchable)
I/O ports at f040

02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 06)
Subsystem: Micro-Star International Co., Ltd. Device 7816
Flags: bus master, fast devsel, latency 0, IRQ 33
I/O ports at e000
Memory at f0004000 (64-bit, prefetchable) [size=4K]
Memory at f0000000 (64-bit, prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 01
Capabilities: [b0] MSI-X: Enable- Count=4 Masked-
Capabilities: [d0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Virtual Channel
Capabilities: [160] Device Serial Number 01-00-00-00-68-4c-e0-00
Kernel driver in use: r8169

03:00.0 PCI bridge: ASMedia Technology Inc. ASM1083/1085 PCIe to PCI Bridge (rev 03) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=03, secondary=04, subordinate=04, sec-latency=32
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Power Management version 3
Capabilities: [80] Express PCI/PCI-X Bridge, MSI 00
Capabilities: [c0] Subsystem: Micro-Star International Co., Ltd. Device 7816
Capabilities: [100] Virtual Channel

Proxmox Server 3
lspci -v
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor DRAM Controller (rev 09)
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, fast devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor PCI Express Root Port (rev 09) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
Capabilities: [88] Subsystem: ASUSTeK Computer Inc. Device 84ca
Capabilities: [80] Power Management version 3
Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [a0] Express Root Port (Slot+), MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [140] Root Complex Link
Capabilities: [d94] #19
Kernel driver in use: pcieport

00:02.0 VGA compatible controller: Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor Graphics Controller (rev 09) (prog-if 00 [VGA controller])
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: fast devsel, IRQ 16
Memory at f7800000 (64-bit, non-prefetchable) [size=4M]
Memory at e0000000 (64-bit, prefetchable) [size=256M]
I/O ports at f000
Expansion ROM at <unassigned> [disabled]
Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [d0] Power Management version 2
Capabilities: [a4] PCI Advanced Features

00:16.0 Communication controller: Intel Corporation 7 Series/C210 Series Chipset Family MEI Controller #1 (rev 04)
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, fast devsel, latency 0, IRQ 10
Memory at f7c06000 (64-bit, non-prefetchable)
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:1a.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB Enhanced Host Controller #2 (rev 04) (prog-if 20 [EHCI])
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, medium devsel, latency 0, IRQ 23
Memory at f7c04000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1c.0 PCI bridge: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 1 (rev c4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 84ca
Capabilities: [a0] Power Management version 2

00:1c.4 PCI bridge: Intel Corporation 7 Series/C210 Series Chipset Family PCI Express Root Port 5 (rev c4) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0
Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Prefetchable memory behind bridge: 00000000f0000000-00000000f00fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: ASUSTeK Computer Inc. Device 84ca
Capabilities: [a0] Power Management version 2

00:1d.0 USB controller: Intel Corporation 7 Series/C210 Series Chipset Family USB Enhanced Host Controller #1 (rev 04) (prog-if 20 [EHCI])
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, medium devsel, latency 0, IRQ 23
Memory at f7c03000 (32-bit, non-prefetchable) [size=1K]
Capabilities: [50] Power Management version 2
Capabilities: [58] Debug port: BAR=1 offset=00a0
Capabilities: [98] PCI Advanced Features
Kernel driver in use: ehci_hcd

00:1f.0 ISA bridge: Intel Corporation H77 Express Chipset LPC Controller (rev 04)
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, medium devsel, latency 0
Capabilities: [e0] Vendor Specific Information: Len=0c <?>

00:1f.2 SATA controller: Intel Corporation 7 Series/C210 Series Chipset Family 6-port SATA Controller [AHCI mode] (rev 04) (prog-if 01 [AHCI 1.0])
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 32
I/O ports at f0b0
I/O ports at f0a0
I/O ports at f090
I/O ports at f080
I/O ports at f060
Memory at f7c02000 (32-bit, non-prefetchable) [size=2K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Capabilities: [b0] PCI Advanced Features
Kernel driver in use: ahci

00:1f.3 SMBus: Intel Corporation 7 Series/C210 Series Chipset Family SMBus Controller (rev 04)
Subsystem: ASUSTeK Computer Inc. Device 84ca
Flags: medium devsel, IRQ 18
Memory at f7c01000 (64-bit, non-prefetchable)
I/O ports at f040

03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168B PCI Express Gigabit Ethernet controller (rev 09)
Subsystem: ASUSTeK Computer Inc. Device 8505
Flags: bus master, fast devsel, latency 0, IRQ 33
I/O ports at e000
Memory at f0004000 (64-bit, prefetchable) [size=4K]
Memory at f0000000 (64-bit, prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [70] Express Endpoint, MSI 01
Capabilities: [b0] MSI-X: Enable- Count=4 Masked-
Capabilities: [d0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Virtual Channel
Capabilities: [160] Device Serial Number 00-00-00-00-00-00-00-00
Kernel driver in use: r8169

Best regards Stephan

 

[tom]

seems there are also hardware issues with these server from Hetzner?

http://www.webhostingtalk.com/showpost.php?p=8785162&postcount=125

 

[shartenauer]

seems there are also hardware issues with these server from Hetzner?

http://www.webhostingtalk.com/showpost.php?p=8785162&postcount=125

Hello Tom,
yes, we had hardwareproblems with the new Hetzner EX40 and EX40-SSD at the beginning. But before 3 weeks we got an BIOS Update and a different BIOS settings.
The memory modules were degraded from 1600 MHz to 1333 MHz.
Now the hardware runs stable.

The problem today was not a problem with the memory modules , in these cases the whole Proxmox Server stops and could only be resetted via a hardware reset.
Today the VMs were running fine except the one which was in snapshot state.
Bit we were not able to control the VMs via GUI or console.

Best regards Stephan

 

[tom]

Can you test with latest kernel? (packages from pvetest repo)

 

[shartenauer]

Can you test with latest kernel? (packages from pvetest repo)

Hello Tom,
That's not possible at the moment, because the systems are in production use.
When will the next kernel come out in stable relase?
Best regards Stephan

 

[shartenauer]

Hello Tom,

that was exactly the same problem like mine:
http://forum.proxmox.com/threads/15462-Web-interface-breaking

Maybe an
pvestatd restart
had solved my problems

Stephan