server locking

Leonardo

New Member
Oct 20, 2014
1
0
1
My server is crashing every 30 minutes + - with the below error message:

Oct 20 05:42:42 Oxigenio kernel: general protection fault: 0000 [#1] SMP

Oct 20 05:42:42 Oxigenio kernel: last sysfs file: /sys/kernel/uevent_seqnum
Oct 20 05:42:42 Oxigenio kernel: CPU 0
Oct 20 05:42:42 Oxigenio kernel: Modules linked in: ip_set vzethdev vznetdev pio_nfs pio_direct pfmt_raw pfmt_ploop1 ploop simfs vzrst nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 vzcpt nf_conntrack vzdquota vzmon vzdev ip6t_REJECT ip6table_mangle ip6table_filter ip6_tables xt_length xt_hl xt_tcpmss xt_TCPMSS iptable_mangle iptable_filter vhost_net tun macvtap macvlan xt_multiport xt_limit xt_dscp nfnetlink_log kvm_intel nfnetlink ipt_REJECT kvm ip_tables vzevent ib_iser rdma_cm ib_addr iw_cm ib_cm ib_sa ib_mad ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi nfsd nfs nfs_acl auth_rpcgss fscache lockd sunrpc ipv6 fuse snd_hda_codec_realtek snd_hda_intel i915 snd_hda_codec snd_hwdep iTCO_wdt snd_pcsp drm_kms_helper snd_pcm i2c_i801 iTCO_vendor_support snd_page_alloc drm i2c_algo_bit snd_timer serio_raw i2c_core lpc_ich mfd_core snd soundcore video shpchp output ext3 mbcache jbd sg ata_generic pata_acpi r8169 mii ata_piix [last unloaded: scsi_wait_scan]
Oct 20 05:42:42 Oxigenio kernel:
Oct 20 05:42:42 Oxigenio kernel: Pid: 3048, comm: kvm veid: 0 Not tainted 2.6.32-32-pve #1 042stab093_4 PCWARE To be filled by O.E.M./IPMH61G1
Oct 20 05:42:42 Oxigenio kernel: RIP: 0010:[<ffffffff811df6f6>] [<ffffffff811df6f6>] mark_buffer_dirty+0x36/0xa0
Oct 20 05:42:42 Oxigenio kernel: RSP: 0018:ffff8802deeed9c8 EFLAGS: 00010246
Oct 20 05:42:42 Oxigenio kernel: RAX: 0000000000000000 RBX: ffff880016d590c8 RCX: 0000000000001000
Oct 20 05:42:42 Oxigenio kernel: RDX: 0000000000001000 RSI: 0000000000000001 RDI: ffff6a000050be40
Oct 20 05:42:42 Oxigenio kernel: RBP: ffff8802deeed9d8 R08: 0000000000001000 R09: ffffea000050be40
Oct 20 05:42:42 Oxigenio kernel: R10: ffffffffa0085200 R11: ffffea000050be40 R12: 0000000000001000
Oct 20 05:42:42 Oxigenio kernel: R13: 0000000000000000 R14: ffffea000050be40 R15: ffff880016d590c8
Oct 20 05:42:42 Oxigenio kernel: FS: 00007f8c6e7dc700(0000) GS:ffff88002c200000(0000) knlGS:0000000000000000
Oct 20 05:42:42 Oxigenio kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Oct 20 05:42:42 Oxigenio kernel: CR2: fffff8a00604e000 CR3: 000000041c205000 CR4: 00000000001427f0
Oct 20 05:42:42 Oxigenio kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Oct 20 05:42:42 Oxigenio kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Oct 20 05:42:42 Oxigenio kernel: Process kvm (pid: 3048, veid: 0, threadinfo ffff8802deeec000, task ffff8802deee0640)
Oct 20 05:42:42 Oxigenio kernel: Stack:
Oct 20 05:42:42 Oxigenio kernel: ffff880418de9400 ffff880016d590c8 ffff8802deeeda38 ffffffff811dfb6a
Oct 20 05:42:42 Oxigenio kernel: <d> ffff880400000001 ffff880200001000 ffff880200001000 00000000811e33d6
Oct 20 05:42:42 Oxigenio kernel: <d> ffff8802deeedb80 0000000000001000 0000000000000000 0000000000001000
Oct 20 05:42:42 Oxigenio kernel: Call Trace:
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811dfb6a>] __block_commit_write.isra.17+0x7a/0xb0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811e210d>] block_write_end+0x3d/0x80
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa006b82c>] ? ext3_write_begin+0x21c/0x2b0 [ext3]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa006b4c8>] ext3_ordered_write_end+0x78/0x1c0 [ext3]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81554b68>] ? __iovec_copy_from_user_inatomic+0x4a/0x77
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131465>] generic_file_buffered_write_iter+0x175/0x2a0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8107af26>] ? current_fs_time+0x16/0x60
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131995>] __generic_file_write_iter+0x215/0x3e0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8106c5bc>] ? mutex_spin_on_owner+0x7c/0xa0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131be3>] __generic_file_aio_write+0x83/0xa0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131c88>] generic_file_aio_write+0x88/0x100
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131c00>] ? generic_file_aio_write+0x0/0x100
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a791a>] do_sync_readv_writev+0xfa/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8109fcd0>] ? autoremove_wake_function+0x0/0x40
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7a42>] ? rw_copy_check_uvector+0x52/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7a5f>] ? rw_copy_check_uvector+0x6f/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7bfb>] do_readv_writev+0xcb/0x200
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811f6e76>] ? eventfd_write+0xc6/0x1d0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa051aa54>] ? kvm_on_user_return+0x74/0x80 [kvm]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7d65>] vfs_writev+0x35/0x60
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a80ca>] sys_pwritev+0xaa/0xd0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8100b182>] system_call_fastpath+0x16/0x1b
Oct 20 05:42:42 Oxigenio kernel: Code: 44 00 00 48 8b 07 48 89 fb a8 01 74 4f a8 02 74 08 0f ae f0 f6 03 02 75 3c f0 0f ba 2b 01 19 c0 85 c0 0f 1f 00 75 2e 48 8b 7b 10 <f0> 0f ba 2f 04 19 c0 85 c0 75 1f 48 f7 07 00 00 01 00 48 8b 77
Oct 20 05:42:42 Oxigenio kernel: RIP [<ffffffff811df6f6>] mark_buffer_dirty+0x36/0xa0
Oct 20 05:42:42 Oxigenio kernel: RSP <ffff8802deeed9c8>
Oct 20 05:42:42 Oxigenio kernel: Tainting kernel with flag 0x7
Oct 20 05:42:42 Oxigenio kernel: Pid: 3048, comm: kvm veid: 0 Not tainted 2.6.32-32-pve #1
Oct 20 05:42:42 Oxigenio kernel: Call Trace:
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81073269>] ? add_taint+0x69/0x70
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8155e303>] ? oops_end+0x53/0xf0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81011908>] ? die+0x58/0x90
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8155dc02>] ? do_general_protection+0x152/0x160
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81554a8c>] ? zone_page_state_add+0x9/0x23
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8155d675>] ? general_protection+0x25/0x30
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811df6f6>] ? mark_buffer_dirty+0x36/0xa0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811dfb6a>] ? __block_commit_write.isra.17+0x7a/0xb0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811e210d>] ? block_write_end+0x3d/0x80
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa006b82c>] ? ext3_write_begin+0x21c/0x2b0 [ext3]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa006b4c8>] ? ext3_ordered_write_end+0x78/0x1c0 [ext3]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81554b68>] ? __iovec_copy_from_user_inatomic+0x4a/0x77
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131465>] ? generic_file_buffered_write_iter+0x175/0x2a0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8107af26>] ? current_fs_time+0x16/0x60
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131995>] ? __generic_file_write_iter+0x215/0x3e0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8106c5bc>] ? mutex_spin_on_owner+0x7c/0xa0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131be3>] ? __generic_file_aio_write+0x83/0xa0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131c88>] ? generic_file_aio_write+0x88/0x100
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff81131c00>] ? generic_file_aio_write+0x0/0x100
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a791a>] ? do_sync_readv_writev+0xfa/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8109fcd0>] ? autoremove_wake_function+0x0/0x40
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7a42>] ? rw_copy_check_uvector+0x52/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7a5f>] ? rw_copy_check_uvector+0x6f/0x140
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7bfb>] ? do_readv_writev+0xcb/0x200
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811f6e76>] ? eventfd_write+0xc6/0x1d0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffffa051aa54>] ? kvm_on_user_return+0x74/0x80 [kvm]
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a7d65>] ? vfs_writev+0x35/0x60
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff811a80ca>] ? sys_pwritev+0xaa/0xd0
Oct 20 05:42:42 Oxigenio kernel: [<ffffffff8100b182>] ? system_call_fastpath+0x16/0x1b
Oct 20 05:42:42 Oxigenio kernel: ---[ end trace 84f4cf4fbe8b1aa6 ]---
Oct 20 05:42:42 Oxigenio kernel: Kernel panic - not syncing: Fatal exception
 
Do your run something special (pci pass through), or just standard VM. Maybe you can find out which VM triggers the bug? For example

# qm list

shows the PID of running VMs, and the PID is also included in the kernel trace.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!