Vms restart automatically for no reasons

eddie

New Member
Jun 21, 2017
11
0
1
43
Hello everyone,
I have encountered VMs reboot automatically without any notice and reasons I couldn't find out.
Proxmox was fine, but just VMs reboot all of them. I got 7 VMs running and with specs 32G Ram, 16 CPUs.

Any answer is appreciate.

here is the log from Proxmox sysglog.

Virtual Environment 5.0-30

Node 'Dell430'

Since:

Until:

Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.

Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'iscsi_tcp'

Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (tcp)

Dec 04 10:29:12 Dell430 systemd[1]: Started Remount Root and Kernel File Systems.

Dec 04 10:29:12 Dell430 systemd[1]: Started Set the console keyboard layout.

Dec 04 10:29:12 Dell430 systemd[1]: Started Create list of required static device nodes for the current kernel.

Dec 04 10:29:12 Dell430 systemd[1]: Starting Create Static Device Nodes in /dev...

Dec 04 10:29:12 Dell430 systemd[1]: Starting udev Coldplug all Devices...

Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'ib_iser'

Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (iser)

Dec 04 10:29:12 Dell430 systemd[1]: Starting Load/Save Random Seed...

Dec 04 10:29:12 Dell430 systemd[1]: Starting Flush Journal to Persistent Storage...

Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.

Dec 04 10:29:12 Dell430 systemd[1]: Started Flush Journal to Persistent Storage.

Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'vhost_net'

Dec 04 10:29:12 Dell430 systemd[1]: Started Load Kernel Modules.

Dec 04 10:29:13 Dell430 systemd[1]: Mounting Configuration File System...

Dec 04 10:29:13 Dell430 systemd[1]: Mounting FUSE Control File System...

Dec 04 10:29:13 Dell430 systemd[1]: Starting Apply Kernel Variables...

Dec 04 10:29:13 Dell430 systemd[1]: Mounted FUSE Control File System.

Dec 04 10:29:13 Dell430 systemd[1]: Mounted Configuration File System.

Dec 04 10:29:13 Dell430 systemd[1]: Started Create Static Device Nodes in /dev.

Dec 04 10:29:13 Dell430 systemd[1]: Started Load/Save Random Seed.

Dec 04 10:29:13 Dell430 systemd[1]: Started udev Coldplug all Devices.

Dec 04 10:29:13 Dell430 systemd[1]: Started Apply Kernel Variables.

Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Wait for Complete Device Initialization...

Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Kernel Device Manager...

Dec 04 10:29:13 Dell430 systemd[1]: Started udev Kernel Device Manager.

Dec 04 10:29:13 Dell430 systemd-udevd[2253]: Process '/bin/mount -t fusectl fusectl /sys/fs/fuse/connections' failed with exit code 32.

Dec 04 10:29:13 Dell430 kernel: ACPI Error: No handler for Region [SYSI] (ffff8d801ecbea20) [IPMI] (20160930/evregion-166)

Dec 04 10:29:13 Dell430 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20160930/exfldio-299)

Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/ttyS0.

Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._GHL] (Node ffff8d801ecabc30), AE_NOT_EXIST (20160930/psparse-543)

Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._PMC] (Node ffff8d801ecab2f8), AE_NOT_EXIST (20160930/psparse-543)

Dec 04 10:29:13 Dell430 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20160930/power_meter-755)

Dec 04 10:29:13 Dell430 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1

Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/zvol/rpool/swap.

Dec 04 10:29:13 Dell430 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer

Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules

Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules

Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules

Dec 04 10:29:13 Dell430 kernel: wmi: Mapper loaded

Dec 04 10:29:13 Dell430 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)

Dec 04 10:29:13 Dell430 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4

Dec 04 10:29:13 Dell430 kernel: ipmi message handler version 39.2

Dec 04 10:29:13 Dell430 systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.

Dec 04 10:29:13 Dell430 kernel: ipmi device interface

Dec 04 10:29:13 Dell430 kernel: mei_me 0000:00:16.0: Device doesn't have valid ME Interface

Dec 04 10:29:13 Dell430 kernel: IPMI System Interface driver.

Dec 04 10:29:13 Dell430 kernel: ipmi_si: probing via SMBIOS

Dec 04 10:29:13 Dell430 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10

Dec 04 10:29:13 Dell430 systemd[1]: Activating swap /dev/zvol/rpool/swap...

Dec 04 10:29:13 Dell430 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine

Dec 04 10:29:13 Dell430 kernel: ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10

Dec 04 10:29:13 Dell430 kernel: Error: Driver 'pcspkr' is already registered, aborting...

Dec 04 10:29:14 Dell430 kernel: Adding 8388604k swap on /dev/zd128. Priority:-1 extents:1 across:8388604k SSFS

Dec 04 10:29:14 Dell430 systemd[1]: Activated swap /dev/zvol/rpool/swap.

Dec 04 10:29:14 Dell430 systemd[1]: Reached target Swap.

Dec 04 10:29:14 Dell430 kernel: AVX2 version of gcm_enc/dec engaged.

Dec 04 10:29:14 Dell430 kernel: AES CTR mode by8 optimization enabled

Dec 04 10:29:14 Dell430 kernel: [drm] Initialized

Dec 04 10:29:14 Dell430 kernel: [TTM] Zone kernel: Available graphics memory: 16358682 kiB

Dec 04 10:29:14 Dell430 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB

Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.

Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing pool allocator

Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Using irq 10

Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing DMA pool allocator

Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)

Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: IPMI kcs interface initialized

Dec 04 10:29:14 Dell430 kernel: fbcon: mgadrmfb (fb0) is primary device

Dec 04 10:29:14 Dell430 kernel: EDAC MC: Ver: 3.0.0

Dec 04 10:29:14 Dell430 kernel: IPMI SSIF Interface driver

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f60

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f79

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6a

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6b

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6c

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6d

Dec 04 10:29:14 Dell430 kernel: EDAC MC0: Giving out device to module sbridge_edac.c controller Broadwell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)

Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Ver: 1.1.1

Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain package

Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain dram

Dec 04 10:29:14 Dell430 kernel: intel_rapl: DRAM domain energy unit 15300pj

Dec 04 10:29:14 Dell430 kernel: intel_rapl: RAPL package 0 domain package locked by BIOS

Dec 04 10:29:14 Dell430 kernel: Console: switching to colour frame buffer device 128x48

Dec 04 10:29:14 Dell430 kernel: mgag200 0000:08:00.0: fb0: mgadrmfb frame buffer device

Dec 04 10:29:14 Dell430 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:08:00.0 on minor 0

Dec 04 10:29:14 Dell430 systemd[1]: Started udev Wait for Complete Device Initialization.

Dec 04 10:29:14 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...

Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.

Dec 04 10:29:15 Dell430 systemd[1]: Reached target Encrypted Volumes.

Dec 04 10:29:15 Dell430 systemd[1]: Starting Mount ZFS filesystems...

Dec 04 10:29:15 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...

Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.

Dec 04 10:29:15 Dell430 systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...

Dec 04 10:29:15 Dell430 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.

Dec 04 10:29:15 Dell430 systemd[1]: Reached target Local File Systems (Pre).

Dec 04 10:29:16 Dell430 zfs[2489]: cannot mount '/rpool/storage/vms': directory is not empty

Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE

Dec 04 10:29:16 Dell430 systemd[1]: Failed to start Mount ZFS filesystems.

Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Unit entered failed state.

Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Failed with result 'exit-code'.

Dec 04 10:29:16 Dell430 systemd[1]: Reached target Local File Systems.

Dec 04 10:29:16 Dell430 systemd[1]: Starting Create Volatile Files and Directories...

Dec 04 10:29:16 Dell430 systemd[1]: Starting Preprocess NFS configuration...

Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE Login Banner...

Dec 04 10:29:16 Dell430 systemd[1]: Starting Set console font and keymap...

Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE firewall logger...

Dec 04 10:29:16 Dell430 systemd[1]: Starting Commit Proxmox VE network changes...

Dec 04 10:29:16 Dell430 systemd[1]: Starting AppArmor initialization...

Dec 04 10:29:16 Dell430 systemd[1]: Started Create Volatile Files and Directories.

Dec 04 10:29:16 Dell430 systemd[1]: Started Preprocess NFS configuration.

Dec 04 10:29:16 Dell430 systemd[1]: Started Set console font and keymap.

Dec 04 10:29:16 Dell430 systemd[1]: Reached target NFS client services.

Dec 04 10:29:16 Dell430 mv[2542]: /bin/mv: cannot stat '/etc/network/interfaces.new': No such file or directory

Dec 04 10:29:16 Dell430 systemd[1]: Starting Update UTMP about System Boot/Shutdown...

Dec 04 10:29:16 Dell430 kernel: Netfilter messages via NETLINK v0.30.

Dec 04 10:29:16 Dell430 pvepw-logger[2550]: starting pvefw logger

Dec 04 10:29:16 Dell430 systemd[1]: Starting Network Time Synchronization...

Dec 04 10:29:16 Dell430 systemd[1]: Starting RPC bind portmap service...

Dec 04 10:29:16 Dell430 systemd[1]: Started Proxmox VE firewall logger.

Dec 04 10:29:16 Dell430 systemd[1]: Started Update UTMP about System Boot/Shutdown.

Dec 04 10:29:16 Dell430 systemd[1]: Started Commit Proxmox VE network changes.

Dec 04 10:29:16 Dell430 systemd[1]: Started Network Time Synchronization.

Dec 04 10:29:16 Dell430 systemd[1]: Reached target System Time Synchronized.

Dec 04 10:29:17 Dell430 systemd[1]: Started RPC bind portmap service.

Dec 04 10:29:17 Dell430 systemd[1]: Reached target RPC Port Mapper.

Dec 04 10:29:17 Dell430 audit[2605]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 apparmor[2537]: Starting AppArmor profiles:.

Dec 04 10:29:17 Dell430 systemd[1]: Started AppArmor initialization.

Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.384:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default" pid=2604 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-cgns" pid=2604 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-mounting" pid=2604 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-nesting" pid=2604 comm="apparmor_parser"

Dec 04 10:29:17 Dell430 systemd[1]: Starting Raise network interfaces...

Dec 04 10:29:17 Dell430 systemd[1]: Reached target System Initialization.

Dec 04 10:29:17 Dell430 systemd[1]: Listening on D-Bus System Message Bus Socket.

Dec 04 10:29:17 Dell430 systemd[1]: Reached target Sockets.

Dec 04 10:29:17 Dell430 systemd[1]: Reached target Basic System.

Dec 04 10:29:17 Dell430 systemd[1]: Started D-Bus System Message Bus.

Dec 04 10:29:18 Dell430 dbus[2614]: [system] AppArmor D-Bus mediation is enabled

Dec 04 10:29:18 Dell430 systemd[1]: Starting ZFS file system shares...

Dec 04 10:29:18 Dell430 systemd[1]: Starting System Logging Service...

Dec 04 10:29:18 Dell430 systemd[1]: Started Self Monitoring and Reporting Technology (SMART) Daemon.

Dec 04 10:29:18 Dell430 systemd[1]: Started FUSE filesystem for LXC.

Dec 04 10:29:18 Dell430 systemd[1]: Starting Login Service...

Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE replication runner.

Dec 04 10:29:18 Dell430 systemd[1]: Starting Kernel Samepage Merging (KSM) Tuning Daemon...

Dec 04 10:29:18 Dell430 systemd[1]: Started Daily Cleanup of Temporary Directories.

Dec 04 10:29:18 Dell430 kernel: cgroup: new mount options do not match the existing superblock, will be ignored

Dec 04 10:29:18 Dell430 smartd[2618]: smartd 6.6 2016-05-31 r4324 [x86_64-linux-4.10.17-2-pve] (local build)

Dec 04 10:29:18 Dell430 smartd[2618]: Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

Dec 04 10:29:18 Dell430 smartd[2618]: Opened configuration file /etc/smartd.conf

Dec 04 10:29:18 Dell430 smartd[2618]: Drive: DEVICESCAN, implied '-a' Directive on line 21 of file /etc/smartd.conf

Dec 04 10:29:18 Dell430 smartd[2618]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices

Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE watchdog multiplexer.

Dec 04 10:29:18 Dell430 lxcfs[2619]: hierarchies:

Dec 04 10:29:18 Dell430 lxcfs[2619]: 0: fd: 5: freezer

Dec 04 10:29:18 Dell430 lxcfs[2619]: 1: fd: 6: cpuset

Dec 04 10:29:18 Dell430 lxcfs[2619]: 2: fd: 7: devices

Dec 04 10:29:18 Dell430 lxcfs[2619]: 3: fd: 8: memory

Dec 04 10:29:18 Dell430 lxcfs[2619]: 4: fd: 9: pids

Dec 04 10:29:18 Dell430 lxcfs[2619]: 5: fd: 10: net_cls,net_prio

Dec 04 10:29:18 Dell430 lxcfs[2619]: 6: fd: 11: cpu,cpuacct

Dec 04 10:29:18 Dell430 lxcfs[2619]: 7: fd: 12: perf_event

Dec 04 10:29:18 Dell430 lxcfs[2619]: 8: fd: 13: hugetlb

Dec 04 10:29:18 Dell430 lxcfs[2619]: 9: fd: 14: blkio

Dec 04 10:29:18 Dell430 lxcfs
 
Hi,

I have the same problem !! I have 3 proxmox server and they stop all vm and containers every 2 weeks at the same hour ! No automatically restart task was created, so I don't understand what's happening..

Bye
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!