Hello everyone,
I have encountered VMs reboot automatically without any notice and reasons I couldn't find out.
Proxmox was fine, but just VMs reboot all of them. I got 7 VMs running and with specs 32G Ram, 16 CPUs.
Any answer is appreciate.
here is the log from Proxmox sysglog.
Virtual Environment 5.0-30
Node 'Dell430'
Since:
Until:
Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'iscsi_tcp'
Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (tcp)
Dec 04 10:29:12 Dell430 systemd[1]: Started Remount Root and Kernel File Systems.
Dec 04 10:29:12 Dell430 systemd[1]: Started Set the console keyboard layout.
Dec 04 10:29:12 Dell430 systemd[1]: Started Create list of required static device nodes for the current kernel.
Dec 04 10:29:12 Dell430 systemd[1]: Starting Create Static Device Nodes in /dev...
Dec 04 10:29:12 Dell430 systemd[1]: Starting udev Coldplug all Devices...
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'ib_iser'
Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (iser)
Dec 04 10:29:12 Dell430 systemd[1]: Starting Load/Save Random Seed...
Dec 04 10:29:12 Dell430 systemd[1]: Starting Flush Journal to Persistent Storage...
Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.
Dec 04 10:29:12 Dell430 systemd[1]: Started Flush Journal to Persistent Storage.
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'vhost_net'
Dec 04 10:29:12 Dell430 systemd[1]: Started Load Kernel Modules.
Dec 04 10:29:13 Dell430 systemd[1]: Mounting Configuration File System...
Dec 04 10:29:13 Dell430 systemd[1]: Mounting FUSE Control File System...
Dec 04 10:29:13 Dell430 systemd[1]: Starting Apply Kernel Variables...
Dec 04 10:29:13 Dell430 systemd[1]: Mounted FUSE Control File System.
Dec 04 10:29:13 Dell430 systemd[1]: Mounted Configuration File System.
Dec 04 10:29:13 Dell430 systemd[1]: Started Create Static Device Nodes in /dev.
Dec 04 10:29:13 Dell430 systemd[1]: Started Load/Save Random Seed.
Dec 04 10:29:13 Dell430 systemd[1]: Started udev Coldplug all Devices.
Dec 04 10:29:13 Dell430 systemd[1]: Started Apply Kernel Variables.
Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Wait for Complete Device Initialization...
Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Kernel Device Manager...
Dec 04 10:29:13 Dell430 systemd[1]: Started udev Kernel Device Manager.
Dec 04 10:29:13 Dell430 systemd-udevd[2253]: Process '/bin/mount -t fusectl fusectl /sys/fs/fuse/connections' failed with exit code 32.
Dec 04 10:29:13 Dell430 kernel: ACPI Error: No handler for Region [SYSI] (ffff8d801ecbea20) [IPMI] (20160930/evregion-166)
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20160930/exfldio-299)
Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/ttyS0.
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._GHL] (Node ffff8d801ecabc30), AE_NOT_EXIST (20160930/psparse-543)
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._PMC] (Node ffff8d801ecab2f8), AE_NOT_EXIST (20160930/psparse-543)
Dec 04 10:29:13 Dell430 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20160930/power_meter-755)
Dec 04 10:29:13 Dell430 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1
Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/zvol/rpool/swap.
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules
Dec 04 10:29:13 Dell430 kernel: wmi: Mapper loaded
Dec 04 10:29:13 Dell430 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
Dec 04 10:29:13 Dell430 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Dec 04 10:29:13 Dell430 kernel: ipmi message handler version 39.2
Dec 04 10:29:13 Dell430 systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Dec 04 10:29:13 Dell430 kernel: ipmi device interface
Dec 04 10:29:13 Dell430 kernel: mei_me 0000:00:16.0: Device doesn't have valid ME Interface
Dec 04 10:29:13 Dell430 kernel: IPMI System Interface driver.
Dec 04 10:29:13 Dell430 kernel: ipmi_si: probing via SMBIOS
Dec 04 10:29:13 Dell430 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
Dec 04 10:29:13 Dell430 systemd[1]: Activating swap /dev/zvol/rpool/swap...
Dec 04 10:29:13 Dell430 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine
Dec 04 10:29:13 Dell430 kernel: ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10
Dec 04 10:29:13 Dell430 kernel: Error: Driver 'pcspkr' is already registered, aborting...
Dec 04 10:29:14 Dell430 kernel: Adding 8388604k swap on /dev/zd128. Priority:-1 extents:1 across:8388604k SSFS
Dec 04 10:29:14 Dell430 systemd[1]: Activated swap /dev/zvol/rpool/swap.
Dec 04 10:29:14 Dell430 systemd[1]: Reached target Swap.
Dec 04 10:29:14 Dell430 kernel: AVX2 version of gcm_enc/dec engaged.
Dec 04 10:29:14 Dell430 kernel: AES CTR mode by8 optimization enabled
Dec 04 10:29:14 Dell430 kernel: [drm] Initialized
Dec 04 10:29:14 Dell430 kernel: [TTM] Zone kernel: Available graphics memory: 16358682 kiB
Dec 04 10:29:14 Dell430 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing pool allocator
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Using irq 10
Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing DMA pool allocator
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: IPMI kcs interface initialized
Dec 04 10:29:14 Dell430 kernel: fbcon: mgadrmfb (fb0) is primary device
Dec 04 10:29:14 Dell430 kernel: EDAC MC: Ver: 3.0.0
Dec 04 10:29:14 Dell430 kernel: IPMI SSIF Interface driver
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f60
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f79
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6a
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6b
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6c
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6d
Dec 04 10:29:14 Dell430 kernel: EDAC MC0: Giving out device to module sbridge_edac.c controller Broadwell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Ver: 1.1.1
Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain package
Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain dram
Dec 04 10:29:14 Dell430 kernel: intel_rapl: DRAM domain energy unit 15300pj
Dec 04 10:29:14 Dell430 kernel: intel_rapl: RAPL package 0 domain package locked by BIOS
Dec 04 10:29:14 Dell430 kernel: Console: switching to colour frame buffer device 128x48
Dec 04 10:29:14 Dell430 kernel: mgag200 0000:08:00.0: fb0: mgadrmfb frame buffer device
Dec 04 10:29:14 Dell430 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:08:00.0 on minor 0
Dec 04 10:29:14 Dell430 systemd[1]: Started udev Wait for Complete Device Initialization.
Dec 04 10:29:14 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...
Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Reached target Encrypted Volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Starting Mount ZFS filesystems...
Dec 04 10:29:15 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...
Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Dec 04 10:29:15 Dell430 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Dec 04 10:29:15 Dell430 systemd[1]: Reached target Local File Systems (Pre).
Dec 04 10:29:16 Dell430 zfs[2489]: cannot mount '/rpool/storage/vms': directory is not empty
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
Dec 04 10:29:16 Dell430 systemd[1]: Failed to start Mount ZFS filesystems.
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Unit entered failed state.
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target Local File Systems.
Dec 04 10:29:16 Dell430 systemd[1]: Starting Create Volatile Files and Directories...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Preprocess NFS configuration...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE Login Banner...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Set console font and keymap...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE firewall logger...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Commit Proxmox VE network changes...
Dec 04 10:29:16 Dell430 systemd[1]: Starting AppArmor initialization...
Dec 04 10:29:16 Dell430 systemd[1]: Started Create Volatile Files and Directories.
Dec 04 10:29:16 Dell430 systemd[1]: Started Preprocess NFS configuration.
Dec 04 10:29:16 Dell430 systemd[1]: Started Set console font and keymap.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target NFS client services.
Dec 04 10:29:16 Dell430 mv[2542]: /bin/mv: cannot stat '/etc/network/interfaces.new': No such file or directory
Dec 04 10:29:16 Dell430 systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Dec 04 10:29:16 Dell430 kernel: Netfilter messages via NETLINK v0.30.
Dec 04 10:29:16 Dell430 pvepw-logger[2550]: starting pvefw logger
Dec 04 10:29:16 Dell430 systemd[1]: Starting Network Time Synchronization...
Dec 04 10:29:16 Dell430 systemd[1]: Starting RPC bind portmap service...
Dec 04 10:29:16 Dell430 systemd[1]: Started Proxmox VE firewall logger.
Dec 04 10:29:16 Dell430 systemd[1]: Started Update UTMP about System Boot/Shutdown.
Dec 04 10:29:16 Dell430 systemd[1]: Started Commit Proxmox VE network changes.
Dec 04 10:29:16 Dell430 systemd[1]: Started Network Time Synchronization.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target System Time Synchronized.
Dec 04 10:29:17 Dell430 systemd[1]: Started RPC bind portmap service.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target RPC Port Mapper.
Dec 04 10:29:17 Dell430 audit[2605]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 apparmor[2537]: Starting AppArmor profiles:.
Dec 04 10:29:17 Dell430 systemd[1]: Started AppArmor initialization.
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.384:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-cgns" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-mounting" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-nesting" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 systemd[1]: Starting Raise network interfaces...
Dec 04 10:29:17 Dell430 systemd[1]: Reached target System Initialization.
Dec 04 10:29:17 Dell430 systemd[1]: Listening on D-Bus System Message Bus Socket.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target Sockets.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target Basic System.
Dec 04 10:29:17 Dell430 systemd[1]: Started D-Bus System Message Bus.
Dec 04 10:29:18 Dell430 dbus[2614]: [system] AppArmor D-Bus mediation is enabled
Dec 04 10:29:18 Dell430 systemd[1]: Starting ZFS file system shares...
Dec 04 10:29:18 Dell430 systemd[1]: Starting System Logging Service...
Dec 04 10:29:18 Dell430 systemd[1]: Started Self Monitoring and Reporting Technology (SMART) Daemon.
Dec 04 10:29:18 Dell430 systemd[1]: Started FUSE filesystem for LXC.
Dec 04 10:29:18 Dell430 systemd[1]: Starting Login Service...
Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE replication runner.
Dec 04 10:29:18 Dell430 systemd[1]: Starting Kernel Samepage Merging (KSM) Tuning Daemon...
Dec 04 10:29:18 Dell430 systemd[1]: Started Daily Cleanup of Temporary Directories.
Dec 04 10:29:18 Dell430 kernel: cgroup: new mount options do not match the existing superblock, will be ignored
Dec 04 10:29:18 Dell430 smartd[2618]: smartd 6.6 2016-05-31 r4324 [x86_64-linux-4.10.17-2-pve] (local build)
Dec 04 10:29:18 Dell430 smartd[2618]: Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
Dec 04 10:29:18 Dell430 smartd[2618]: Opened configuration file /etc/smartd.conf
Dec 04 10:29:18 Dell430 smartd[2618]: Drive: DEVICESCAN, implied '-a' Directive on line 21 of file /etc/smartd.conf
Dec 04 10:29:18 Dell430 smartd[2618]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE watchdog multiplexer.
Dec 04 10:29:18 Dell430 lxcfs[2619]: hierarchies:
Dec 04 10:29:18 Dell430 lxcfs[2619]: 0: fd: 5: freezer
Dec 04 10:29:18 Dell430 lxcfs[2619]: 1: fd: 6: cpuset
Dec 04 10:29:18 Dell430 lxcfs[2619]: 2: fd: 7: devices
Dec 04 10:29:18 Dell430 lxcfs[2619]: 3: fd: 8: memory
Dec 04 10:29:18 Dell430 lxcfs[2619]: 4: fd: 9: pids
Dec 04 10:29:18 Dell430 lxcfs[2619]: 5: fd: 10: net_cls,net_prio
Dec 04 10:29:18 Dell430 lxcfs[2619]: 6: fd: 11: cpu,cpuacct
Dec 04 10:29:18 Dell430 lxcfs[2619]: 7: fd: 12: perf_event
Dec 04 10:29:18 Dell430 lxcfs[2619]: 8: fd: 13: hugetlb
Dec 04 10:29:18 Dell430 lxcfs[2619]: 9: fd: 14: blkio
Dec 04 10:29:18 Dell430 lxcfs
I have encountered VMs reboot automatically without any notice and reasons I couldn't find out.
Proxmox was fine, but just VMs reboot all of them. I got 7 VMs running and with specs 32G Ram, 16 CPUs.
Any answer is appreciate.
here is the log from Proxmox sysglog.
Virtual Environment 5.0-30
Node 'Dell430'
Since:
Until:
Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'iscsi_tcp'
Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (tcp)
Dec 04 10:29:12 Dell430 systemd[1]: Started Remount Root and Kernel File Systems.
Dec 04 10:29:12 Dell430 systemd[1]: Started Set the console keyboard layout.
Dec 04 10:29:12 Dell430 systemd[1]: Started Create list of required static device nodes for the current kernel.
Dec 04 10:29:12 Dell430 systemd[1]: Starting Create Static Device Nodes in /dev...
Dec 04 10:29:12 Dell430 systemd[1]: Starting udev Coldplug all Devices...
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'ib_iser'
Dec 04 10:29:12 Dell430 kernel: iscsi: registered transport (iser)
Dec 04 10:29:12 Dell430 systemd[1]: Starting Load/Save Random Seed...
Dec 04 10:29:12 Dell430 systemd[1]: Starting Flush Journal to Persistent Storage...
Dec 04 10:29:12 Dell430 systemd-journald[2214]: Runtime journal (/run/log/journal/bc2f684e31ee4daf95e45c62410a95b1) is 8.0M, max 319.5M, 311.5M free.
Dec 04 10:29:12 Dell430 systemd[1]: Started Flush Journal to Persistent Storage.
Dec 04 10:29:12 Dell430 systemd-modules-load[2208]: Inserted module 'vhost_net'
Dec 04 10:29:12 Dell430 systemd[1]: Started Load Kernel Modules.
Dec 04 10:29:13 Dell430 systemd[1]: Mounting Configuration File System...
Dec 04 10:29:13 Dell430 systemd[1]: Mounting FUSE Control File System...
Dec 04 10:29:13 Dell430 systemd[1]: Starting Apply Kernel Variables...
Dec 04 10:29:13 Dell430 systemd[1]: Mounted FUSE Control File System.
Dec 04 10:29:13 Dell430 systemd[1]: Mounted Configuration File System.
Dec 04 10:29:13 Dell430 systemd[1]: Started Create Static Device Nodes in /dev.
Dec 04 10:29:13 Dell430 systemd[1]: Started Load/Save Random Seed.
Dec 04 10:29:13 Dell430 systemd[1]: Started udev Coldplug all Devices.
Dec 04 10:29:13 Dell430 systemd[1]: Started Apply Kernel Variables.
Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Wait for Complete Device Initialization...
Dec 04 10:29:13 Dell430 systemd[1]: Starting udev Kernel Device Manager...
Dec 04 10:29:13 Dell430 systemd[1]: Started udev Kernel Device Manager.
Dec 04 10:29:13 Dell430 systemd-udevd[2253]: Process '/bin/mount -t fusectl fusectl /sys/fs/fuse/connections' failed with exit code 32.
Dec 04 10:29:13 Dell430 kernel: ACPI Error: No handler for Region [SYSI] (ffff8d801ecbea20) [IPMI] (20160930/evregion-166)
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Region IPMI (ID=7) has no handler (20160930/exfldio-299)
Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/ttyS0.
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._GHL] (Node ffff8d801ecabc30), AE_NOT_EXIST (20160930/psparse-543)
Dec 04 10:29:13 Dell430 kernel: ACPI Error: Method parse/execution failed [\_SB.PMI0._PMC] (Node ffff8d801ecab2f8), AE_NOT_EXIST (20160930/psparse-543)
Dec 04 10:29:13 Dell430 kernel: ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20160930/power_meter-755)
Dec 04 10:29:13 Dell430 kernel: input: PC Speaker as /devices/platform/pcspkr/input/input1
Dec 04 10:29:13 Dell430 systemd[1]: Found device /dev/zvol/rpool/swap.
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain package 2^-14 Joules
Dec 04 10:29:13 Dell430 kernel: RAPL PMU: hw unit of domain dram 2^-16 Joules
Dec 04 10:29:13 Dell430 kernel: wmi: Mapper loaded
Dec 04 10:29:13 Dell430 kernel: dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
Dec 04 10:29:13 Dell430 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Dec 04 10:29:13 Dell430 kernel: ipmi message handler version 39.2
Dec 04 10:29:13 Dell430 systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Dec 04 10:29:13 Dell430 kernel: ipmi device interface
Dec 04 10:29:13 Dell430 kernel: mei_me 0000:00:16.0: Device doesn't have valid ME Interface
Dec 04 10:29:13 Dell430 kernel: IPMI System Interface driver.
Dec 04 10:29:13 Dell430 kernel: ipmi_si: probing via SMBIOS
Dec 04 10:29:13 Dell430 kernel: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
Dec 04 10:29:13 Dell430 systemd[1]: Activating swap /dev/zvol/rpool/swap...
Dec 04 10:29:13 Dell430 kernel: ipmi_si: Adding SMBIOS-specified kcs state machine
Dec 04 10:29:13 Dell430 kernel: ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10
Dec 04 10:29:13 Dell430 kernel: Error: Driver 'pcspkr' is already registered, aborting...
Dec 04 10:29:14 Dell430 kernel: Adding 8388604k swap on /dev/zd128. Priority:-1 extents:1 across:8388604k SSFS
Dec 04 10:29:14 Dell430 systemd[1]: Activated swap /dev/zvol/rpool/swap.
Dec 04 10:29:14 Dell430 systemd[1]: Reached target Swap.
Dec 04 10:29:14 Dell430 kernel: AVX2 version of gcm_enc/dec engaged.
Dec 04 10:29:14 Dell430 kernel: AES CTR mode by8 optimization enabled
Dec 04 10:29:14 Dell430 kernel: [drm] Initialized
Dec 04 10:29:14 Dell430 kernel: [TTM] Zone kernel: Available graphics memory: 16358682 kiB
Dec 04 10:29:14 Dell430 kernel: [TTM] Zone dma32: Available graphics memory: 2097152 kiB
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing pool allocator
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Using irq 10
Dec 04 10:29:14 Dell430 kernel: [TTM] Initializing DMA pool allocator
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
Dec 04 10:29:14 Dell430 kernel: ipmi_si ipmi_si.0: IPMI kcs interface initialized
Dec 04 10:29:14 Dell430 kernel: fbcon: mgadrmfb (fb0) is primary device
Dec 04 10:29:14 Dell430 kernel: EDAC MC: Ver: 3.0.0
Dec 04 10:29:14 Dell430 kernel: IPMI SSIF Interface driver
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa0
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffc
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6ffd
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f60
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fa8
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f71
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faa
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fab
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fac
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6fad
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6faf
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f68
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f79
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6a
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6b
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6c
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Seeking for: PCI ID 8086:6f6d
Dec 04 10:29:14 Dell430 kernel: EDAC MC0: Giving out device to module sbridge_edac.c controller Broadwell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
Dec 04 10:29:14 Dell430 kernel: EDAC sbridge: Ver: 1.1.1
Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain package
Dec 04 10:29:14 Dell430 kernel: intel_rapl: Found RAPL domain dram
Dec 04 10:29:14 Dell430 kernel: intel_rapl: DRAM domain energy unit 15300pj
Dec 04 10:29:14 Dell430 kernel: intel_rapl: RAPL package 0 domain package locked by BIOS
Dec 04 10:29:14 Dell430 kernel: Console: switching to colour frame buffer device 128x48
Dec 04 10:29:14 Dell430 kernel: mgag200 0000:08:00.0: fb0: mgadrmfb frame buffer device
Dec 04 10:29:14 Dell430 kernel: [drm] Initialized mgag200 1.0.0 20110418 for 0000:08:00.0 on minor 0
Dec 04 10:29:14 Dell430 systemd[1]: Started udev Wait for Complete Device Initialization.
Dec 04 10:29:14 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...
Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Reached target Encrypted Volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Starting Mount ZFS filesystems...
Dec 04 10:29:15 Dell430 systemd[1]: Starting Activation of LVM2 logical volumes...
Dec 04 10:29:15 Dell430 systemd[1]: Started Activation of LVM2 logical volumes.
Dec 04 10:29:15 Dell430 systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
Dec 04 10:29:15 Dell430 systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
Dec 04 10:29:15 Dell430 systemd[1]: Reached target Local File Systems (Pre).
Dec 04 10:29:16 Dell430 zfs[2489]: cannot mount '/rpool/storage/vms': directory is not empty
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
Dec 04 10:29:16 Dell430 systemd[1]: Failed to start Mount ZFS filesystems.
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Unit entered failed state.
Dec 04 10:29:16 Dell430 systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target Local File Systems.
Dec 04 10:29:16 Dell430 systemd[1]: Starting Create Volatile Files and Directories...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Preprocess NFS configuration...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE Login Banner...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Set console font and keymap...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Proxmox VE firewall logger...
Dec 04 10:29:16 Dell430 systemd[1]: Starting Commit Proxmox VE network changes...
Dec 04 10:29:16 Dell430 systemd[1]: Starting AppArmor initialization...
Dec 04 10:29:16 Dell430 systemd[1]: Started Create Volatile Files and Directories.
Dec 04 10:29:16 Dell430 systemd[1]: Started Preprocess NFS configuration.
Dec 04 10:29:16 Dell430 systemd[1]: Started Set console font and keymap.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target NFS client services.
Dec 04 10:29:16 Dell430 mv[2542]: /bin/mv: cannot stat '/etc/network/interfaces.new': No such file or directory
Dec 04 10:29:16 Dell430 systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Dec 04 10:29:16 Dell430 kernel: Netfilter messages via NETLINK v0.30.
Dec 04 10:29:16 Dell430 pvepw-logger[2550]: starting pvefw logger
Dec 04 10:29:16 Dell430 systemd[1]: Starting Network Time Synchronization...
Dec 04 10:29:16 Dell430 systemd[1]: Starting RPC bind portmap service...
Dec 04 10:29:16 Dell430 systemd[1]: Started Proxmox VE firewall logger.
Dec 04 10:29:16 Dell430 systemd[1]: Started Update UTMP about System Boot/Shutdown.
Dec 04 10:29:16 Dell430 systemd[1]: Started Commit Proxmox VE network changes.
Dec 04 10:29:16 Dell430 systemd[1]: Started Network Time Synchronization.
Dec 04 10:29:16 Dell430 systemd[1]: Reached target System Time Synchronized.
Dec 04 10:29:17 Dell430 systemd[1]: Started RPC bind portmap service.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target RPC Port Mapper.
Dec 04 10:29:17 Dell430 audit[2605]: AVC apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 apparmor[2537]: Starting AppArmor profiles:.
Dec 04 10:29:17 Dell430 systemd[1]: Started AppArmor initialization.
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.384:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2605 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-cgns" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-mounting" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 kernel: audit: type=1400 audit(1512412157.436:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-nesting" pid=2604 comm="apparmor_parser"
Dec 04 10:29:17 Dell430 systemd[1]: Starting Raise network interfaces...
Dec 04 10:29:17 Dell430 systemd[1]: Reached target System Initialization.
Dec 04 10:29:17 Dell430 systemd[1]: Listening on D-Bus System Message Bus Socket.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target Sockets.
Dec 04 10:29:17 Dell430 systemd[1]: Reached target Basic System.
Dec 04 10:29:17 Dell430 systemd[1]: Started D-Bus System Message Bus.
Dec 04 10:29:18 Dell430 dbus[2614]: [system] AppArmor D-Bus mediation is enabled
Dec 04 10:29:18 Dell430 systemd[1]: Starting ZFS file system shares...
Dec 04 10:29:18 Dell430 systemd[1]: Starting System Logging Service...
Dec 04 10:29:18 Dell430 systemd[1]: Started Self Monitoring and Reporting Technology (SMART) Daemon.
Dec 04 10:29:18 Dell430 systemd[1]: Started FUSE filesystem for LXC.
Dec 04 10:29:18 Dell430 systemd[1]: Starting Login Service...
Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE replication runner.
Dec 04 10:29:18 Dell430 systemd[1]: Starting Kernel Samepage Merging (KSM) Tuning Daemon...
Dec 04 10:29:18 Dell430 systemd[1]: Started Daily Cleanup of Temporary Directories.
Dec 04 10:29:18 Dell430 kernel: cgroup: new mount options do not match the existing superblock, will be ignored
Dec 04 10:29:18 Dell430 smartd[2618]: smartd 6.6 2016-05-31 r4324 [x86_64-linux-4.10.17-2-pve] (local build)
Dec 04 10:29:18 Dell430 smartd[2618]: Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
Dec 04 10:29:18 Dell430 smartd[2618]: Opened configuration file /etc/smartd.conf
Dec 04 10:29:18 Dell430 smartd[2618]: Drive: DEVICESCAN, implied '-a' Directive on line 21 of file /etc/smartd.conf
Dec 04 10:29:18 Dell430 smartd[2618]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Dec 04 10:29:18 Dell430 systemd[1]: Started Proxmox VE watchdog multiplexer.
Dec 04 10:29:18 Dell430 lxcfs[2619]: hierarchies:
Dec 04 10:29:18 Dell430 lxcfs[2619]: 0: fd: 5: freezer
Dec 04 10:29:18 Dell430 lxcfs[2619]: 1: fd: 6: cpuset
Dec 04 10:29:18 Dell430 lxcfs[2619]: 2: fd: 7: devices
Dec 04 10:29:18 Dell430 lxcfs[2619]: 3: fd: 8: memory
Dec 04 10:29:18 Dell430 lxcfs[2619]: 4: fd: 9: pids
Dec 04 10:29:18 Dell430 lxcfs[2619]: 5: fd: 10: net_cls,net_prio
Dec 04 10:29:18 Dell430 lxcfs[2619]: 6: fd: 11: cpu,cpuacct
Dec 04 10:29:18 Dell430 lxcfs[2619]: 7: fd: 12: perf_event
Dec 04 10:29:18 Dell430 lxcfs[2619]: 8: fd: 13: hugetlb
Dec 04 10:29:18 Dell430 lxcfs[2619]: 9: fd: 14: blkio
Dec 04 10:29:18 Dell430 lxcfs