[SOLVED] One node dont start pve service

greydjin

New Member
Dec 17, 2015
3
0
1
35
Hello!

I have 3 node in claster. PVE3 is a new node, and i have some problem.
I am finish config storrage, network and add this node to cluster. After that i add new bridge with vlan, reboot node and
Code:
root@pve3:~# service pvedaemon status
● pvedaemon.service
   Loaded: masked (/dev/null)
   Active: inactive (dead)

Warning: Unit file changed on disk, 'systemctl daemon-reload' recommended.
root@pve3:~# pveversion -v
-bash: pveversion: command not found
root@pve3:~# service pve-manager start
Failed to start pve-manager.service: Unit pve-manager.service is masked.
root@pve3:~# service pve-manager status
● pve-manager.service
   Loaded: masked (/dev/null)
   Active: inactive (dead)

Warning: Unit file changed on disk, 'systemctl daemon-reload' recommended.
I revert changes.
My interfaces file now
Code:
root@pve3:~# cat /etc/network/interfaces
auto lo
iface lo inet loopback
iface eth0 inet manual
iface eth1 inet manual

auto vmbr0
iface vmbr0 inet static
        address  192.168.3.3
        netmask  255.255.255.0
        gateway  192.168.3.1
        bridge_ports eth1
        bridge_stp off
        bridge_fd 0

auto vmbr1
iface vmbr1 inet static
        address  10.10.3.3
        netmask  255.255.255.0
        bridge_ports eth0
        bridge_stp off
        bridge_fd 0
        pre-up ifconfig eth0 mtu 9000

What can i do to start pve?
 
Last edited:
dmesg.log
Jul 29 14:02:50 pve3 pve-ha-crm[1573]: server stopped
Jul 29 14:03:29 pve3 systemd-modules-load[340]: Module 'fuse' is builtin
Jul 29 14:03:29 pve3 systemd-modules-load[340]: Inserted module 'vhost_net'
Jul 29 14:03:29 pve3 hdparm[370]: Setting parameters of disc: (none).
Jul 29 14:03:29 pve3 mdadm-raid[368]: Generating udev events for MD arrays...done.
Jul 29 14:03:29 pve3 keyboard-setup[367]: Setting preliminary keymap...done.
Jul 29 14:03:29 pve3 udev-finish[678]: /lib/udev/udev-finish: 6: /lib/udev/udev-finish: cannot create /etc/udev/rules.d/70-persistent-net.rules: Read-only file system
Jul 29 14:03:29 pve3 systemd[1]: udev-finish.service: main process exited, code=exited, status=2/INVALIDARGUMENT
Jul 29 14:03:29 pve3 systemd[1]: Failed to start Copy rules generated while the root was ro.
Jul 29 14:03:29 pve3 systemd[1]: Unit udev-finish.service entered failed state.
Jul 29 14:03:29 pve3 lvm[676]: 2 logical volume(s) in volume group "pve" now active
Jul 29 14:03:29 pve3 systemd-fsck[705]: /dev/mapper/data-storrage_ssd: clean, 18/44326912 files, 3981983/177285120 blocks
Jul 29 14:03:29 pve3 lvm[676]: 2 logical volume(s) in volume group "data" now active
Jul 29 14:03:29 pve3 systemd-fsck[721]: /dev/mapper/data-storrage: clean, 21/244187136 files, 15880169/976720896 blocks
Jul 29 14:03:29 pve3 lvm[720]: 2 logical volume(s) in volume group "pve" now active
Jul 29 14:03:29 pve3 lvm[720]: 2 logical volume(s) in volume group "data" now active
Jul 29 14:03:29 pve3 zpool[810]: no pools available to import
Jul 29 14:03:29 pve3 lvm[817]: 2 logical volume(s) in volume group "pve" monitored
Jul 29 14:03:29 pve3 lvm[817]: 2 logical volume(s) in volume group "data" monitored
Jul 29 14:03:29 pve3 pvepw-logger[875]: starting pvefw logger
Jul 29 14:03:29 pve3 networking[846]: Configuring network interfaces...
Jul 29 14:03:29 pve3 networking[846]: Waiting for vmbr0 to get ready (MAXWAIT is 2 seconds).
Jul 29 14:03:29 pve3 networking[846]: Waiting for vmbr1 to get ready (MAXWAIT is 2 seconds).
Jul 29 14:03:29 pve3 networking[846]: done.
Jul 29 14:03:29 pve3 iscsid: iSCSI logger with pid=1209 started!
Jul 29 14:03:29 pve3 open-iscsi[1185]: Starting iSCSI initiator service: iscsid.
Jul 29 14:03:29 pve3 open-iscsi[1185]: Setting up iSCSI targets:
Jul 29 14:03:29 pve3 open-iscsi[1185]: iscsiadm: No records found
Jul 29 14:03:29 pve3 open-iscsi[1185]: .
Jul 29 14:03:29 pve3 open-iscsi[1185]: Mounting network filesystems:.
Jul 29 14:03:29 pve3 open-iscsi[1185]: Enabling network swap devices:.
Jul 29 14:03:29 pve3 rpcbind[1187]: Starting rpcbind daemon....
Jul 29 14:03:29 pve3 kbd[1225]: Setting console screen modes.
Jul 29 14:03:29 pve3 kbd[1225]: setterm: $TERM is not defined.
Jul 29 14:03:29 pve3 rpc.statd[1309]: Version 1.2.8 starting
Jul 29 14:03:29 pve3 sm-notify[1310]: Version 1.2.8 starting
Jul 29 14:03:29 pve3 apparmor[1222]: Starting AppArmor profiles:.
Jul 29 14:03:29 pve3 nfs-common[1264]: Starting NFS common utilities: statd idmapd.
Jul 29 14:03:29 pve3 console-setup[1287]: Setting up console font and keymap.../usr/bin/ckbcomp: Can not find file "symbols/en-us" in any known directory
Jul 29 14:03:29 pve3 console-setup[1287]: failed.
Jul 29 14:03:29 pve3 lxcfs[1345]: hierarchies: 0: pids
Jul 29 14:03:29 pve3 lxcfs[1345]: 1: hugetlb
Jul 29 14:03:29 pve3 lxcfs[1345]: 2: perf_event
Jul 29 14:03:29 pve3 lxcfs[1345]: 3: net_cls,net_prio
Jul 29 14:03:29 pve3 lxcfs[1345]: 4: freezer
Jul 29 14:03:29 pve3 lxcfs[1345]: 5: devices
Jul 29 14:03:29 pve3 lxcfs[1345]: 6: memory
Jul 29 14:03:29 pve3 lxcfs[1345]: 7: blkio
Jul 29 14:03:29 pve3 lxcfs[1345]: 8: cpu,cpuacct
Jul 29 14:03:29 pve3 lxcfs[1345]: 9: cpuset
Jul 29 14:03:29 pve3 lxcfs[1345]: 10: name=systemd
Jul 29 14:03:29 pve3 rm[1355]: /bin/rm: cannot remove ‘/etc/dfs/sharetab’: No such file or directory
Jul 29 14:03:29 pve3 watchdog-mux[1364]: Watchdog driver 'Software Watchdog', version 0
Jul 29 14:03:29 pve3 zed[1360]: ZFS Event Daemon 0.6.5.7-pve10~bpo80 (PID 1360)
Jul 29 14:03:29 pve3 zed[1360]: Processing events since eid=0
Jul 29 14:03:29 pve3 smartd[1347]: smartd 6.4 2014-10-07 r4002 [x86_64-linux-4.4.13-2-pve] (local build)
Jul 29 14:03:29 pve3 smartd[1347]: Copyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org
Jul 29 14:03:29 pve3 smartd[1347]: =======> UNRECOGNIZED ARGUMENT: ”–interval=1800″ <=======
Jul 29 14:03:29 pve3 smartd[1347]: Use smartd -h to get a usage summary
Jul 29 14:03:29 pve3 dbus[1378]: [system] Successfully activated service 'org.freedesktop.systemd1'
Jul 29 14:03:29 pve3 systemd[1]: smartd.service: main process exited, code=exited, status=1/FAILURE
Jul 29 14:03:29 pve3 systemd[1]: Unit smartd.service entered failed state.
Jul 29 14:03:29 pve3 rrdcached[1437]: starting up
Jul 29 14:03:29 pve3 rrdcached[1437]: checking for journal files
Jul 29 14:03:29 pve3 rrdcached[1437]: started new journal /var/lib/rrdcached/journal/rrd.journal.1469783009.626161
Jul 29 14:03:29 pve3 rrdcached[1437]: journal processing complete
Jul 29 14:03:29 pve3 rrdcached[1437]: listening for connections
Jul 29 14:03:29 pve3 rrdcached[1373]: Starting RRDtool data caching daemon: rrdcached.
Jul 29 14:03:29 pve3 lxc-devsetup[1462]: Creating /dev/.lxc
Jul 29 14:03:29 pve3 lxc-devsetup[1462]: /dev is devtmpfs
Jul 29 14:03:29 pve3 lxc-devsetup[1462]: Creating /dev/.lxc/user
Jul 29 14:03:29 pve3 pmxcfs[1509]: [quorum] crit: quorum_initialize failed: 2
Jul 29 14:03:29 pve3 pmxcfs[1509]: [quorum] crit: can't initialize service
Jul 29 14:03:29 pve3 pmxcfs[1509]: [confdb] crit: cmap_initialize failed: 2
Jul 29 14:03:29 pve3 pmxcfs[1509]: [confdb] crit: can't initialize service
Jul 29 14:03:29 pve3 pmxcfs[1509]: [dcdb] crit: cpg_initialize failed: 2
Jul 29 14:03:29 pve3 pmxcfs[1509]: [dcdb] crit: can't initialize service
Jul 29 14:03:29 pve3 pmxcfs[1509]: [status] crit: cpg_initialize failed: 2
Jul 29 14:03:29 pve3 pmxcfs[1509]: [status] crit: can't initialize service
Jul 29 14:03:29 pve3 postfix[1375]: Starting Postfix Mail Transport Agent: postfix.
Jul 29 14:03:30 pve3 iscsid: iSCSI daemon with pid=1210 started!
Jul 29 14:03:30 pve3 corosync[1557]: [MAIN ] Corosync Cluster Engine ('2.4.0'): started and ready to provide service.
Jul 29 14:03:30 pve3 corosync[1557]: [MAIN ] Corosync built-in features: augeas systemd pie relro bindnow
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] Initializing transport (UDP/IP Multicast).
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] Initializing transmit/receive security (NSS) crypto: aes256 hash: sha1
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] The network interface [10.10.3.3] is now up.
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync configuration map access [0]
Jul 29 14:03:30 pve3 corosync[1558]: [QB ] server name: cmap
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync configuration service [1]
Jul 29 14:03:30 pve3 corosync[1558]: [QB ] server name: cfg
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync cluster closed process group service v1.01 [2]
Jul 29 14:03:30 pve3 corosync[1558]: [QB ] server name: cpg
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync profile loading service [4]
Jul 29 14:03:30 pve3 corosync[1558]: [QUORUM] Using quorum provider corosync_votequorum
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync vote quorum service v1.0 [5]
Jul 29 14:03:30 pve3 corosync[1558]: [QB ] server name: votequorum
Jul 29 14:03:30 pve3 corosync[1558]: [SERV ] Service engine loaded: corosync cluster quorum service v0.1 [3]
Jul 29 14:03:30 pve3 corosync[1558]: [QB ] server name: quorum
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] A new membership (10.10.3.3:604) was formed. Members joined: 3
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] JOIN or LEAVE message was thrown away during flush operation.
Jul 29 14:03:30 pve3 corosync[1558]: [QUORUM] Members[1]: 3
Jul 29 14:03:30 pve3 corosync[1558]: [MAIN ] Completed service synchronization, ready to provide service.
Jul 29 14:03:30 pve3 corosync[1558]: [TOTEM ] A new membership (10.10.3.2:608) was formed. Members joined: 2 1
Jul 29 14:03:30 pve3 corosync[1558]: [QUORUM] This node is within the primary component and will provide service.
Jul 29 14:03:30 pve3 corosync[1558]: [QUORUM] Members[3]: 2 3 1
Jul 29 14:03:30 pve3 corosync[1558]: [MAIN ] Completed service synchronization, ready to provide service.
Jul 29 14:03:31 pve3 pve-firewall[1562]: starting server
Jul 29 14:03:31 pve3 corosync[1549]: Starting Corosync Cluster Engine (corosync): [ OK ]
Jul 29 14:03:31 pve3 pve-ha-crm[1575]: starting server
 
I try this
Code:
systemctl stop pvestatd.service
systemctl stop pvedaemon.service
systemctl stop pve-cluster.service
apt install --reinstall libpve-common-perl
reboot
And it is solved.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!