No Quorum after Update

groemer05

New Member
Mar 23, 2015
4
0
1
Hello,

After updating my 2 proxmox node, i restarted the first one. Now i wanted to move the vms to the first node and restart the second one.

Unfortunately the quorum ist lost and i cannot move any vms.

I tried to restart the services pvedaemon, pvestatd, pveproxy, pve-cluster

Is it ok, if i just set expected votes to 1 and then migrate the vms? Will that work?

Here are some outputs from the 2 nodes, that might help:

Node1
Code:
[COLOR=#3C3E43][FONT=segoe ui]root@groemer01 ~ $ [B]pvecm node[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node Sts Inc Joined Name[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]1 M 1464 2015-03-23 08:12:29 groemer01[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]2 X 1468 groemer02[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]root@groemer01 ~ $ [B]pvecm status[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Version: 6.2.0[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Config Version: 22[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Name: tsccluster[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Id: 49332[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Member: Yes[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Generation: 1472[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Membership state: Cluster-Member[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Nodes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Expected votes: 2[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Total votes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node votes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Quorum: 2 Activity blocked[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Active subsystems: 6[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Flags:[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Ports Bound: 0 177[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node name: groemer01[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node ID: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Multicast addresses: x.x.x.x[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node addresses: x.x.x.x[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]root@groemer01 ~ $ [B]cat /etc/pve/cluster.conf[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<?xml version="1.0"?>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cluster config_version="22" name="tsccluster">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cman keyfile="/var/lib/pve-cluster/corosync.authkey"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="x.x.x.x" lanplus="1" login="ADMIN" name="ipmi1" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="x.x.x.x" lanplus="1" login="ADMIN" name="ipmi2" passwd="xxx" p ower_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer01" nodeid="1" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi1"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer02" nodeid="2" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi2"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<pvevm autostart="1" vmid="106"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</cluster>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]root@groemer01 ~ $ [B]cat /etc/cluster/cluster.conf[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<?xml version="1.0"?>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cluster config_version="22" name="tsccluster">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cman keyfile="/var/lib/pve-cluster/corosync.authkey"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="x.x.x.x" lanplus="1" login="ADMIN" name="ipmi1" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]" lanplus="1" login="ADMIN" name="ipmi2" passwd="xxx" p ower_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer01" nodeid="1" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi1"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer02" nodeid="2" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi2"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<pvevm autostart="1" vmid="106"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</cluster>[/FONT][/COLOR]

Node2
Code:
[COLOR=#3C3E43][FONT=segoe ui]root@groemer02:~# [B]pvecm status[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Version: 6.2.0[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Config Version: 22[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Name: tsccluster[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Id: 49332[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Member: Yes[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Cluster Generation: 1472[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Membership state: Cluster-Member[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Nodes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Expected votes: 2[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Total votes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node votes: 1[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Quorum: 2 Activity blocked[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Active subsystems: 6[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Flags:[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Ports Bound: 0[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node name: groemer02[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node ID: 2[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Multicast addresses: [/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]Node addresses: [/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]root@groemer02:~# [B]cat /etc/pve/cluster.conf[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<?xml version="1.0"?>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cluster config_version="22" name="tsccluster">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cman keyfile="/var/lib/pve-cluster/corosync.authkey"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]" lanplus="1" login="ADMIN" name="ipmi1" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]" lanplus="1" login="ADMIN" name="ipmi2" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer01" nodeid="1" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi1"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer02" nodeid="2" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi2"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<pvevm autostart="1" vmid="106"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</cluster>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]root@groemer02:~# [B]cat /etc/cluster/cluster.conf[/B][/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<?xml version="1.0"?>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cluster config_version="22" name="tsccluster">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<cman keyfile="/var/lib/pve-cluster/corosync.authkey"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="x.x.x.x" lanplus="1" login="ADMIN" name="ipmi1" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fencedevice agent="fence_ipmilan" ipaddr="[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]x.x.x.x[/FONT][/COLOR][COLOR=#3C3E43][FONT=segoe ui]" lanplus="1" login="ADMIN" name="ipmi2" passwd="xxx" power_wait="5"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fencedevices>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer01" nodeid="1" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi1"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<clusternode name="groemer02" nodeid="2" votes="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<method name="1">[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<device name="ipmi2"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</method>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</fence>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternode>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</clusternodes>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]<pvevm autostart="1" vmid="106"/>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</rm>[/FONT][/COLOR]
[COLOR=#3C3E43][FONT=segoe ui]</cluster>[/FONT][/COLOR]

omping works as well.
 
Last edited:
Please never post your fencing config like this. You use fencing via ipmi with public ip adresses. Everybody could reset your servers at any moment. Change your passwords immediately!
 
Thank you. I will read the links.

But can that be the reason, if it was working before the update?

What services are important to get quorum? Can i check any logs?

best regards Thomas
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!