[SOLVED] Quorum value different on cluster nodes?

[jlp]

I have a cluster that nominally has four nodes in it. One of these nodes is down for maintenance, leaving three nodes operational at this time.

On node A, the expected votes value is 2, but the quorum value is 3. On nodes B and C, the expected votes values are 2 and the quorum values are also 2. Why is there a discrepancy here? How is the quorum value computed?

Here is the pvecm status reports from the three nodes:

node A:

Version: 6.2.0
Config Version: 25
Cluster Name: LOGIC1
Cluster Id: 4739
Cluster Member: Yes
Cluster Generation: 524
Membership state: Cluster-Member
Nodes: 3
Expected votes: 2
Total votes: 3
Node votes: 1
Quorum: 3  
Active subsystems: 6
Flags: 
Ports Bound: 0 177  
Node name: hdlvm2
Node ID: 1
Multicast addresses: 239.192.18.149 
Node addresses: 10.50.18.41

node B:

Version: 6.2.0
Config Version: 25
Cluster Name: LOGIC1
Cluster Id: 4739
Cluster Member: Yes
Cluster Generation: 524
Membership state: Cluster-Member
Nodes: 3
Expected votes: 2
Total votes: 3
Node votes: 1
Quorum: 2  
Active subsystems: 6
Flags: 
Ports Bound: 0 177  
Node name: hdlvm3
Node ID: 2
Multicast addresses: 239.192.18.149 
Node addresses: 10.50.18.42

node C:

Version: 6.2.0
Config Version: 25
Cluster Name: LOGIC1
Cluster Id: 4739
Cluster Member: Yes
Cluster Generation: 524
Membership state: Cluster-Member
Nodes: 3
Expected votes: 2
Total votes: 3
Node votes: 1
Quorum: 2  
Active subsystems: 6
Flags: 
Ports Bound: 0 177  
Node name: hdlvm4
Node ID: 3
Multicast addresses: 239.192.18.149 
Node addresses: 10.50.18.43

 

[dietmar]

what is the output of

# pvecm nodes

 

[jlp]

pvecm nodes (same on all three systems):

Node  Sts   Inc   Joined               Name
   1   M    516   2013-03-17 21:29:23  hdlvm2
   2   M    508   2013-03-17 21:28:43  hdlvm3
   3   M    524   2013-03-18 10:16:15  hdlvm4
   4   X      0                        hdlvm5

 

[dietmar]

Did you manually set expected votes?

 

[jlp]

It is set in the cluster.conf cman key. Here's the cluster.conf file:

<?xml version="1.0"?>
<cluster config_version="25" name="LOGIC1">
  <cman expected_votes="2" keyfile="/var/lib/pve-cluster/corosync.authkey"/>
  <fencedevices>
    <fencedevice agent="fence_ipmilan" ipaddr="10.50.18.80" lanplus="1"
     login="ADMIN" name="hdlvm1-ilo" passwd="*****" power_wait="5"/>
    <fencedevice agent="fence_ipmilan" ipaddr="10.50.18.81" lanplus="1"
     login="ADMIN" name="hdlvm2-ilo" passwd="*****" power_wait="5"/>
    <fencedevice agent="fence_ipmilan" ipaddr="10.50.18.82" lanplus="1"
     login="ADMIN" name="hdlvm3-ilo" passwd="*****" power_wait="5"/>
    <fencedevice agent="fence_ipmilan" ipaddr="10.50.18.83" lanplus="1"
     login="ADMIN" name="hdlvm4-ilo" passwd="*****" power_wait="5"/>
    <fencedevice agent="fence_ipmilan" ipaddr="10.50.18.84" lanplus="1"
     login="ADMIN" name="hdlvm5-ilo" passwd="*****" power_wait="5"/>
  </fencedevices>
  <clusternodes>
    <clusternode name="hdlvm2" nodeid="1" votes="1">
      <fence>
        <method name="1">
          <device name="hdlvm2-ilo"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="hdlvm3" nodeid="2" votes="1">
      <fence>
        <method name="1">
          <device name="hdlvm3-ilo"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="hdlvm4" votes="1" nodeid="3">
      <fence>
        <method name="1">
          <device name="hdlvm4-ilo"/>
        </method>
      </fence>
    </clusternode>
    <clusternode name="hdlvm5" votes="1" nodeid="4">
      <fence>
        <method name="1">
          <device name="hdlvm5-ilo"/>
        </method>
      </fence>
    </clusternode>
  </clusternodes>
  <rm log_level="7">
    <pvevm autostart="1" vmid="100"/>
    <pvevm autostart="1" vmid="101"/>
    <pvevm autostart="1" vmid="103"/>
    <pvevm autostart="1" vmid="104"/>
    <pvevm autostart="1" vmid="105"/>
    <pvevm autostart="1" vmid="107"/>
    <pvevm autostart="1" vmid="109"/>
  </rm>
</cluster>

 

[dietmar]

Please remove that setting.

 

[jlp]

That seems to have done the trick, Dietmar! Thanks. All nodes are now showing expected votes 2 and quorum 2. I'll mark this thread as solved.