quorum disk for cluster

[lievenva]

Hi,

can someone provide some pointers on how to setup a quorum disk?
We have a san, two connected PVE 2.0 beta installs, but get

Starting cluster: 
   Checking if cluster has been disabled at boot... [  OK  ]
   Checking Network Manager... [  OK  ]
   Global setup... [  OK  ]
   Loading kernel modules... [  OK  ]
   Mounting configfs... [  OK  ]
   Starting cman... /usr/share/cluster/cluster.rng:992: element ref: Relax-NG parser error : Reference PVEVM has no matching definition
/usr/share/cluster/cluster.rng:992: element ref: Relax-NG parser error : Internal found no define for ref PVEVM
Relax-NG schema /usr/share/cluster/cluster.rng failed to compile
[  OK  ]
   Waiting for quorum... [  OK  ]
   Starting fenced... [  OK  ]
   Starting dlm_controld... [  OK  ]
   Unfencing self... [  OK  ]

after

root@yamu:~# pvecm create pvetestcluster

and

Starting cluster: 
   Checking if cluster has been disabled at boot... [  OK  ]
   Checking Network Manager... [  OK  ]
   Global setup... [  OK  ]
   Loading kernel modules... [  OK  ]
   Mounting configfs... [  OK  ]
   Starting cman... /usr/share/cluster/cluster.rng:992: element ref: Relax-NG parser error : Reference PVEVM has no matching definition
/usr/share/cluster/cluster.rng:992: element ref: Relax-NG parser error : Internal found no define for ref PVEVM
Relax-NG schema /usr/share/cluster/cluster.rng failed to compile
[  OK  ]
   Waiting for quorum... [  OK  ]
   Starting fenced... [  OK  ]
   Starting dlm_controld... [  OK  ]
   Unfencing self... [  OK  ]
cluster not ready - no quorum?

after

root@maraikoh:~# pvecm add yamu

We followed these:

http://pve.proxmox.com/wiki/Install_Proxmox_VE_on_Debian_Squeeze
http://pve.proxmox.com/wiki/Proxmox_VE_2.0_Cluster

Does /etc/pve need to be on a shared storage lun?

Best Regards,

Lieven

 

[tom]

...

Does /etc/pve need to be on a shared storage lun?

..

no. see http://pve.proxmox.com/wiki/Proxmox_Cluster_file_system_(pmxcfs)

your warnings are because you miss one package, install the missing one with:

aptitude install resource-agents-pve

and make sure that your switches supports multicast.

 

[lievenva]

Allright, thanks for the info.

Currently, logging in to a cluster node using the gui, one node is 'marked' green and the other red.
Selecting the green node allows us to manage the nodesetting.
Selecting the red node pops up the login dialog, and credentials are not accepted. A 'data load error'-dialog appears.

tcpdump on the mcastaddress of a node shows bidirectional traffic, so I guess multicasting is OK.

Thanks a lot for the assistance.

Best Regards,

Lieven

 

[tom]

a two node setup needs special settings to get quorum, also a qdisk. I recommend you use at least 3 nodes.

we will document the two node setup later.

 

[nasim]

Sir,
I have created a partition from SAN as Qdisk.the size is 100MB.
I got following error when reloading cman.
Starting cluster:
Checking if cluster has been disabled at boot... [ OK ]
Checking Network Manager... [ OK ]
Global setup... [ OK ]
Loading kernel modules... [ OK ]
Mounting configfs... [ OK ]
Starting cman... [ OK ]
Starting qdiskd...
[FAILED]

Here is the out put of #cat /etc/pve/cluster.conf

cat /etc/pve/cluster.conf
<?xml version="1.0"?>
<cluster name="master3" config_version="9">


<cman expected_votes="3" keyfile="/var/lib/pve-cluster/corosync.authkey" transport="udpu">
</cman>
<quorumd votes="1" allow_kill="0" interval="1" label="Proxmox_Qdisk" tko="10"/>
<totem token="54000"/>


<clusternodes>
<clusternode name="node3" votes="1" nodeid="1"/>
</clusternodes>


</cluster>

Here is the cluster status.
root@node3:~# clustat
Cluster Status for master3 @ Fri Nov 29 18:23:57 2013
Member Status: Inquorate


Member Name ID Status
------ ---- ---- ------
node3 1 Online, Local

root@node3:~# pvecm sVersion: 6.2.0
Config Version: 9
Cluster Name: master3
Cluster Id: 13531
Cluster Member: Yes
Cluster Generation: 164
Membership state: Cluster-Member
Nodes: 1
Expected votes: 3
Total votes: 1
Node votes: 1
Quorum: 2 Activity blocked
Active subsystems: 1
Flags:
Ports Bound: 0
Node name: node3
Node ID: 1
Multicast addresses: 255.255.255.255
Node addresses: 62.210.189.52




No nodes added to the cluster.


Please help to solve this cluster issue.

Regards,
Nasim