Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI KVM

S

sohaib

Well-Known Member
May 14, 2011
124
0
56
Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI KVM.

my Main server which is Raid 10 is a Supermicro w/ IPMI KVM OVER IP and another server is Dell PER410 with iDrac card v6.

How I can setup HA on Two servers with Fencing using those two cards ? Any advice.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

I am sure it will work with iDrac but my question was one server is supermicro with IPMI KVM over IP and one server is with iDrac - so will my configuration is going to be like this in my CLUSTER SERVER

<?xml version="1.0"?>
<cluster name="hpcluster765" config_version="28"> <cman keyfile="/var/lib/pve-cluster/corosync.authkey"> </cman> <fencedevices> <fencedevice agent="fence_drac5" ipaddr="X.X.X.X" login="root" name="node1-drac" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="ipmi1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>

<fencedevice agent="fence_drac5" ipaddr="X.X.X.X" login="root" name="node3-drac" passwd="XXXX" secure="1"/> </fencedevices> <clusternodes> <clusternode name="node1" nodeid="1" votes="1"> <fence> <method name="1"> <device name="node1-drac"/> </method> </fence> </clusternode> <clusternode name="node2" nodeid="2" votes="1"> <fence> <method name="1"> <device name="node2-drac"/> </method> </fence> </clusternode> <clusternode name="node3" nodeid="3" votes="1"> <fence> <method name="1"> <device name="node3-drac"/> </method> </fence> </clusternode> </clusternodes> <rm> <service autostart="1" exclusive="0" name="TestIP" recovery="relocate"> <ip address="192.168.7.180"/> </service> </rm></cluster>


​
Click to expand...
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Yes, you can mix both, just define each fencedevice type of each server

should works with something like that
Code: 
 [COLOR=#009900][COLOR=#000000][B]<fencedevices>[/B][/COLOR][/COLOR]    [COLOR=#009900][COLOR=#000000][B]<fencedevice[/B][/COLOR] [COLOR=#000066]agent[/COLOR]=[COLOR=#FF0000]"fence_drac5"[/COLOR] [/COLOR][COLOR=#000066]name[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"drac1"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]ipaddr[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"X.X.X.X"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]login[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"root"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]passwd[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"XXXX"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]secure[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"1"[/COLOR][B]/>[/B]
    [COLOR=#009900][COLOR=#000000][B]<fencedevice[/B][/COLOR] [COLOR=#000066]agent[/COLOR]=[COLOR=#FF0000]"fence_ipmilan"[/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"ipmi1"[/COLOR] [COLOR=#000066]lanplus[/COLOR]=[COLOR=#FF0000]"1"[/COLOR] [COLOR=#000066]ipaddr[/COLOR]=[COLOR=#FF0000]"X.X.X.X"[/COLOR] [COLOR=#000066]login[/COLOR]=[COLOR=#FF0000]"ipmiusername"[/COLOR] [COLOR=#000066]passwd[/COLOR]=[COLOR=#FF0000]"ipmipassword"[/COLOR] [COLOR=#000066]power_wait[/COLOR]=[COLOR=#FF0000]"5"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]     ....  [/COLOR][COLOR=#009900][COLOR=#000000][B]</fencedevices>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternodes>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternode[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"node1"[/COLOR] [COLOR=#000066]nodeid[/COLOR]=[COLOR=#FF0000]"1"[/COLOR] [COLOR=#000066]votes[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]<fence>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]<method[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]          [/COLOR][COLOR=#009900][COLOR=#000000][B]<device[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"drac1"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]</method>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]</fence>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]</clusternode>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternode[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"node2"[/COLOR] [COLOR=#000066]nodeid[/COLOR]=[COLOR=#FF0000]"2"[/COLOR] [COLOR=#000066]votes[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]<fence>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]<method[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]<device[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"ipmi1"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]</method>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]</fence>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]</clusternode> .....
[/B][/COLOR][/COLOR]
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Thanks - and I will have this XML copy in my cluster server right ? not on NODES.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

yes, just do it on 1 of your proxmox host:

http://pve.proxmox.com/wiki/Fencing

cp /etc/pve/cluster.conf /etc/pve/cluster.conf.new

edit the cluster.conf.new

then

Go to webinterface (Datacenter/HA), and commit changes

That's all !
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

My server name are as follows ?

NOD1 - This server has IPMI Card - Cluster Server - Cluster name is
NODCLUSTER
Click to expand...
NOD2 - (THIS SERVER HAS DRAC6 Enterprise Card )

Please let me know where I would add the NOD1 and NOD2 ?

Here's what I think my configuration should look like but need some expert advice.

<?xml version="1.0"?>
<cluster name="NODCLUSTER" config_version="28">
<cman keyfile="/var/lib/pve-cluster/corosync.authkey">
</cman>
<fencedevices>
<fencedevice agent="fence_drac6" ipaddr="X.X.X.X" login="root" name="NOD1" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="ipmi1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>


</fencedevices>
<clusternodes>
<clusternode name="node1" nodeid="1" votes="1">
<fence>
<method name="1">
<device name="node1-drac"/>
</method>
</fence>
</clusternode>
<clusternode name="node2" nodeid="2" votes="1">
<fence>
<method name="1">
<device name="node2-drac"/>
</method>
</fence>
</clusternode>
</clusternodes>
<rm>
<service autostart="1" exclusive="0" name="TestIP" recovery="relocate">
<ip address="192.168.7.180"/>
NOT SURE WHAT IP THAT IS
Click to expand...
</service>
</rm>
</cluster>
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

It's very simple, you just need to define fencingdevice name, then put them into the good clusternode
(note that you need 3 nodes minimum to have a working quorum)

<?xml version="1.0"?>
<cluster name="NODCLUSTER" config_version="28">
<cman keyfile="/var/lib/pve-cluster/corosync.authkey">
</cman>
<fencedevices>
<fencedevice agent="fence_drac6" ipaddr="X.X.X.X" login="root" name="DRAC1" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="IMPI1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>


</fencedevices>
<clusternodes>
<clusternode name="NOD1" nodeid="1" votes="1">
<fence>
<method name="1">
<device name="DRAC1"/>
</method>
</fence>
</clusternode>
<clusternode name="NOD2" nodeid="2" votes="1">
<fence>
<method name="1">
<device name="IPMI1"/>
</method>
</fence>
</clusternode>
</clusternodes>
<rm>
<service autostart="1" exclusive="0" name="TestIP" recovery="relocate">
<ip address="192.168.7.180"/>
---Quote---
NOT SURE WHAT IP THAT IS
---End Quote---
</service>
</rm>
</cluster>
***************
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

What is that IP 192.168.7.180?
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

I got this error when I try to start

Starting Cluster Service Manager: [FAILED]
TASK ERROR: command '/etc/init.d/rgmanager start' failed: exit code 1
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

sohaib said:
Starting Cluster Service Manager: [FAILED]
TASK ERROR: command '/etc/init.d/rgmanager start' failed: exit code 1
Click to expand...

You enabled fencing?

see http://pve.proxmox.com/wiki/Fencing (Enable Fencing on all nodes)
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

NOD2 is showing this

root@NOD2:~# fence_tool joinroot@NOD2:~# fence_tool ls
fence domain
member count 1
victim count 0
victim now 0
master nodeid 2
wait state none
members 2
Click to expand...

on my NOD1 - which is my cluster server

root@NOD1:~# fence_tool joinfence_tool: fenced not running, no lockfile
root@NOD1:~# fence_tool ls
Click to expand...
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

sohaib said:
on my NOD1 - which is my cluster server
Click to expand...

enable fencing on NOD1, the restart cman with '/etc/init.d/cman start'.

After that fenced should be running.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

OK - now on both nodes I can see

fence domain
member count 2
victim count 0
victim now 0
master nodeid 2
wait state none
members 1 2
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

After starting /etc/init.d/cman start - and adding VM to HA and starting resource manager - I cant access my proxmox NOD1 -
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Screen Shot 2012-04-02 at 8.16.52 AM.png

On my Terminal I can see this error.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

There seems to be something wrong with your hostname. The name in /etc/hostname must have an entry in /etc/hosts (to get the IP address).
 
You must log in or register to reply here.
Top Bottom