Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI KVM

S

sohaib

Well-Known Member
May 14, 2011
124
0
56
Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI KVM.

my Main server which is Raid 10 is a Supermicro w/ IPMI KVM OVER IP and another server is Dell PER410 with iDrac card v6.

How I can setup HA on Two servers with Fencing using those two cards ? Any advice.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

I am sure it will work with iDrac but my question was one server is supermicro with IPMI KVM over IP and one server is with iDrac - so will my configuration is going to be like this in my CLUSTER SERVER

<?xml version="1.0"?>
<cluster name="hpcluster765" config_version="28"> <cman keyfile="/var/lib/pve-cluster/corosync.authkey"> </cman> <fencedevices> <fencedevice agent="fence_drac5" ipaddr="X.X.X.X" login="root" name="node1-drac" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="ipmi1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>

<fencedevice agent="fence_drac5" ipaddr="X.X.X.X" login="root" name="node3-drac" passwd="XXXX" secure="1"/> </fencedevices> <clusternodes> <clusternode name="node1" nodeid="1" votes="1"> <fence> <method name="1"> <device name="node1-drac"/> </method> </fence> </clusternode> <clusternode name="node2" nodeid="2" votes="1"> <fence> <method name="1"> <device name="node2-drac"/> </method> </fence> </clusternode> <clusternode name="node3" nodeid="3" votes="1"> <fence> <method name="1"> <device name="node3-drac"/> </method> </fence> </clusternode> </clusternodes> <rm> <service autostart="1" exclusive="0" name="TestIP" recovery="relocate"> <ip address="192.168.7.180"/> </service> </rm></cluster>


​
Click to expand...
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Yes, you can mix both, just define each fencedevice type of each server

should works with something like that
Code: 
 [COLOR=#009900][COLOR=#000000][B]<fencedevices>[/B][/COLOR][/COLOR]    [COLOR=#009900][COLOR=#000000][B]<fencedevice[/B][/COLOR] [COLOR=#000066]agent[/COLOR]=[COLOR=#FF0000]"fence_drac5"[/COLOR] [/COLOR][COLOR=#000066]name[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"drac1"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]ipaddr[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"X.X.X.X"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]login[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"root"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]passwd[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"XXXX"[/COLOR][COLOR=#009900] [/COLOR][COLOR=#000066]secure[/COLOR][COLOR=#009900]=[/COLOR][COLOR=#FF0000]"1"[/COLOR][B]/>[/B]
    [COLOR=#009900][COLOR=#000000][B]<fencedevice[/B][/COLOR] [COLOR=#000066]agent[/COLOR]=[COLOR=#FF0000]"fence_ipmilan"[/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"ipmi1"[/COLOR] [COLOR=#000066]lanplus[/COLOR]=[COLOR=#FF0000]"1"[/COLOR] [COLOR=#000066]ipaddr[/COLOR]=[COLOR=#FF0000]"X.X.X.X"[/COLOR] [COLOR=#000066]login[/COLOR]=[COLOR=#FF0000]"ipmiusername"[/COLOR] [COLOR=#000066]passwd[/COLOR]=[COLOR=#FF0000]"ipmipassword"[/COLOR] [COLOR=#000066]power_wait[/COLOR]=[COLOR=#FF0000]"5"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]     ....  [/COLOR][COLOR=#009900][COLOR=#000000][B]</fencedevices>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternodes>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternode[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"node1"[/COLOR] [COLOR=#000066]nodeid[/COLOR]=[COLOR=#FF0000]"1"[/COLOR] [COLOR=#000066]votes[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]<fence>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]<method[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]          [/COLOR][COLOR=#009900][COLOR=#000000][B]<device[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"drac1"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]</method>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]</fence>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]</clusternode>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]<clusternode[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"node2"[/COLOR] [COLOR=#000066]nodeid[/COLOR]=[COLOR=#FF0000]"2"[/COLOR] [COLOR=#000066]votes[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]<fence>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]<method[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"1"[/COLOR][COLOR=#000000][B]>[/B][/COLOR][/COLOR][COLOR=#000000]        [/COLOR][COLOR=#009900][COLOR=#000000][B]<device[/B][/COLOR] [COLOR=#000066]name[/COLOR]=[COLOR=#FF0000]"ipmi1"[/COLOR][COLOR=#000000][B]/>[/B][/COLOR][/COLOR][COLOR=#000000]      [/COLOR][COLOR=#009900][COLOR=#000000][B]</method>[/B][/COLOR][/COLOR][COLOR=#000000]    [/COLOR][COLOR=#009900][COLOR=#000000][B]</fence>[/B][/COLOR][/COLOR][COLOR=#000000]  [/COLOR][COLOR=#009900][COLOR=#000000][B]</clusternode> .....
[/B][/COLOR][/COLOR]
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Thanks - and I will have this XML copy in my cluster server right ? not on NODES.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

yes, just do it on 1 of your proxmox host:

http://pve.proxmox.com/wiki/Fencing

cp /etc/pve/cluster.conf /etc/pve/cluster.conf.new

edit the cluster.conf.new

then

Go to webinterface (Datacenter/HA), and commit changes

That's all !
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

My server name are as follows ?

NOD1 - This server has IPMI Card - Cluster Server - Cluster name is
NODCLUSTER
Click to expand...
NOD2 - (THIS SERVER HAS DRAC6 Enterprise Card )

Please let me know where I would add the NOD1 and NOD2 ?

Here's what I think my configuration should look like but need some expert advice.

<?xml version="1.0"?>
<cluster name="NODCLUSTER" config_version="28">
<cman keyfile="/var/lib/pve-cluster/corosync.authkey">
</cman>
<fencedevices>
<fencedevice agent="fence_drac6" ipaddr="X.X.X.X" login="root" name="NOD1" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="ipmi1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>


</fencedevices>
<clusternodes>
<clusternode name="node1" nodeid="1" votes="1">
<fence>
<method name="1">
<device name="node1-drac"/>
</method>
</fence>
</clusternode>
<clusternode name="node2" nodeid="2" votes="1">
<fence>
<method name="1">
<device name="node2-drac"/>
</method>
</fence>
</clusternode>
</clusternodes>
<rm>
<service autostart="1" exclusive="0" name="TestIP" recovery="relocate">
<ip address="192.168.7.180"/>
NOT SURE WHAT IP THAT IS
Click to expand...
</service>
</rm>
</cluster>
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

It's very simple, you just need to define fencingdevice name, then put them into the good clusternode
(note that you need 3 nodes minimum to have a working quorum)

<?xml version="1.0"?>
<cluster name="NODCLUSTER" config_version="28">
<cman keyfile="/var/lib/pve-cluster/corosync.authkey">
</cman>
<fencedevices>
<fencedevice agent="fence_drac6" ipaddr="X.X.X.X" login="root" name="DRAC1" passwd="XXXX" secure="1"/>
<fencedevice agent="fence_ipmilan" name="IMPI1" lanplus="1" ipaddr="X.X.X.X" login="ipmiusername" passwd="ipmipassword" power_wait="5"/>


</fencedevices>
<clusternodes>
<clusternode name="NOD1" nodeid="1" votes="1">
<fence>
<method name="1">
<device name="DRAC1"/>
</method>
</fence>
</clusternode>
<clusternode name="NOD2" nodeid="2" votes="1">
<fence>
<method name="1">
<device name="IPMI1"/>
</method>
</fence>
</clusternode>
</clusternodes>
<rm>
<service autostart="1" exclusive="0" name="TestIP" recovery="relocate">
<ip address="192.168.7.180"/>
---Quote---
NOT SURE WHAT IP THAT IS
---End Quote---
</service>
</rm>
</cluster>
***************
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

What is that IP 192.168.7.180?
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

I got this error when I try to start

Starting Cluster Service Manager: [FAILED]
TASK ERROR: command '/etc/init.d/rgmanager start' failed: exit code 1
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

sohaib said:
Starting Cluster Service Manager: [FAILED]
TASK ERROR: command '/etc/init.d/rgmanager start' failed: exit code 1
Click to expand...

You enabled fencing?

see http://pve.proxmox.com/wiki/Fencing (Enable Fencing on all nodes)
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

NOD2 is showing this

root@NOD2:~# fence_tool joinroot@NOD2:~# fence_tool ls
fence domain
member count 1
victim count 0
victim now 0
master nodeid 2
wait state none
members 2
Click to expand...

on my NOD1 - which is my cluster server

root@NOD1:~# fence_tool joinfence_tool: fenced not running, no lockfile
root@NOD1:~# fence_tool ls
Click to expand...
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

sohaib said:
on my NOD1 - which is my cluster server
Click to expand...

enable fencing on NOD1, the restart cman with '/etc/init.d/cman start'.

After that fenced should be running.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

OK - now on both nodes I can see

fence domain
member count 2
victim count 0
victim now 0
master nodeid 2
wait state none
members 1 2
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

After starting /etc/init.d/cman start - and adding VM to HA and starting resource manager - I cant access my proxmox NOD1 -
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

Screen Shot 2012-04-02 at 8.16.52 AM.png

On my Terminal I can see this error.
 
Re: Proxmox Fencing on Two Server one Dell with iDrac & one Raid 10 Cluster with IPMI

There seems to be something wrong with your hostname. The name in /etc/hostname must have an entry in /etc/hosts (to get the IP address).
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back