SOLVED: adding a 3rd node

eliotte

New Member
Jun 17, 2014
10
0
1
Hi,

I already have 2 nodes on a cluster working perfectly since January. Today, I had trouble adding my 3rd node. I got timeout at quorum phase: Waiting for quorum... Timed-out waiting for cluster

I really don't understand why. Here config from one working node:

Code:
[COLOR=#00F900][FONT=Andale Mono]vmbr0     Link encap:Ethernet  HWaddr 00:25:90:eb:c0:8d  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet addr:192.168.1.3  Bcast:192.99.149.255  Mask:255.255.255.0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::225:90ff:feeb:c08d/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:243586130 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:218378383 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:55932725347 (52.0 GiB)  TX bytes:53816476283 (50.1 GiB)[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]
[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]vmbr1     Link encap:Ethernet  HWaddr da:7a:0d:9c:0b:0a  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::d87a:dff:fe9c:b0a/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:519 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:9 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:36699 (35.8 KiB)  TX bytes:750 (750.0 B)[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]
[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]vmbr2     Link encap:Ethernet  HWaddr 00:25:90:eb:c0:8c  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet addr:xxxx  Bcast:xxxx  Mask:255.255.255.0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::225:90ff:feeb:c08c/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:180896341 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:42617077 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:10171297605 (9.4 GiB)  TX bytes:158288771972 (147.4 GiB)[/FONT][/COLOR]

here, from the node I try to add:

Code:
[COLOR=#00F900][FONT=Andale Mono]vmbr0     Link encap:Ethernet  HWaddr 0c:c4:7a:0c:8c:63  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet addr:192.168.1.4  Bcast:192.168.1.255  Mask:255.255.255.0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::ec4:7aff:fe0c:8c63/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:4467 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:223593 (218.3 KiB)  TX bytes:648 (648.0 B)[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]
[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]vmbr1     Link encap:Ethernet  HWaddr 0e:2d:60:21:ec:73  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::c2d:60ff:fe21:ec73/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:0 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:8 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:0 (0.0 B)  TX bytes:648 (648.0 B)[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]
[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]vmbr2     Link encap:Ethernet  HWaddr 0c:c4:7a:0c:8c:62  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet addr:xxxx  Bcast:xxxxx  Mask:255.255.255.0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          inet6 addr: fe80::ec4:7aff:fe0c:8c62/64 Scope:Link[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX packets:6612 errors:0 dropped:0 overruns:0 frame:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          TX packets:6173 errors:0 dropped:0 overruns:0 carrier:0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          collisions:0 txqueuelen:0 [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]          RX bytes:679112 (663.1 KiB)  TX bytes:748242 (730.7 KiB)[/FONT][/COLOR]




when I call "pvecm status" on my new node, I don't understand why I got my public ip (on vmbr2) on the attribute called node adresse:

Code:
[COLOR=#00F900][FONT=Andale Mono]root@node4:/# pvecm status[/FONT][/COLOR][COLOR=#00F900][FONT=Andale Mono]Version: 6.2.0[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Config Version: 5[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Cluster Name: cubicule[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Cluster Id: 26553[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Cluster Member: Yes[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Cluster Generation: 16[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Membership state: Cluster-Member[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Nodes: 1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Expected votes: 3[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Total votes: 1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Node votes: 1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Quorum: 2 Activity blocked[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Active subsystems: 1[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Flags: [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Ports Bound: 0  [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Node name: node4[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Node ID: 3[/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Multicast addresses: 239.192.XXX.XXX [/FONT][/COLOR]
[COLOR=#00F900][FONT=Andale Mono]Node addresses: PUBLIC_IP
[/FONT][/COLOR]

My cluster (2 nodes) is running 3.2 and new node 3.3

Do you have any idea?
 
Last edited:
Re: adding a 3rd node

I juste saw my weird Bcast address. let me see. I let you know!
 
Re: adding a 3rd node

So,

This morning I found my error. In /etc/hosts, I had my public IP and not local IP related to my hostname. I changed it, reboot and voilà! :

192.168.1.4 node.something node
 
Last edited: