Hi,
I am battling with adding a new node to the existing cluster.
A cluster was set up initially with 3 nodes.
Some vm were added as well.
Cluster was working fine. I have added node 4 wich still was ok.
Now I am trying to add node 5, and this is where the trouble begins.
So basically I am having a new node that has the same exactly hardware as the other nodes. Installing proxmox.
Then login via web gui. all seems to be ok. SSH to the new node, run updates etc.
then via web gui configuring network cards the same way as on the other nodes (just giving new IP for the new node)...
Once this is done and node rebooted, I am trying to add new node to the cluster via web gui. Once click add, the process is starting and ending with connection error.
Usually refreshing the page gets me back to the login page, where you can log in and see the whole cluster. this time after adding node to the cluster the gui no longer can be accessed by web.
On other node, via web gui I can see 5 nodes however the "old" nodes are having green thick while the new node nr 5 has red cross.
When running the pvecm status command on an "old" node I am getting this:
Quorum information
------------------
Date: Wed Oct 30 12:47:18 2019
Quorum provider: corosync_votequorum
Nodes: 4
Node ID: 0x00000001
Ring ID: 1/219176
Quorate: Yes
Votequorum information
----------------------
Expected votes: 5
Highest expected: 5
Total votes: 4
Quorum: 3
Flags: Quorate
Membership information
----------------------
Nodeid Votes Name
0x00000001 1 192.0.0.71 (local)
0x00000002 1 192.0.0.72
0x00000003 1 192.0.0.73
0x00000004 1 192.0.0.74
So looks like the node 5 is missing from the list.
running command ls -l /etc/pve/nodes/ on a "old node I am getting this:
total 0
drwxr-xr-x 2 root www-data 0 Sep 20 15:32 pve-01
drwxr-xr-x 2 root www-data 0 Sep 23 13:31 pve-02
drwxr-xr-x 2 root www-data 0 Sep 23 13:33 pve-03
drwxr-xr-x 2 root www-data 0 Oct 23 12:30 pve-04
drwxr-xr-x 2 root www-data 0 Oct 30 11:41 pve-05
So there's a new node on the list...
another command pvesh get cluster/config/nodes (executed on the "old" node) is showing this:
┌────────┐
│ node │
├────────┤
│ pve-01 │
├────────┤
│ pve-02 │
├────────┤
│ pve-03 │
├────────┤
│ pve-04 │
├────────┤
│ pve-05 │
and again looks like the node 5 is there...
however running command: pvecm nodes yelds this:
Membership information
----------------------
Nodeid Votes Name
1 1 pve-01 (local)
2 1 pve-02
3 1 pve-03
4 1 pve-04
running the same command on the new node I am getting this:
Membership information
----------------------
Nodeid Votes Name
5 1 pve-05 (local)
running command pvecm status on a new node I am getting this:
Quorum information
------------------
Date: Wed Oct 30 12:58:01 2019
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000005
Ring ID: 5/16
Quorate: No
Votequorum information
----------------------
Expected votes: 5
Highest expected: 5
Total votes: 1
Quorum: 3 Activity blocked
Flags:
Membership information
----------------------
Nodeid Votes Name
0x00000005 1 192.0.0.75 (local)
running command ls -l /etc/pve/nodes/ ona new node shows:
ls: cannot access '/etc/pve/nodes/': No such file or directory
I have already remove node 5 from a cluster and then reinstall from scratch proxmox on a new node. and try again to add the node to the cluster and always with the same result.
Not sure if there is something I am doing wrong or in wrong order or there is something else that prevents me from adding a new node to the cluster.
I will appreciate any input and help on this problem as I will need add 2 more nodes...
I am battling with adding a new node to the existing cluster.
A cluster was set up initially with 3 nodes.
Some vm were added as well.
Cluster was working fine. I have added node 4 wich still was ok.
Now I am trying to add node 5, and this is where the trouble begins.
So basically I am having a new node that has the same exactly hardware as the other nodes. Installing proxmox.
Then login via web gui. all seems to be ok. SSH to the new node, run updates etc.
then via web gui configuring network cards the same way as on the other nodes (just giving new IP for the new node)...
Once this is done and node rebooted, I am trying to add new node to the cluster via web gui. Once click add, the process is starting and ending with connection error.
Usually refreshing the page gets me back to the login page, where you can log in and see the whole cluster. this time after adding node to the cluster the gui no longer can be accessed by web.
On other node, via web gui I can see 5 nodes however the "old" nodes are having green thick while the new node nr 5 has red cross.
When running the pvecm status command on an "old" node I am getting this:
Quorum information
------------------
Date: Wed Oct 30 12:47:18 2019
Quorum provider: corosync_votequorum
Nodes: 4
Node ID: 0x00000001
Ring ID: 1/219176
Quorate: Yes
Votequorum information
----------------------
Expected votes: 5
Highest expected: 5
Total votes: 4
Quorum: 3
Flags: Quorate
Membership information
----------------------
Nodeid Votes Name
0x00000001 1 192.0.0.71 (local)
0x00000002 1 192.0.0.72
0x00000003 1 192.0.0.73
0x00000004 1 192.0.0.74
So looks like the node 5 is missing from the list.
running command ls -l /etc/pve/nodes/ on a "old node I am getting this:
total 0
drwxr-xr-x 2 root www-data 0 Sep 20 15:32 pve-01
drwxr-xr-x 2 root www-data 0 Sep 23 13:31 pve-02
drwxr-xr-x 2 root www-data 0 Sep 23 13:33 pve-03
drwxr-xr-x 2 root www-data 0 Oct 23 12:30 pve-04
drwxr-xr-x 2 root www-data 0 Oct 30 11:41 pve-05
So there's a new node on the list...
another command pvesh get cluster/config/nodes (executed on the "old" node) is showing this:
┌────────┐
│ node │
├────────┤
│ pve-01 │
├────────┤
│ pve-02 │
├────────┤
│ pve-03 │
├────────┤
│ pve-04 │
├────────┤
│ pve-05 │
and again looks like the node 5 is there...
however running command: pvecm nodes yelds this:
Membership information
----------------------
Nodeid Votes Name
1 1 pve-01 (local)
2 1 pve-02
3 1 pve-03
4 1 pve-04
running the same command on the new node I am getting this:
Membership information
----------------------
Nodeid Votes Name
5 1 pve-05 (local)
running command pvecm status on a new node I am getting this:
Quorum information
------------------
Date: Wed Oct 30 12:58:01 2019
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000005
Ring ID: 5/16
Quorate: No
Votequorum information
----------------------
Expected votes: 5
Highest expected: 5
Total votes: 1
Quorum: 3 Activity blocked
Flags:
Membership information
----------------------
Nodeid Votes Name
0x00000005 1 192.0.0.75 (local)
running command ls -l /etc/pve/nodes/ ona new node shows:
ls: cannot access '/etc/pve/nodes/': No such file or directory
I have already remove node 5 from a cluster and then reinstall from scratch proxmox on a new node. and try again to add the node to the cluster and always with the same result.
Not sure if there is something I am doing wrong or in wrong order or there is something else that prevents me from adding a new node to the cluster.
I will appreciate any input and help on this problem as I will need add 2 more nodes...
