Join node to the cluster failed.

[Marian.Veverka]

Hello,
I have one node, where I create cluster and want add new node to this cluster, but adding failed.

root@node2:~# pvecm add 192.168.83.101
Please enter superuser (root) password for '192.168.83.101': ********
detected the following error(s):
* local node address: cannot use IP '0.0.0.192', not found on local node!

Check if node may join a cluster failed!

Can somebody help me?

 

[aaron]

Can you show the content of /etc/hosts of the new node and the existing one?

 

[Marian.Veverka]

Node with cluster:

root@node1:~# cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
192.168.83.101 node1.....local node1

# The following lines are desirable for IPv6 capable hosts

::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts

Node which cannot be added:

root@192:~# cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
192.168.83.10 node2.....local node2

# The following lines are desirable for IPv6 capable hosts

::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
ff02::3 ip6-allhosts

 

[aaron]

Hmm, looks all okay. Can you please give the following output from both nodes?
ip a

and on the node on which you already have the cluster set up
cat /etc/pve/corosync.conf

 

[Marian.Veverka]

Node with cluster:

root@node1:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 00:13:3b:10:1b:f8 brd ff:ff:ff:ff:ff:ff
3: enp6s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
link/ether 00:13:3b:10:18:e6 brd ff:ff:ff:ff:ff:ff
4: eno1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
5: eno2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
6: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
7: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe69:2f28/64 scope link
valid_lft forever preferred_lft forever
8: vmbr0.83@vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr83 state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
9: vmbr83: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
inet 192.168.83.101/24 brd 192.168.83.255 scope global vmbr83
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:fe69:2f28/64 scope link
valid_lft forever preferred_lft forever
10: vmbr0.102@vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr102 state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
11: vmbr102: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:69:2f:28 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fe69:2f28/64 scope link
valid_lft forever preferred_lft forever
21: tap102i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr102 state UNKNOWN group default qlen 1000
link/ether 62:83:92:9a:39:28 brd ff:ff:ff:ff:ff:ff
560: tap128i0: <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master fwbr128i0 state UNKNOWN group default qlen 1000
link/ether 3e:c6:8e:b8:57:bc brd ff:ff:ff:ff:ff:ff
561: fwbr128i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 22:c1:3b:06:ec:30 brd ff:ff:ff:ff:ff:ff
562: fwpr128p0@fwln128i0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr102 state UP group default qlen 1000
link/ether 42:5f:0c:5f:91:1e brd ff:ff:ff:ff:ff:ff
........


root@node1:~# cat /etc/pve/corosync.conf
logging {
debug: off
to_syslog: yes
}

nodelist {
node {
name: node1
nodeid: 1
quorum_votes: 1
ring0_addr: 192.168.83.101
ring1_addr: 192.168.83.101
}
}

quorum {
provider: corosync_votequorum
}

totem {
cluster_name: D6-cluster1
config_version: 1
interface {
linknumber: 0
}
interface {
linknumber: 1
}
ip_version: ipv4-6
link_mode: passive
secauth: on
version: 2
}

Node which cannot be added:

root@192:~# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
3: eno2: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
4: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr0 state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
5: vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fea9:9542/64 scope link
valid_lft forever preferred_lft forever
6: vmbr0.83@vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr83 state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
7: vmbr83: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
inet 192.168.83.10/24 brd 192.168.83.255 scope global vmbr83
valid_lft forever preferred_lft forever
inet6 fe80::ec4:7aff:fea9:9542/64 scope link
valid_lft forever preferred_lft forever
8: vmbr0.102@vmbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master vmbr102 state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
9: vmbr102: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 0c:c4:7a:a9:95:42 brd ff:ff:ff:ff:ff:ff
inet6 fe80::ec4:7aff:fea9:9542/64 scope link
valid_lft forever preferred_lft forever

 

[aaron]

ring0_addr: 192.168.83.101
ring1_addr: 192.168.83.101

You have the same IP configured for two different links.

I am not sure if that is the cause, but it is definitely not right. Try to change your config to either only one link or use the IP configured on a second NIC for the second ring.

 

[Marian.Veverka]

I have bonded interface:
auto bond0
iface bond0 inet manual
bond-slaves eno1 eno2

My colleague tell me, that is not possible to join together cluster with different version proxmoxs, so I reinstall/downgrade node2 to version 6.1-7 and tried to connect to cluster created from proxmox 6.1-3 and from GUI it was not possible too, but from terminal command
pvecm add IP_FIST_NODE --link1 IP_SECOND_NODE
was succesfull.