Node3 will not cluster

[Ivan Gonzalez]

no matter what i do or how many times i try to add node3 will not make a connection then i remove it re-add all the same justs hangs and have to remove it, matter a fact i tried to add and remove so many times that i made a script that will add.sh and remove.sh for me

1. Yes package versions are matching
2. Yes, host file has all nodes ip's

any help will be great

Master Node:
proxmox-ve: 4.4-112 (running kernel: 4.4.83-1-pve) pve-manager: 4.4-24 (running version: 4.4-24/08ba4d2d) pve-kernel-4.4.35-2-pve: 4.4.35-79 pve-kernel-4.4.59-1-pve: 4.4.59-87 pve-kernel-4.4.134-1-pve: 4.4.134-112 pve-kernel-4.4.19-1-pve: 4.4.19-66 pve-kernel-4.4.83-1-pve: 4.4.83-96 pve-kernel-4.4.40-1-pve: 4.4.40-82 lvm2: 2.02.116-pve3 corosync-pve: 2.4.2-2~pve4+2 libqb0: 1.0.1-1 pve-cluster: 4.0-55 qemu-server: 4.0-115 pve-firmware: 1.1-12 libpve-common-perl: 4.0-96 libpve-access-control: 4.0-23 libpve-storage-perl: 4.0-76 pve-libspice-server1: 0.12.8-2 vncterm: 1.3-2 pve-docs: 4.4-4 pve-qemu-kvm: 2.9.1-9~pve4 pve-container: 1.0-106 pve-firewall: 2.0-33 pve-ha-manager: 1.0-41 ksm-control-daemon: 1.2-1 glusterfs-client: 3.5.2-2+deb8u5 lxc-pve: 2.0.7-4 lxcfs: 2.0.8-2~pve4 criu: 1.6.0-1 novnc-pve: 0.5-9 smartmontools: 6.5+svn4324-1~pve80 zfsutils: 0.6.5.9-pve15~bpo80


Node3:
proxmox-ve: 4.4-112 (running kernel: 4.4.134-1-pve) pve-manager: 4.4-24 (running version: 4.4-24/08ba4d2d) pve-kernel-4.4.35-1-pve: 4.4.35-77 pve-kernel-4.4.134-1-pve: 4.4.134-112 lvm2: 2.02.116-pve3 corosync-pve: 2.4.2-2~pve4+2 libqb0: 1.0.1-1 pve-cluster: 4.0-55 qemu-server: 4.0-115 pve-firmware: 1.1-12 libpve-common-perl: 4.0-96 libpve-access-control: 4.0-23 libpve-storage-perl: 4.0-76 pve-libspice-server1: 0.12.8-2 vncterm: 1.3-2 pve-docs: 4.4-4 pve-qemu-kvm: 2.9.1-9~pve4 pve-container: 1.0-106 pve-firewall: 2.0-33 pve-ha-manager: 1.0-41 ksm-control-daemon: 1.2-1 glusterfs-client: 3.5.2-2+deb8u5 lxc-pve: 2.0.7-4 lxcfs: 2.0.8-2~pve4 criu: 1.6.0-1 novnc-pve: 0.5-9 smartmontools: 6.5+svn4324-1~pve80 zfsutils: 0.6.5.9-pve15~bpo80

 

[oguz]

hi!

- can you type here the exact command you use? (mask the ip address)

- what kind of error do you get?

- can you show us your scripts?

 

[Ivan Gonzalez]

thank you for the reply (host3 is master node
New Node (emply no vms)
# pvecm add host2 -f

i remove it from host2
# pvecm delnode host3

when it fails. i run script on host3
root@host3:~# cat ./remove.sh
systemctl stop pve-cluster
systemctl stop corosync
pmxcfs -l
rm /etc/pve/corosync.conf
rm /etc/corosync/*
reboot

Error
root@host2:~# pvecm add host3 -f
copy corosync auth key
stopping pve-cluster service
backup old database
delete old backup '/var/lib/pve-cluster/backup/config-1558655264.sql.gz'
Job for corosync.service failed. See 'systemctl status corosync.service' and 'journalctl -xn' for details.
waiting for quorum.

hi!

- can you type here the exact command you use? (mask the ip address)

- what kind of error do you get?

- can you show us your scripts?

 

[Ivan Gonzalez]

any help will be great, thanks

 

[sb-jw]

root@host2:~# pvecm add host3 -f

Try it the other way. Log in to host3 and then try to join the existing cluster on any other node, that's the way it works.

https://pve.proxmox.com/wiki/Cluster_Manager#pvecm_join_node_to_cluster

 

[Ivan Gonzalez]

Try it the other way. Log in to host3 and then try to join the existing cluster on any other node, that's the way it works.

https://pve.proxmox.com/wiki/Cluster_Manager#pvecm_join_node_to_cluster

correct, new node with no VM thats the server you login and join with existing but thats what i been doing and getting that error.

 

[sb-jw]

From your postings you do it the wrong way. You are connected on host2 and try to add host3. But you have to connect to host3 and do 'pvecm add host2'. Please read the wiki link carefully.

 

[Ivan Gonzalez]

From your postings you do it the wrong way. You are connected on host2 and try to add host3. But you have to connect to host3 and do 'pvecm add host2'. Please read the wiki link carefully.

question, you asking me to go to "main node" and try to add host3 or go host3 and add?

correct i been adding nodes was to add from the new node

this cluster has 11 nodes, this is the first i ran into this error

 

[sb-jw]

But you have to connect to host3 and do 'pvecm add host2'.

Make sure your hosts file / DNS server is correct or use IP Adress instead of Hostname.

 

[Ivan Gonzalez]

Make sure your hosts file / DNS server is correct or use IP Adress instead of Hostname.

Hello, yes i have try that as well both host file and ip... the results are the same

 

[Daniel S.]

multicast issues? I would check networking

 

[Ivan Gonzalez]

multicast issues? I would check networking

shoot you maybe right, having it checked now