cluster join failed

yaoshengyi

New Member
Apr 25, 2024
9
0
1
Today, I created a test cluster at home using new installed Proxmox VE version 8.2. For networking, I utilized an Intel 82599ES dual-port adapter and configured an OVS bond.
Two nodes are in the same /24 subnet

View attachment 67158

The error message "Establishing API connection with host 'xxx.xxx.xxx.xxx' TASK ERROR: 500 Can't connect to xxx.xxx.xxx.xxx:8006" recurs every time.
 
Your nodes need to be on sperate ip addresses and have different names

eg
node1 192.168.0.10
node2 192.168.0.20
node3 192.168.0.30
 
Your attachment does not appear to actually be attached. I can't see it.

Please be aware that if you use OVS, OVS Linux bonding and bridging or vlans MUST NOT be mixed, as per docs.
here is the interface



auto lo
iface lo inet loopback

iface eno3 inet manual

iface eno4 inet manual

auto eno1
iface eno1 inet manual

auto eno2
iface eno2 inet manual

auto bond0
iface bond0 inet manual
ovs_bonds eno1 eno2
ovs_type OVSBond
ovs_bridge vmbr1
ovs_mtu 9000
ovs_options lacp=active bond_mode=balance-tcp

auto vmbr1
iface vmbr1 inet static
address 10.80.28.20/32
gateway 10.80.28.254
ovs_type OVSBridge
ovs_ports bond0
ovs_mtu 9000

source /etc/network/interfaces.d/*
 
Then the second one should probably be
Code:
address 10.80.28.20/24
I don't think the above is the real cause. I successfully created a cluster with version 8.1 before. Today, I found there is a new version available. Following the previous configuration, I upgraded to version 8.2 and created an OVS LACP bond. However, after creating the new cluster, other nodes couldn't join the cluster.
 
I believe there are some encryption upgrades in this 8.2 version upgrade. When accessing nodes via SSH from another, it gets stuck at a certain stage. Below is the access log:

root@pve:/etc/corosync# ssh 10.80.28.14 -p 22 -v
OpenSSH_9.2p1 Debian-2+deb12u2, OpenSSL 3.0.11 19 Sep 2023
debug1: Reading configuration data /root/.ssh/config
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: include /etc/ssh/ssh_config.d/*.conf matched no files
debug1: /etc/ssh/ssh_config line 21: Applying options for *
debug1: Connecting to 10.80.28.14 [10.80.28.14] port 22.
debug1: Connection established.
debug1: identity file /root/.ssh/id_rsa type 0
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa_sk type -1
debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /root/.ssh/id_ed25519 type -1
debug1: identity file /root/.ssh/id_ed25519-cert type -1
debug1: identity file /root/.ssh/id_ed25519_sk type -1
debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /root/.ssh/id_xmss type -1
debug1: identity file /root/.ssh/id_xmss-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.2p1 Debian-2+deb12u2
debug1: Remote protocol version 2.0, remote software version OpenSSH_9.2p1 Debian-2+deb12u2
debug1: compat_banner: match: OpenSSH_9.2p1 Debian-2+deb12u2 pat OpenSSH* compat 0x04000000
debug1: Authenticating to 10.80.28.14:22 as 'root'
debug1: load_hostkeys: fopen /root/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: algorithm: sntrup761x25519-sha512@openssh.com
debug1: kex: host key algorithm: ssh-ed25519
debug1: kex: server->client cipher: aes128-ctr MAC: umac-64-etm@openssh.com compression: none
debug1: kex: client->server cipher: aes128-ctr MAC: umac-64-etm@openssh.com compression: none
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
 
ssh from macos:

osuser@macbook ~ % ssh root@10.80.28.24 -p 22 -v
OpenSSH_9.6p1, LibreSSL 3.3.6
debug1: Reading configuration data /Users/yaoshengyi/.ssh/config
debug1: Reading configuration data /Users/yaoshengyi/.orbstack/ssh/config
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 21: include /etc/ssh/ssh_config.d/* matched no files
debug1: /etc/ssh/ssh_config line 54: Applying options for *
debug1: Authenticator provider $SSH_SK_PROVIDER did not resolve; disabling
debug1: Connecting to 10.80.28.14 [10.80.28.14] port 22.
debug1: Connection established.
debug1: identity file /Users/yaoshengyi/.ssh/id_rsa type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_rsa-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ecdsa type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ecdsa-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ecdsa_sk type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ed25519 type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ed25519-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ed25519_sk type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_xmss type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_xmss-cert type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_dsa type -1
debug1: identity file /Users/yaoshengyi/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.6
debug1: Remote protocol version 2.0, remote software version OpenSSH_9.2p1 Debian-2+deb12u2
debug1: compat_banner: match: OpenSSH_9.2p1 Debian-2+deb12u2 pat OpenSSH* compat 0x04000000
debug1: Authenticating to 10.80.28.14:22 as 'root'
debug1: load_hostkeys: fopen /Users/yaoshengyi/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: algorithm: sntrup761x25519-sha512@openssh.com
debug1: kex: host key algorithm: ssh-ed25519
debug1: kex: server->client cipher: chacha20-poly1305@openssh.com MAC: <implicit> compression: none
debug1: kex: client->server cipher: chacha20-poly1305@openssh.com MAC: <implicit> compression: none
debug1: expecting SSH2_MSG_KEX_ECDH_REPLY
debug1: SSH2_MSG_KEX_ECDH_REPLY received
debug1: Server host key: ssh-ed25519 SHA256:o+b3scYWD90xpp5GWRNQDtY44JYvL7Z+xucXji08z7s
debug1: load_hostkeys: fopen /Users/yaoshengyi/.ssh/known_hosts2: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts: No such file or directory
debug1: load_hostkeys: fopen /etc/ssh/ssh_known_hosts2: No such file or directory
debug1: Host '10.80.28.14' is known and matches the ED25519 host key.
debug1: Found key in /Users/yaoshengyi/.ssh/known_hosts:61
debug1: ssh_packet_send2_wrapped: resetting send seqnr 3
debug1: rekey out after 134217728 blocks
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: ssh_packet_read_poll2: resetting read seqnr 3
debug1: SSH2_MSG_NEWKEYS received
debug1: rekey in after 134217728 blocks
debug1: SSH2_MSG_EXT_INFO received
debug1: kex_ext_info_client_parse: server-sig-algs=<ssh-ed25519,sk-ssh-ed25519@openssh.com,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ecdsa-sha2-nistp256@openssh.com,webauthn-sk-ecdsa-sha2-nistp256@openssh.com,ssh-dss,ssh-rsa,rsa-sha2-256,rsa-sha2-512>
debug1: kex_ext_info_check_ver: publickey-hostbound@openssh.com=<0>
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey,password
debug1: Next authentication method: publickey
debug1: get_agent_identities: bound agent to hostkey
debug1: get_agent_identities: ssh_fetch_identitylist: agent contains no identities
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_rsa
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_ecdsa
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_ecdsa_sk
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_ed25519
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_ed25519_sk
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_xmss
debug1: Will attempt key: /Users/yaoshengyi/.ssh/id_dsa
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_rsa
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_ecdsa
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_ecdsa_sk
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_ed25519
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_ed25519_sk
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_xmss
debug1: Trying private key: /Users/yaoshengyi/.ssh/id_dsa
debug1: Next authentication method: password
root@10.80.28.14's password:
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!