I have a single node cluster (pve 5.2) set up and systematically want to add nodes to it. The way I do this it to move virtual machines off the old OS the machine I want to ad as a node to Proxmox (with rbd as storage). Then I add that machine as a new node.
So I added the 2nd node now, at least tried to, and it hung on "waiting for quorum..." after doing "pvecm add 192.168.0.14". Now 192.168.0.14 (yster4) has the node config stored, but 192.168.0.13 (yster3) complains: Check if node may join a cluster failed! when I try to add the node again, which of course I can't do.
So how do I fix this? I can't remove the node and reinstall it, since corosync doesn't "see" the node yet.
On yster3 I have:
On yster3:
On yster4:
Yster3 doesn't have an authkey file.
Should I create a file and copy the key from yster4 into it?
I also noticed that I can't copy-ssh-id to yster3.
This might be the cause of the problem with authkey.pub?
How can I fix this?
This is a clean installation, why is this happening? Is there something that I didn't install?
I did an apt update and apt upgrade after installation.
So I added the 2nd node now, at least tried to, and it hung on "waiting for quorum..." after doing "pvecm add 192.168.0.14". Now 192.168.0.14 (yster4) has the node config stored, but 192.168.0.13 (yster3) complains: Check if node may join a cluster failed! when I try to add the node again, which of course I can't do.
So how do I fix this? I can't remove the node and reinstall it, since corosync doesn't "see" the node yet.
Code:
# pvecm nodes
Membership information
----------------------
Nodeid Votes Name
1 1 192.168.0.14 (local)
Code:
# cat /etc/pve/corosync.conf
logging {
debug: off
to_syslog: yes
}
nodelist {
node {
name: yster3
nodeid: 2
quorum_votes: 1
ring0_addr: 192.168.0.13
}
node {
name: yster4
nodeid: 1
quorum_votes: 1
ring0_addr: 192.168.0.14
}
}
quorum {
provider: corosync_votequorum
}
totem {
cluster_name: IMB-production
config_version: 2
interface {
bindnetaddr: 192.168.0.14
ringnumber: 0
}
ip_version: ipv4
secauth: on
version: 2
}On yster3 I have:
Code:
# cat /etc/pve/corosync.conf
logging {
debug: off
to_syslog: yes
}
nodelist {
node {
name: yster3
nodeid: 2
quorum_votes: 1
ring0_addr: 192.168.0.13
}
node {
name: yster4
nodeid: 1
quorum_votes: 1
ring0_addr: 192.168.0.14
}
}
quorum {
provider: corosync_votequorum
}
totem {
cluster_name: IMB-production
config_version: 2
interface {
bindnetaddr: 192.168.0.14
ringnumber: 0
}
ip_version: ipv4
secauth: on
version: 2
}
Code:
# pvecm nodes
Membership information
----------------------
Nodeid Votes Name
2 1 192.168.0.13 (local)On yster3:
Code:
# cat /etc/pve/.members
{
"nodename": "yster3",
"version": 3,
"cluster": { "name": "IMB-production", "version": 2, "nodes": 2, "quorate": 0 },
"nodelist": {
"yster3": { "id": 2, "online": 1, "ip": "192.168.0.13"},
"yster4": { "id": 1, "online": 0}
}
}On yster4:
Code:
# cat /etc/pve/.members
{
"nodename": "yster4",
"version": 4,
"cluster": { "name": "IMB-production", "version": 2, "nodes": 2, "quorate": 0 },
"nodelist": {
"yster3": { "id": 2, "online": 0},
"yster4": { "id": 1, "online": 1, "ip": "192.168.0.14"}
}
}Yster3 doesn't have an authkey file.
Code:
# cat /etc/pve/authkey.pub
cat: /etc/pve/authkey.pub: No such file or directoryShould I create a file and copy the key from yster4 into it?
I also noticed that I can't copy-ssh-id to yster3.
Code:
root@yster4:~# ssh-copy-id yster3
/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: "/root/.ssh/id_rsa.pub"
/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed
/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys
root@yster3's password:
cat: write error: Permission deniedThis might be the cause of the problem with authkey.pub?
How can I fix this?
This is a clean installation, why is this happening? Is there something that I didn't install?
I did an apt update and apt upgrade after installation.
Last edited: