Correcting link0 ips

[jackiedon]

We have a problem with link0 addresses across the cluster - some nodes joined the cluster with correct IPs from the LAN, but some have used the Public IP as link0.

And every time we add a new node to the cluster, the cluster fails, we have to correct IPs manually in the Corosync.conf file.

But the link0 address stays the same in Web UI, we have no way of correcting that.

Can anyone advise whether this can be done on a running cluster?

 

[mira]

Please post the output of cat /etc/pve/corosync.conf as well as pvecm status and pvecm nodes.

 

[jackiedon]

logging {
debug: off
to_syslog: yes
}

nodelist {
node {
name: iofXXXXXX
nodeid: 2
quorum_votes: 1
ring0_addr: 10.5.5.102
}
node {
name: iofXXXXXX
nodeid: 1
quorum_votes: 1
ring0_addr: 10.5.5.101
}
node {
name: iofXXXXXX
nodeid: 5
quorum_votes: 1
ring0_addr: 107.xxx.xx.xxx
}
node {
name: iofXXXXXX
nodeid: 6
quorum_votes: 1
ring0_addr: 10.5.5.106
}
node {
name: iofXXXXXX
nodeid: 7
quorum_votes: 1
ring0_addr: 107.xxx.xx.xxx
}
node {
name: iofXXXXXX
nodeid: 4
quorum_votes: 1
ring0_addr: 104.xxx.xx.xxx
}
node {
name: iofXXXXXX
nodeid: 3
quorum_votes: 1
ring0_addr: 107.xxx.xx.xxx
}
}

quorum {
provider: corosync_votequorum
}

totem {
cluster_name: westusazc1
config_version: 17
interface {
linknumber: 0
}
ip_version: ipv4-6
link_mode: passive
secauth: on
version: 2
}

 

[jackiedon]

pvecm status
Cluster information
-------------------
Name: westusazc1
Config Version: 17
Transport: knet
Secure auth: on

Quorum information
------------------
Date: Wed Sep 9 11:56:14 2020
Quorum provider: corosync_votequorum
Nodes: 6
Node ID: 0x00000002
Ring ID: 1.369e
Quorate: Yes

Votequorum information
----------------------
Expected votes: 7
Highest expected: 7
Total votes: 6
Quorum: 4
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000001 1 10.5.5.101
0x00000002 1 10.5.5.102 (local)
0x00000003 1 10.5.5.103
0x00000004 1 10.5.5.104
0x00000005 1 10.5.5.105
0x00000006 1 10.5.5.106

 

[jackiedon]

pvecm nodes

Membership information
----------------------
Nodeid Votes Name
1 1 ioXXX0
2 1 ioXXX13 (local)
3 1 ioXXX9b
4 1 ioXXX2b
5 1 ioXXX47
6 1 ioXXX50

 

[jackiedon]

we have tried changing values in Corosync.conf, but they get Re-written every time. I think there is some internal Proxmox database that keeps the values in it.

 

[mira]

You have to bump the config_version at the same time you modify anything else in the file. So change all the IPs that need to be changed and bump the config_version and then save the file.
Also make sure you're editing /etc/pve/corosync.conf and not /etc/corosync/corosync.conf as the /etc/corosync file is overwritten with the /etc/pve one once the cluster is running.

 

[jackiedon]

Amazing, it's now corrected! Thank you so much!