[SOLVED] Cluster networking / Hosts communicate over WAN interfaces instead of over cluster network

Mar 27, 2017
23
3
6
Hi,

I have created a Proxmox cluster via Web GUI and that was probably my fault as in the Cluster Join Information I do see my WAN IP instead of the one dedicated for cluster LAN.

My Link 0 IP addresses were set correct, but my /etc/pve/.members is faulty see:

Code:
{
"nodename": "hetzner-srv2",
"version": 10,
"cluster": { "name": "hetzner1", "version": 2, "nodes": 2, "quorate": 1 },
"nodelist": {
  "hetzner-srv1": { "id": 1, "online": 1, "ip": "213.239.xxx.xxx"},
  "hetzner-srv2": { "id": 2, "online": 1, "ip": "2a01:4f8:xxx:xxxx::2"}
  }
}

No way to fix that directly, right? So I have to follow this article, shutdown srv2, remove clusternode hetzner-srv2 from hetzner-srv1, reinstall hetzner-srv2 and then? What should I do with hetzner-srv1 after pvecm delnode hetzner-srv2?
 
Hi,

I have created a Proxmox cluster via Web GUI and that was probably my fault as in the Cluster Join Information I do see my WAN IP instead of the one dedicated for cluster LAN.

My Link 0 IP addresses were set correct, but my /etc/pve/.members is faulty see:

Code:
{
"nodename": "hetzner-srv2",
"version": 10,
"cluster": { "name": "hetzner1", "version": 2, "nodes": 2, "quorate": 1 },
"nodelist": {
  "hetzner-srv1": { "id": 1, "online": 1, "ip": "213.239.xxx.xxx"},
  "hetzner-srv2": { "id": 2, "online": 1, "ip": "2a01:4f8:xxx:xxxx::2"}
  }
}

No way to fix that directly, right? So I have to follow this article, shutdown srv2, remove clusternode hetzner-srv2 from hetzner-srv1, reinstall hetzner-srv2 and then? What should I do with hetzner-srv1 after pvecm delnode hetzner-srv2?

I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?
 
  • Like
Reactions: jsabater
I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?

You can select the cluster network via a drop-down list. The GUI wizard also allows the configuration of a second network link for corosync.
 
I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?
In /etc/hosts I do have the WAN address from the time before creating the cluster network. I understand I should change the IPs to the cluster network, right? Would it affect the IP address listed in /etc/pve/.members?
 
Last edited:
You can select the cluster network via a drop-down list. The GUI wizard also allows the configuration of a second network link for corosync.
Yes, I chose the cluster network, Link 0 has IPs assigned from that L3 network, but communication between the hosts goes over the WAN interfaces as present in Cluster Join Information.
 
I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?
Adam, I have followed Your hint, edited /etc/hosts on both hosts with cluster network IPs, did systemctl restart pve-cluster && systemctl restart corosync and the RCOTI has been resolved. /etc/pve/.members contains expected values and networking between the hosts seems to be OK.

Many thanks for Your help!
 
In my case in /etc/hosts record
192.X.X.X pve-1 (wrong ip)
i replace it on both nodes to right ip and all work noraml.