[SOLVED] Cluster networking / Hosts communicate over WAN interfaces instead of over cluster network

[Kubicz]

Hi,

I have created a Proxmox cluster via Web GUI and that was probably my fault as in the Cluster Join Information I do see my WAN IP instead of the one dedicated for cluster LAN.

My Link 0 IP addresses were set correct, but my /etc/pve/.members is faulty see:

{
"nodename": "hetzner-srv2",
"version": 10,
"cluster": { "name": "hetzner1", "version": 2, "nodes": 2, "quorate": 1 },
"nodelist": {
  "hetzner-srv1": { "id": 1, "online": 1, "ip": "213.239.xxx.xxx"},
  "hetzner-srv2": { "id": 2, "online": 1, "ip": "2a01:4f8:xxx:xxxx::2"}
  }
}

No way to fix that directly, right? So I have to follow this article, shutdown srv2, remove clusternode hetzner-srv2 from hetzner-srv1, reinstall hetzner-srv2 and then? What should I do with hetzner-srv1 after pvecm delnode hetzner-srv2?

 

[adamb]

Hi,

I have created a Proxmox cluster via Web GUI and that was probably my fault as in the Cluster Join Information I do see my WAN IP instead of the one dedicated for cluster LAN.

My Link 0 IP addresses were set correct, but my /etc/pve/.members is faulty see:

{
"nodename": "hetzner-srv2",
"version": 10,
"cluster": { "name": "hetzner1", "version": 2, "nodes": 2, "quorate": 1 },
"nodelist": {
  "hetzner-srv1": { "id": 1, "online": 1, "ip": "213.239.xxx.xxx"},
  "hetzner-srv2": { "id": 2, "online": 1, "ip": "2a01:4f8:xxx:xxxx::2"}
  }
}

No way to fix that directly, right? So I have to follow this article, shutdown srv2, remove clusternode hetzner-srv2 from hetzner-srv1, reinstall hetzner-srv2 and then? What should I do with hetzner-srv1 after pvecm delnode hetzner-srv2?

I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?

 

[tom]

I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?

You can select the cluster network via a drop-down list. The GUI wizard also allows the configuration of a second network link for corosync.

 

[Kubicz]

I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?

In /etc/hosts I do have the WAN address from the time before creating the cluster network. I understand I should change the IPs to the cluster network, right? Would it affect the IP address listed in /etc/pve/.members?

 

[Kubicz]

You can select the cluster network via a drop-down list. The GUI wizard also allows the configuration of a second network link for corosync.

Yes, I chose the cluster network, Link 0 has IPs assigned from that L3 network, but communication between the hosts goes over the WAN interfaces as present in Cluster Join Information.

 

[Kubicz]

I thought pve got the IP from /etc/hosts. What do you have set for your hosts file?

Adam, I have followed Your hint, edited /etc/hosts on both hosts with cluster network IPs, did systemctl restart pve-cluster && systemctl restart corosync and the RCOTI has been resolved. /etc/pve/.members contains expected values and networking between the hosts seems to be OK.

Many thanks for Your help!

 

[admin2triline]

In my case in /etc/hosts record
192.X.X.X pve-1 (wrong ip)
i replace it on both nodes to right ip and all work noraml.