Nodes going red at night.

[GreyWolf]

I have a three-node cluster with all latest updates. At night, all three nodes go red. Rebooting all the nodes turns them green. All of the vm's are still running just fine with the red nodes.

Just for giggles, I left only one node up last night. In the morning it had gone red. Never had this happen with the 1.9 version. All three nodes were clean installs except for the vm's, which were backed up and then restored. What happens only at night?

Any suggestions on troubleshooting are welcome.

 

[dietmar]

I have a three-node cluster with all latest updates. At night, all three nodes go red.

What is the output of

# pvecm status

and

# cat /etc/pve/.members

when the node goes red?

 

[GreyWolf]

Here is the info you requested, dietmar.

root@Proxmox1:~# pvecm status
Version: 6.2.0
Config Version: 5
Cluster Name: GWD
Cluster Id: 526
Cluster Member: Yes
Cluster Generation: 1056
Membership state: Cluster-Member
Nodes: 3
Expected votes: 3
Total votes: 3
Node votes: 1
Quorum: 2
Active subsystems: 5
Flags:
Ports Bound: 0
Node name: Proxmox1
Node ID: 1
Multicast addresses: 239.192.2.16
Node addresses: 192.168.0.11
root@Proxmox1:~# cat /etc/pve/.members
{
"nodename": "Proxmox1",
"version": 8,
"cluster": { "name": "GWD", "version": 5, "nodes": 3, "quorate": 1 },
"nodelist": {
"Proxmox1": { "id": 1, "online": 1, "ip": "192.168.0.11"},
"Proxmox3": { "id": 3, "online": 1, "ip": "192.168.0.13"},
"Proxmox2": { "id": 2, "online": 1, "ip": "192.168.0.12"}
}
}
root@Proxmox1:~#

 

[dietmar]

And all nodes are marked red?