what happened ?? [few PVEw are "greyed out"]

[csi-laser]

Hi Guys,
We having 4 PVEs cluster.

Suddenly, 2 hosts are greyed-out
They accessible via ping/SSH

PVE number 4, which is red, because I played little bit with the LVM, and ruined something. [but it's also acceesible via SSH]
Can it be related somehow to the other 2 hosts that falled down ?
And how can I see logs about why it happened ?

[We are cheking now Proxmox on our lab in order to see if it can fit to our production env. , so it's important to us to know why it happened]


Thanks !
Laser

 

[csi-laser]

BTW -
Strange, but, when I'm accessing via PROXMOX-NODE-02 GUI's, I see this result :

 

[Chris]

Hi,
please check the output of `pvecm status` as well as `systemctl status corosync` and `journalctl -u corosync`. Also check your cluster network with omping, see https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_cluster_network

Also, you can see the logs since reboot in reverse with `journalctl -rb`

 

[csi-laser]

thanks
mmm,strange

I see the same error on all of the nodes :

 

[TechLineX]

Often

#service pve-cluster restart

on all nodes in the cluster helped me with this problem.

 

[Chris]

These errors are related to your disks, you should definitely backup your data and perform some smart tests to check the disks health (although you said this is a test system, so maybe data loss is of no concern here). This could be related to your cluster issues, but not necessarily... You did not post any of the outputs related to corosync.

because I played little bit with the LVM, and ruined something.

What exactly did you ruined on node 4?

 

[csi-laser]

Hi There,
the "systemctl status corosync" showing "Active (running)" state on all node

Regarding Node 4 - I just tried to mount some external disk. It didn't worked, but the node is available and running. I can connect it via SSH and via proxmox web portal....

 

[csi-laser]

Often

#service pve-cluster restart

on all nodes in the cluster helped me with this problem.

Thanks, it helped me too
Now I can see the whole 4 nodes active even from GUI