broken cluster

leanderkretschmer

New Member
Mar 26, 2025
3
0
1
i had a cluster with 4 nodes and a qdevice so 5 votes. I wanted to remove 1 node and the qdevice because I experienced split brain. after trying to remove one node it sees only itself in a cluster but the real cluster has it still listed as offline so I can't use pvecm delnode to remove it because it can't connect. what do I do
 

Attachments

  • Bildschirmfoto 2025-10-02 um 12.07.12.png
    Bildschirmfoto 2025-10-02 um 12.07.12.png
    27 KB · Views: 1
  • Bildschirmfoto 2025-10-02 um 12.07.29.png
    Bildschirmfoto 2025-10-02 um 12.07.29.png
    29.9 KB · Views: 1
On the cluster edit /etc/pve/corosync.conf and remove the entries for the disconnected node in the nodelist section. In totem section you'll need to increase the config_version by one, too. Also delete the folder /etc/pve/nodes/<name of removed node>. It contains the configurations of vm and lxc which were running on that node, so eventually making a backup first, might be a good idea.
At the end that should remove the node from the cluster.

More explanations and how to handle the single node can be found here: https://pve.proxmox.com/wiki/Cluster_Manager#_remove_a_cluster_node
 
  • Like
Reactions: Johannes S