[SOLVED] Proxmox remove dead node from a cluster of 3 nodes

[juancarlo2596]

Hi, I'm new to proxmox cluster setup. I've setup a 3 nodes on a cluster with a dedicated network. Recently, one of our nodes crashed and unable to recover (basically it's dead). I want to remove the dead node from the cluster but I'm afraid that it might also broke my other 2 nodes. From the documentation, I can see that all nodes are present but from my current setup my dead node was not on the list (my proxmox01 dead node was not on the list). Also I've created the cluster using the proxmox01 node before it died.

Here's the result of my pvecm status:

root@proxmox02:~# pvecm status
Cluster information
-------------------
Name: proxmoxCluster
Config Version: 3
Transport: knet
Secure auth: on

Quorum information
------------------
Date: Wed Dec 6 14:59:09 2023
Quorum provider: corosync_votequorum
Nodes: 2
Node ID: 0x00000003
Ring ID: 2.c4
Quorate: Yes

Votequorum information
----------------------
Expected votes: 3
Highest expected: 3
Total votes: 2
Quorum: 2
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000002 1 172.254.254.3
0x00000003 1 172.254.254.2 (local)

And for pvecm nodes:

root@proxmox02:~# pvecm nodes

Membership information
----------------------
Nodeid Votes Name
2 1 proxmox03
3 1 proxmox02 (local)
root@proxmox02:~#

my pveversion -v

root@proxmox02:~# pveversion -v
proxmox-ve: 8.1.0 (running kernel: 6.2.16-19-pve)
pve-manager: 8.1.3 (running version: 8.1.3/b46aac3b42da5d15)
proxmox-kernel-helper: 8.1.0
pve-kernel-6.2: 8.0.5
proxmox-kernel-6.5: 6.5.11-5
proxmox-kernel-6.5.11-5-pve-signed: 6.5.11-5
proxmox-kernel-6.5.11-4-pve-signed: 6.5.11-4
proxmox-kernel-6.2.16-19-pve: 6.2.16-19
proxmox-kernel-6.2: 6.2.16-19
pve-kernel-6.2.16-3-pve: 6.2.16-3
ceph-fuse: 17.2.7-pve1
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx7
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.0
libproxmox-backup-qemu0: 1.4.0
libproxmox-rs-perl: 0.3.1
libpve-access-control: 8.0.7
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.1.0
libpve-guest-common-perl: 5.0.6
libpve-http-server-perl: 5.0.5
libpve-network-perl: 0.9.4
libpve-rs-perl: 0.8.7
libpve-storage-perl: 8.0.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve3
novnc-pve: 1.4.0-3
proxmox-backup-client: 3.0.4-1
proxmox-backup-file-restore: 3.0.4-1
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.2.2
proxmox-mini-journalreader: 1.4.0
proxmox-widget-toolkit: 4.1.3
pve-cluster: 8.0.5
pve-container: 5.0.8
pve-docs: 8.1.3
pve-edk2-firmware: 4.2023.08-2
pve-firewall: 5.0.3
pve-firmware: 3.9-1
pve-ha-manager: 4.0.3
pve-i18n: 3.1.2
pve-qemu-kvm: 8.1.2-4
pve-xtermjs: 5.3.0-2
qemu-server: 8.0.10
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.0-pve3

Am I still able to remove my proxmox01 node from my cluster? Will it not break my other nodes?

 

[UdoB]

Does this help? --> https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_remove_a_cluster_node

You may add a "Quorum Device" afterwards...

Best regards

 

[juancarlo2596]

Does this help? --> https://pve.proxmox.com/pve-docs/pve-admin-guide.html#_remove_a_cluster_node

You may add a "Quorum Device" afterwards...

Best regards

It works, thank you. I'm quite afraid at first to try it, thinking that it might broke the other nodes from the cluster.