[SOLVED] Issue removing Node from cluster?

[killmasta93]

Hi,
I was wondering if someone could lend me hand. Im trying to remove the node from cluster which i did then i try to delete /etc/pve/nodes/nodename but im getting permission denied not sure why

now im getting activity blocked
not sure if im screwed i completely lost contact from the 2nd node so i have no way to get up the quorum, is there a way i can separate this node without losing any vms? This node is the principal

root@prometheus:~# pvecm status
Quorum information
------------------
Date:             Wed Dec  5 18:53:23 2018
Quorum provider:  corosync_votequorum
Nodes:            1
Node ID:          0x00000001
Ring ID:          1/52
Quorate:          No

Votequorum information
----------------------
Expected votes:   2
Highest expected: 2
Total votes:      1
Quorum:           2 Activity blocked
Flags:

Membership information
----------------------
    Nodeid      Votes Name
0x00000001          1 192.168.3.252 (local)

 

[dcsapak]

1/2 nodes is not the majority -> no quorum. you need to set the expected votes to 1 to remove the other
do 'pvecm expected 1' and the follow https://pve.proxmox.com/wiki/Cluster_Manager#_remove_a_cluster_node

 

[killmasta93]

Thank you so that did the trick on restarting the vm and backing them up, when i was testing to remove a node i did the following.

added to /etc/hosts the IP of each proxmox by name

then on the master node i ran

pvecm delnode prometheus2

then after that i was trying to delete

/etc/pve/nodes/<nodename>

i was getting permission issue as it still apears on the WebGui

Then thanks to @dcsapak
ran this

pvecm expected 1

but still appears the node 2 so i ran this

service pvestatd restart

after that the node 2 disappeared

im able to start the VM

the only thing on the summary part i see this

Cluster: myclustername, Quorate: No

guess i cant remove that either

on a side note. so lets say i have 2 nodes in a cluster. and hypothetically both nodes shuts down but one of the nodes dont turn on but the other one does. The node that turns on wont turn on the Vms because it waiting for the quorum to start but it will never start because the another node died. So in that case one has to result to the above?

 

[dcsapak]

on a side note. so lets say i have 2 nodes in a cluster. and hypothetically both nodes shuts down but one of the nodes dont turn on but the other one does. The node that turns on wont turn on the Vms because it waiting for the quorum to start but it will never start because the another node died. So in that case one has to result to the above?

again, if you have 2 nodes and only 1 is up, you cannot do anything before executing 'pvecm expected 1' BUT use it with care, if both nodes are online but cannot see each other, it can result in a split
brain scenario