dead node could not be remove

[k-123]

a new node just gone dead because of HDD corruption. (could not load pve OS after reboot)
I can NOT find the node in terminal, (have NOT issue "pvecm delnode" command yet).

but web admin console the dead node is still there. (pve-03 is dead)

is there anything I can do? thanks.

root@pve-01:~# pvecm status
Quorum information
------------------
Date: Thu Nov 9 10:43:54 2017
Quorum provider: corosync_votequorum
Nodes: 2
Node ID: 0x00000001
Ring ID: 1/8252
Quorate: Yes

Votequorum information
----------------------
Expected votes: 3
Highest expected: 3
Total votes: 2
Quorum: 2
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000001 1 172.16.2.1 (local)
0x00000002 1 172.16.2.2
root@pve-01:~# pvecm nodes

Membership information
----------------------
Nodeid Votes Name
1 1 pve-01 (local)
2 1 pve-02


pve version : 5.1-36 (just update at nov 8 , community subs)

 

[k-123]

I've delete /etc/pve/nodes/pve-03 & restart pve-cluster/pvedaemon, still no luck. the dead node is still in the web console.
and Votequorum vote still seeking the dead node 'pve-03'.

root@pve-04:/etc/pve/nodes# pvecm nodes

Membership information
----------------------
Nodeid Votes Name
1 1 pve-01
2 1 pve-02
4 1 pve-04 (local)
root@pve-04:/etc/pve/nodes# pvecm status
Quorum information
------------------
Date: Tue Nov 14 10:39:41 2017
Quorum provider: corosync_votequorum
Nodes: 3
Node ID: 0x00000004
Ring ID: 1/8284
Quorate: Yes

Votequorum information
----------------------
Expected votes: 4
Highest expected: 4
Total votes: 3
Quorum: 3
Flags: Quorate

Membership information
----------------------
Nodeid Votes Name
0x00000001 1 172.16.2.1
0x00000002 1 172.16.2.2
0x00000004 1 172.16.2.4 (local)