Lost 2 nodes on a 2/3 quorum - can I recover full access to the remaining node?

[airhache]

Hi,

I'm in a very embarrassing situation, where I had the following setup :
- 1 main Node 1
- 1 secondary Node 2
- 1 Qdevice 3

The main and the QDevice went offline (Qdevice is even destroyed), and configuration of node 1 is broken, and won't let me do anything.

I have access to Node 2, but I can't do much since it's seems locked because of corosync.
- I can't SSH to Node 2, since 2FA is enabled and my pubkey is rejected. I tried to remove /etc/pve/priv/tfa.cfg, but it is locked, probably because of the missing Quorum ("Activity Blocked")

- When I run pvecm status, it indicates :

• Expected votes : 2
• Highest expected : 2
• Total Votes : 1
• Quorum : 2 Activity blocked
• Flags : Qdevice
• Membership information
  • 1 vote : node 2
  • 0 vote : Qdevice

- I tried to run

1. pvecm expected 1
2. pvecm delnode Qdevice

but it fails, probably because Activity is blocked


Is there a way to get back access to my node 2?
Thank you.

 

[SteveITS]

Here they mention editing the config file if corosync can't start. You could try giving your node more votes?