Trouble Joining Nodes to cluster

[RockisLife]

Hello,
So ive run into a bit of an issue. I am going to join nodes to a cluster but for some reason 2 nodes didnt join. They just show up with red x's in the summary and I cant sign into their web interfaces after refreshing the page.

For the 2 nodes Im seeing errors for the pve-cluster.service as follows
[dcdb] crit: cpg_initialize failed: 2
[status] crit: cpg_initialize failed: 2

pvescheduler.service
jobs: cfslock 'file-jobs_cfg' error: no quorum!
replication:cfslock 'file-replication_cfg' error: no quorum!

pveproxy.service
/etc/pve/local/pve-ssl.em: failed to load the private key at /usr/share/per15/PVE/APIServer/AnyEvent.pm line 1904

pve-ha-lrm.service
unable to write lrm status file - unable to open file '/etc/pve/node6/lrm_status.tmp.1110' - No such file or directory

pvedaemon.service
authentication failure: rhost=::fffff:10.160.190.1 user=root@pam msg= Authentication Failure


These errors are showing up on both the hosts. What do I need todo to fix this issue
From what I gather they didnt successfully join the quorum.

Another issue is for some reason I cant sign into the web side of things with the cluster in this state
This is a fresh install

 

[datschlatscher]

From what I understand it seems some files in the cluster were not created correctly. Did you have existing guest VMs or containers on the nodes you added to the cluster? Also, please check whether your nodes have enough storage (even if unlikely with a new installation): https://forum.proxmox.com/threads/quorum-crit-quorum_initialize-failed-2.59202/

Furthermore, please attach the output of pvecm status and journalctl -u corosync below.

Note: Not being able to sign into the GUI on a non-quorate nodes in a cluster is actually expected behaviour, as the nodes are read-only in this state and cant aquire a lock (write operation) necessary for authentication. You should still be able to access your nodes e.g. using SSH though.

 

[RockisLife]

Its a brand new cluster deployment so there are no guest VM or containers on any nodes. The storage looks fine. Attached are the 2 outputs