Can't add some cluster nodes after upgrade to 4.x

[charon]

Hi,
i tried to upgrade a cluster today but some hosts can't be added again to the new cluster.

i upgraded all hosts from datacenter1 and the first node became the master of the new cluster.
the first node of second datacenter could also be added to the cluster, but all other nodes failed:

root@hostname:~# pvecm add 10.10.10.101 --force
unable to create directory '/etc/pve/nodes/hostname/lxc' - Device or resource busy
unable to add node: command failed (ssh 10.10.10.101 -o BatchMode=yes pvecm addnode hostname --force 1)

i just followed the upgrade guide from:

https://pve.proxmox.com/wiki/Upgrade_from_3.x_to_4.0

any ideas?

 

[charon]

I had to restart the master node.

syslog:

pve-ha-lrm[4538]: unable to write lrm status file - unable to open file '/etc/pve/nodes/hostnamemasternode/lrm_status.tmp.4538' - Device or resource busy

 

[dietmar]

Seems you do not have quorum?

 

[charon]

Hi dietmar,

as i mentioned I already solved it and added the the corresponding syslog.
but why did it happen? i had quorum because at least 11 nodes were already in the new cluster.
the only thing i had to do is reboot the first node and it started working again.

edit: I could not see a problem with "pvecm status" only in syslog and while trying to add new nodes.
but its working now, so maybe we just leave it here if someone else runs into this.