So all points back to cluster.conf, which I cant edit. Is there any way how I can edit the file in another way?
Yes, you can edit /etc/cluster/cluster.conf directly, then start cman, set expected votes, ...
Or simply start pve-cluster file system in local mode:
# pmxcfs -l
After that you can edit all files in /etc/pve/. But please make sure no other nodes are online during that time,
and restart pmxcfs (or the node) in normal mode after you are done.