Can not create /etc/pve/nodes

[raptortrex]

I try to install a new cluster with Proxmox 4.4.12.
I add the ips to /etc/hosts and did "pvecm create [clustername]"
When i try to add a node to the cluster with pvecm add [IP Mainnode] i get the message "can not create /etc/pve/nodes acces denied "
When i try to create the directroy with mkdir or with ftp it is not possible to create the directory because the write permission.

How can i solve this? An what is the

 

[dcsapak]

what is the output of

ls -lh /etc/pve

do you try those commands as root?

 

[raptortrex]

output is

ls -lh /etc/pve
total 512
-r--r----- 1 root www-data 454 Feb 23 10:01 corosync.conf
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 local -> nodes/server2
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 lxc -> nodes/server2/lxc
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 openvz -> nodes/server2/openvz
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 qemu-server -> nodes/server2/qemu-server

 

[dcsapak]

what does

pvecm status

say?

 

[raptortrex]

output for pvecm status,


root@server2:~# pvecm status
Quorum information
------------------
Date: Thu Feb 23 21:21:27 2017
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000002
Ring ID: 2/1132
Quorate: No

Votequorum information
----------------------
Expected votes: 2
Highest expected: 2
Total votes: 1
Quorum: 2 Activity blocked
Flags:

Membership information
----------------------
Nodeid Votes Name
0x00000002 1 163.172.107.22 (local)
root@server2:~#

 

[raptortrex]

I did a fresh install and added the second note through ssh from the first node. This way i was able to add the node with pvecm add [ip first node].
However the cluster works for a couple of minutes and than brokes. Everythime i reboot the servers, the cluster will run for a couple of minutes and the will be broke.

ls -lh /etc/pve output server1 gives
root@server1:~# ls -lh /etc/pve
total 2.5K
-r--r----- 1 root www-data 451 Feb 23 23:04 authkey.pub
-r--r----- 1 root www-data 454 Feb 24 00:03 corosync.conf
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 local -> nodes/server1
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 lxc -> nodes/server1/lxc
dr-xr-xr-x 2 root www-data 0 Feb 23 23:04 nodes
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 openvz -> nodes/server1/openvz
dr-x------ 2 root www-data 0 Feb 23 23:04 priv
-r--r----- 1 root www-data 2.1K Feb 23 23:04 pve-root-ca.pem
-r--r----- 1 root www-data 1.7K Feb 23 23:04 pve-www.key
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 qemu-server -> nodes/server1/qemu-server
-r--r----- 1 root www-data 119 Feb 23 23:04 vzdump.cron

ls -lh /etc/pve output server2 gives
root@server2:~# ls -lh /etc/pve
total 2.5K
-r--r----- 1 root www-data 451 Feb 23 23:04 authkey.pub
-r--r----- 1 root www-data 454 Feb 24 00:03 corosync.conf
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 local -> nodes/server2
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 lxc -> nodes/server2/lxc
dr-xr-xr-x 2 root www-data 0 Feb 23 23:04 nodes
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 openvz -> nodes/server2/openvz
dr-x------ 2 root www-data 0 Feb 23 23:04 priv
-r--r----- 1 root www-data 2.1K Feb 23 23:04 pve-root-ca.pem
-r--r----- 1 root www-data 1.7K Feb 23 23:04 pve-www.key
lr-xr-xr-x 1 root www-data 0 Jan 1 1970 qemu-server -> nodes/server2/qemu-s erver
-r--r----- 1 root www-data 119 Feb 23 23:04 vzdump.cron

So this seems to be ok.

pvecm status gives

root@server2:~# pvecm status
Quorum information
------------------
Date: Fri Feb 24 00:41:00 2017
Quorum provider: corosync_votequorum
Nodes: 1
Node ID: 0x00000002
Ring ID: 2/532
Quorate: No

Votequorum information
----------------------
Expected votes: 2
Highest expected: 2
Total votes: 1
Quorum: 2 Activity blocked
Flags:

Membership information
----------------------
Nodeid Votes Name
0x00000002 1 163.172.107.22 (local)

What can be the problem?

 

[dcsapak]

did you verify that multicast works?
https://pve.proxmox.com/wiki/Multicast_notes#Using_omping_to_test_multicast

 

[raptortrex]

Cluster is working now. I added transport: udpu at /etc/pve/corosync.conf.

I have a other issue now. When i whan to create a pveceph createmon i get the message
unable to find local address within network '10.91.219.61/32'

My intern network has follow ips from online.net
server1 10.91.219.61
server2 10.91.218.150
the are connected in the same group with the RPN interface from online.net

The ips are pingable from the 2 servers.
To add the network i did the follow command on server1
pveceph init --network 10.91.219.61/32
All other prefix give a message "invalide prefix" and this 32 prefix give me the message unable to find local address

how can i fix this?

 

[raptortrex]

I think the issue is that the 2 private ip's are 2 different subnets.
Bouth ip's are pingable from bouth servers