Rbd: couldn't connect to cluster

[Firm]

Hi,

I has PVE 4.2 with Ceph installed with help of pveceph. The problem is that when I try to create CT/VM on RBD volume it ends with error:

TASK ERROR: rbd error: rbd: couldn't connect to the cluster!

I was able to trace calls to rbd binary which is executed with "--auth_supported none" in command line. I wonder why PVE GUI is using "none" while I has "cephx" authentication type in /etc/ceph/ceph.conf.

P.S. Changing none to cephx leads to successful executions of rbd command.

Regards,
Alex

 

[dietmar]

I was able to trace calls to rbd binary which is executed with "--auth_supported none" in command line. I wonder why PVE GUI is using "none" while I has "cephx" authentication type in /etc/ceph/ceph.conf.

Because you forgot to upload the key to /etc/pve/priv/ceph/${storeid}.keyring ?

 

[Firm]

dietmar, you're right. I missed this step in manual. Now the Status looks like:

stopped: rbd error: got lock timeout - aborting command

Wonder if it's related to

pgmap v67: 64 pgs: 64 stale+active+undersized+degraded; 0 bytes data, 197 MB used, 22315 GB / 22315 GB avail

 

[Firm]

It was definitely problem with ceph installation. Using separate network segments via public/cluster network parameters leads to problem with osd daemon can't report to mon daemon (still checking why). Using single network segment is ok.