rbd map fails

elias.steiner

New Member
Aug 24, 2023
1
0
1
Hi There

We try to use the ceph cluster for persisten storage in our local okd installation with Rook.

The Operator creates the block storage correct in the ceph pool. But pods and also local clients are not able to map the storage.



Code:
rbd ls --id=admin -m 192.168.1.1:6789,192.168.1.3:6789,192.168.1.2:6789 --keyfile=KEYKEYKEY== okd-encrypted
csi-vol-0816b1a4-ce52-46c2-9feb-159a0d459706
csi-vol-3d56a63e-d8bd-4523-b642-e0d41f0f3e41
csi-vol-47eb54af-9e44-45b7-be48-7e660c3cfd4e
csi-vol-f6428a38-0b82-4450-87c9-1a35da3ef4e1



Code:
rbd map --id admin -m 192.168.1.1:6789,192.168.1.3:6789,192.168.1.2:6789 --keyfile=KEYKEYKEY== okd-encrypted/csi-vol-0816b1a4-ce52-46c2-9feb-159a0d459706 --device-type krbd --options noudev
rbd: sysfs write failed
In some cases useful info is found in syslog - try "dmesg | tail".
rbd: map failed: (110) Connection timed out



Hade some one simular problems?
 
If someone else finds this with google - see if this is the culprit https://github.com/ceph/ceph-csi/issues/3113 --
If you are not using the multus network or some pod network please remove netNamespaceFilePath from your value.yaml (if you are using helm) or from ceph-csi-config configmap

Had similar experience with OKD and ceph-csi installed with Helm.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!