Hi,
I am experimenting with cephadm and I've done a couple of proof-of-concept installations.
For this issue, I have a new proxmox installation and I have installed and bootstrapped cephadm. Proxmox is running fine and ceph is running fine on the same hardware. I have tried to add a ceph rbd pool as an external rbd storage follwing https://pve.proxmox.com/pve-docs/chapter-pvesm.html#ceph_rados_block_devices as well as tried similar instructions such as 45 drives KB https://knowledgebase.45drives.com/kb/kb450244-configuring-external-ceph-rbd-storage-with-proxmox/.
I have copied the keyring to /etc/pve/priv/ceph/storage_id.keyring (storage_id is rbd-hdd-osd-2-1) and to /etc/ceph, and copied the ceph.conf to /etc/pve/priv/ceph/storage_id.conf and to /etc/ceph. I have the storage with both KRBD and without.
I still have a question mark for the storage and it's marked as inactive.
Here is the kicker. I have another newly installed proxmox node. When I add the external rbd pool from the other node, it works immediately. I have gone through the files above on both nodes (in /etc/ceph and /etc/pve/priv/ceph) and they are identical. So far, the only difference seems to be that using the same mon ip as the node itself doesn't work. I tried adding an A record in the DNS and using that instead, but didn't help.
Is this a known situation or does anyone have any ideas?
I am experimenting with cephadm and I've done a couple of proof-of-concept installations.
For this issue, I have a new proxmox installation and I have installed and bootstrapped cephadm. Proxmox is running fine and ceph is running fine on the same hardware. I have tried to add a ceph rbd pool as an external rbd storage follwing https://pve.proxmox.com/pve-docs/chapter-pvesm.html#ceph_rados_block_devices as well as tried similar instructions such as 45 drives KB https://knowledgebase.45drives.com/kb/kb450244-configuring-external-ceph-rbd-storage-with-proxmox/.
I have copied the keyring to /etc/pve/priv/ceph/storage_id.keyring (storage_id is rbd-hdd-osd-2-1) and to /etc/ceph, and copied the ceph.conf to /etc/pve/priv/ceph/storage_id.conf and to /etc/ceph. I have the storage with both KRBD and without.
I still have a question mark for the storage and it's marked as inactive.
Here is the kicker. I have another newly installed proxmox node. When I add the external rbd pool from the other node, it works immediately. I have gone through the files above on both nodes (in /etc/ceph and /etc/pve/priv/ceph) and they are identical. So far, the only difference seems to be that using the same mon ip as the node itself doesn't work. I tried adding an A record in the DNS and using that instead, but didn't help.
Is this a known situation or does anyone have any ideas?
Last edited:
