Unable to add CephFS/RBD to VM

[yyyy]

Hi all,

I have successfully set up ceph cluster on my datacenter across 5 nodes with 3 monitors and multiple OSDs, I can see it in the proxmox node itself, however there is no way to mount it on VMs created within the node? I have created a CephFS called "cephfs" on the node "
root@dws-zve-5:~# ls /mnt/pve/
cephfs"
and it is visible in the node shell but when I go to access it in the VM (created on the same node) there is no way to mount or access it?

 

[sb-jw]

Neither CephFS nor RBD is intended to be put directly into the VM under PVE. This works if you manage the CEPH as if it were running standalone. So you have to give every VM access to your CEPH network so that they can reach every mon and every storage node. Then you have to create the appropriate access data and store it in the VM. You'll need to install a few packages here and there, depending on how you want to mount it in the VM.

https://docs.ceph.com/en/latest/man/8/mount.ceph/
https://docs.ceph.com/en/latest/start/quick-rbd/

 

[alexskysilk]

however there is no way to mount it on VMs created within the node?

its possible. you'd need to set up your ceph public interfaces as bridges, and make ceph auth keys for your vms. you need to be careful with this; you really dont want to give rbd access to your guests, but cephfs/rgw no problem.

edit what @sb-jw said.