Question on Usage of Ceph in VMs as a Common Storage Device

Seed

Active Member
Oct 18, 2019
98
58
38
124
Hello,

I have a ceph pool that I want to be able to mount to virtual machines sharing this mount to a few VMs as a shared storing, similar to NFS. How can i do this? Do I need to use cephfs in the VM? How can I create a disk that is shared to be able to mount to VMs across nodes?

Thanks!
 
If the VMs have access to the Ceph cluster, than they can use RBD or CephFS, as the Proxmox VE nodes do. But maybe a more classical/flexibel approach is to use a NFS/SMB server that has its disks on RBD.
 
But maybe a more classical/flexibel approach is to use a NFS/SMB server that has its disks on RBD.
Yeah I’m trying to avoid using NFS if at all possible. Too many issues with file ownership in the past across hosts.
 
Too many issues with file ownership in the past across hosts.
But that won't go away. CephFS is a POSIX compatible filesystem, hence has also user permissions.
 
  • Like
Reactions: Seed
But that won't go away. CephFS is a POSIX compatible filesystem, hence has also user permissions
Hmm. That sucks....

so is the idea then that I create a virtual disk on a vm then share that out to other vms?

maybe an alternative would be to create a disk on the ceph pool and use that for a few containers on the one node, and if that node takes a dump I should be able to remount that disk to another vm on a different node?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!