cephfs

We've been using Proxmox with ceph for years. Our typical cluster is... Proxmox 8.3.5 Ceph 18.2.4 10 servers 3 Enterprise SSD OSDs per server each 20Gbs between the servers 10Gbs between VMs and Ceph Public network for cephfs mounts. 1 Pool for VM deployment 2 subvolumes/pools; 1 Elastic data...

I set up a home lab of 3 machines to set up a proxmox cluster so I could learn how to do it. I got through the ceph setup and started setting up a cephfs, but when I set it up, for some reason, I cannot create any VMs on it, and can only use the storage local to each host. I found the content...

Good evening, I have a three node test cluster running with PVE 8.4.1. pve-01 & pve-02CPU(s) 56 x Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz (2 Sockets) pve-03CPU(s) 28 x Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz (1 Socket) Kernel Version Linux 6.8.12-10-pve (2025-04-18T07:39Z)...

Hello Proxmox Community, I'm looking for some guidance on the best way to set up a Ceph File System (CephFS) within my 3-node Proxmox cluster to provide storage for multiple applications: FileCloud, Paperless-ngx, and Jellyfin. FileCloud in particular needs a file system with a mountable path...

Hi, I have 4 node PVE Cluster with CephFS deployed and from a couple of months ago i get MDS oom kills and sometimes MDS are deployed on another node and get stucked on clientreplay status, so i need to restart this MDS again to gain acces to cephfs from all clients Checked scheduled jobs or...

I have been using Cloud-Init for the past six months and Ceph for the past three months. I tried to set up Cloud-Init to work with CephFS and RBD, but I am having trouble booting a basic virtual machine. Is there a post or tutorial available for this particular use case? I have searched...

Hi all, I am currently testing a Ceph 19.2 on a 3/2 test cluster, which has worked properly so far. Now I wanted to try CephFS, but failed because the pool cannot be mounted. I followed the documentation: https://pve.proxmox.com/pve-docs/chapter-pveceph.html#pveceph_fs The metadata servers are...

Hello, this whole shebang has already taken me nearly a week to try to figure out, but I'm still stuck. Background: I want to spin up a 5 VM Docker Swarm cluster. They're meant to be using keepaliveD for HA/Failover using a simple SDN. That seems to be working OK. Now I "only" need peristent...

Hallo, has anyone seens this "problem" before? root@pve0:/mnt/pve# ls -lisah ls: cannot access 'cephfs': Permission denied total 1.0K 5384 512 drwxr-xr-x 3 root root 3 Aug 30 15:31 . 8 512 drwxr-xr-x 3 root root 3 Aug 30 15:31 .. ? ? d????????? ? ? ? ? ? cephfs A node...

I used the shell to stop the CephFS and delete but on the GUI it shows on all the nodes with a question mark still. How do I remove that?

Hello all, We're running our servers on a PRoxmox 8.1 cluster, and there is Ceph installed. I have both ceph block pool and cephfs pool using actively. But it seems like i divides into 2 our total usable storage size and i dont know how to determine limits i need. Now it's like 20TB-20TB...

Good day all. Sorry for all the noob questions. I have ceph running on my 6node proxmox cluster. After some other noob questions ive asked over the last few days. its running nicely. I would like to now add a cephfs share to a vm Assumption : when i add to a vm, it woule be like mounting a NFS...

I'm sure this has been covered before, but i wasn't able to find quite what i was looking for in other posts. i have created my proxmox 8 cluster and i have created a cephfs. cephfs needs to go to the VM's hosted within proxmox and im trying to avoid having internet traffic go outside the host...

Hi I'm trying to get two cephfs shares on 2 different sites to mirror in both way's. To try and achieve this i was following this guide: https://docs.ceph.com/en/latest/dev/cephfs-mirroring/ But when i try to "systemctl enable cephfs-mirror@mirror" i'm getting the error that this service...

It will help if it is GUI-based steps to create CephFS. I currently have configured Ceph as shared storage on all 3 nodes. Also, Linux VMs are on local storage. I have to use CephFs to create a shared folder between 2 VMs on different nodes.

We're succesfully using Ceph on Proxmox, and have started to attempt to use CephFS. We are able to mount, and create a file, but can then not write to the file, it shows the below error: root@<redacted>:/mnt/ceph# echo "test" > /mnt/ceph/testfile -bash: echo: write error: Operation not permitted...

[SOLVED] user error - permissions for group(s) for / Hello, I have a fresh installation of pve 8.1.3 using pam auth, ceph reef 18.2.0, using cephfs as the iso datastore. If I'm logged in as root, create vm, OS tab, the ISOs there are listed. I then create a user with permissions...

Is it needed to set Scrub or Trim for CephFS when it has SSD / NVME OSD drives? I know I can start it manual seeing (active+clean+scrubbing: 1), but how to configure this to run automatically?

Hi ! Please help me understand what happen. I have pve 7 and ceph version 17.2.5. Created ceph fs and try to mount it on my centos 8 fresh installed server. But there is an error in cli: mount -t ceph 10.20.0.120:/cephfs /mnt/cephfs -o name=user_test,secret=%ANY-SECRET% mount: /mnt/cephfs...

New novice user trying to use Proxmox. This software is very unpleasant. could this possibly be any more over complicated and unfriendly? ``` creating data pool 'cephfs_data'... pool cephfs_data: applying application = cephfs pool cephfs_data: applying pg_num = 128 creating metadata pool...