cephfs

been running around in circles trying to figure this out.. what's the best/most-direct way to get more than 1 CephFS running/working on a pmx7 cluster with the pool types NOT matching? IE, I'd like to have the following: 1. /mnt/pve/cephfs - replicated, SSD 2. /mnt/pve/ec_cephfs - erasure...

I have a PBS system where I need to mount a CephFS FS. I have managed to mount this using this command: mount -t ceph 192.168.215.4,192.168.215.3,192.168.215.2,192.168.215.1:/ /mnt/mycephfs -o name=bob,secret=xxxxxxxxxxxxxxxxxxxxxxx== This is working like a charm and I have access to my...

We have a large 4 node cluster with about 419To split in two main pools, one for NVMe based disks and another one for SSD. We are planning to use the NVMe RBD to store our VMs and the other pool to store shared data. Shared data will be very voluminous and with +100 millions of files. Beside...

Hallo, wir haben ein 3-Node CEPH/PVE Cluster (PVE 6.4-5/ CEPH 15.2.11) und haben ein paar Ausfalltests durchgeführt. Dabei ist uns aufgefallen, dass CEPH quasi gar nicht mehr reagiert, wenn die Links vom CEPH Public und CEPH Cluster Netzwerk down sind. Also auch die (pve-)ceph. Befehle geben...

Hi, I’ve started to use pbs for VMs and containers backups, but I don’t find a way to backup Ceph file systems... I’ve created ceph-fs in the proxmox cluster. Is there any proper way to do it? If not, is there any plan for proxmox or pbs next releases to support this feature? Thanks!

Hi! I have a 6 server cluster: 3 servers are hybrid nodes with a lot of OSDs and other 3 nodes are like VM processing nodes. Everything is backed up by 2x2 port 10G NIC in hybrid nodes and 1x2 port 10G NIC un processing nodes and two stacked N3K switches. Ceph does the thing for VM storage and...

Hello, On some servers in cloud I see this error, while trying to check cephfs - content: mount error: exit code 16 (500) I have next package versions:

i have usefully integrated ceph(proxmox based) in all the lxc containers, now i want to integrate it outside of proxmox for some user for read only access , to replace the current nfs share, what do i need to do ? what params to put in /etc/fstab

good evening, i posted in another thread (https://forum.proxmox.com/threads/proxmox-6-ceph-mds-stuck-on-creating.57524/#post-268549) that was created on the same topic and just hopped on to it, but that thread seems to be dead. so i am trying my luck here to see if this is a general problem...

Hi, I have noticed in Ceph log (ceph -w) an increase of "slow requests are blocked" when I create CephFS, e.g. 2019-10-14 16:41:32.083294 mon.ld5505 [INF] daemon mds.ld4465 assigned to filesystem cephfs as rank 0 2019-10-14 16:41:32.121895 mon.ld5505 [INF] daemon mds.ld4465 is now active in...

Hello, After adding and then removing a cephfs instance in the storage gui I noticed that it was not unmounted and/or deleted from /mnt/pve/[title]. I was wondering if this was intentional or not? Note: This was my 2nd cephfs storage instance in case that matters. I cannot remove my primary...

I would like to mount CEPHFS on a Client. Since CEPHFS version is Nautilus, I decided to use, as client, a container running CentOS 7. It might have well been an external physical machine, just happened I wanted to try with a container. Yes, CEPHFS is already installed on ProxMox and working...

I am currently evaluating Proxmox in a cluster environment and have intention to expand it to 7 storage nodes and 7 compute nodes to harness the storage provided by ceph. I have spent the last few weeks spending my effort formatting the machines and reinstalling everytime I make a ceph...

Hi, after creating MDS and CephFS manually in my cluster, I want to create a storage of type cephfs. However this fails with error: error with cfs lock 'file-storage_cfg': mount error: exit code 2 This is the complete output: root@ld3955:~# pvesm add cephfs pve_cephfs mount error 2 = No such...

I am using Proxmox 5.4 with CephFS and multiple file systems. One filesystem is called cephfs and it's on NVMe and the other is cephfs_slow and it's on standard SATA. I can manually mount each file system with: mount -t ceph -o mds_namespace=cephfs virt0,virt4,virt8,virt12:/ /foo mount -t ceph...

So im trying to configure a proxmox cluster with ceph. So from what i can see i can make a pool directly and use it (as in add it to the cluster storage as RBD) In order to create a CephFS storage in proxmox i need to create 2 sepparate ceph pools and then create the cephfs specifying the pool...

So i am trying to configure proxmox to use ceph server (on 3 nodes\servers). So i have created the osds, the pool, and the metadata servers. So im following this : https://pve.proxmox.com/pve-docs/chapter-pveceph.html So i added the ceph server to the cluster storage, and can use it. Now im...

Hi , Is there anyway to change read ahead of the cephfs. According : docs.ceph.com/docs/master/man/8/mount.ceph/ and : lists.ceph.com/pipermail/ceph-users-ceph.com/2016-November/014553.html (could not place hyper link - new user) this is should be improve reading single large files. right now...

When creating a regular (RBD) Ceph pool, there are options in both the GUI and in pveceph to determine the size (replication count) and the min. size (online replicas for read) of the pool. However, when creating a CephFS pool, neither the GUI, not pveceph provides an option to create one with a...

Hey, I am a little bit confused or maybe I am just missing a small detail. My plan is to deploy and mount a cephfs directory on a samba VM. Thus I created a MDS in the proxmox cephfs GUI but the address of the MDS is from my cluster network where the OSDs are communicating. Well, I tried to...