Ceph Config - Create FS - Error

fxandrei

Renowned Member
Jan 10, 2013
163
17
83
So i am trying to configure proxmox to use ceph server (on 3 nodes\servers).
So i have created the osds, the pool, and the metadata servers.

So im following this : https://pve.proxmox.com/pve-docs/chapter-pveceph.html

So i added the ceph server to the cluster storage, and can use it.
Now im supposed to create the FS (even though i dont understant why exactly i need to do this... but ill keep investigating).

So if i try to create from the gui or from console (with "pveceph fs create --pg_num 128 --add-storage") i get this error :
creating data pool 'cephfs_data'...
mon_command failed - error parsing integer value '': Expected option value to be integer, got ''ta"}

If i check the pool after this i can see that it has create a new pool called "cephfs_data" with 128 pgnum.

So what can i do ?
I why would i need to create another pool with another pgnum when i already have a pool ?!
 
So i added the ceph server to the cluster storage, and can use it.
Now im supposed to create the FS (even though i dont understant why exactly i need to do this... but ill keep investigating).
You only need to create a FS (and MDS) if you want to use CephFS. For VM disk storage, the RBD part is already sufficient.

So if i try to create from the gui or from console (with "pveceph fs create --pg_num 128 --add-storage") i get this error :
creating data pool 'cephfs_data'...
mon_command failed - error parsing integer value '': Expected option value to be integer, got ''ta"}
This seems like an already fixed bug, please upgrade to the latest packages.
 
What packages should have this fix ? And in what version ?

And is there a workaround ?
Could i create them manually somehow ?!
 
So i just did the update :

Code:
apt-get dist-upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

PS: i dont have enterprise support.
Is that a factor ?


I still get the same error.

Guess il try with the "ceph fs" command .
 
So something does not fit.
So when i get to the point of creating a CephFS i already have a pool created.
I cannot use that from what i can see.

I can create new pools, and the create the fs with these commands:
Code:
ceph osd pool create cephfs_data <pg_num>
ceph osd pool create cephfs_metadata <pg_num>
ceph fs new <fs_name> <metadata> <data>

If i execute ceph fs ls i see this :
Code:
root@hp1-s1:/var/lib# ceph fs ls
name: serv1-ceph-fs, metadata pool: serv1-ceph-metadata, data pools: [serv1-ceph-data ]
root@hp1-s1:/var/lib#

So whats the deal with the initial pool i created.
Should i delete it ?!
And what do i need now to do ?
Add the serv1-ceph-data to the storage cluster (RBD type).

What about the fs ?!

My question is what do i need to do to acces the pools !?
 
So yeah. Im kind of lost.
So i deleted everything.... so no pools.

I created the pools and fs manually with :
ceph osd pool create cephfs_data 512
ceph osd pool create cephfs_metadata 128

ceph fs new cephfs cephfs_metadata cephfs_data
ceph osd pool application enable cephfs_metadata cephfs

I then went to Storage in Proxmox Cluster and :
- added both clusterfs_data and clusterfs_metadata with RBD(PVE) storage type
- added clusterfs usint the clusterfs storage type

RBD can save disks, clusterfs cannot (just backups).

My problem is that im kind of lost :).

Should i mount the metadata pool ? Or just the data ?!
How would i acces the disks i add in the data pool ? What about the metadata pool?
 
This one can be close, as i oppened another thread, only with my "problems" related to how to use these pools and fs.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!