Hi
I've been tinkering with Ceph for a bit, and I've evidently done a bad thing with CephFS and I can't create a new fs called 'cephfs'.
The error generated is:
However, I don't know where the keyring is.
If I create the CephFS, but don't add it to storage in Proxmox, the creation is successful, but I get the same TASK ERROR when I try to add it as storage.
If I create a CephFS called something else, like cephfs2, the whole process succeeds.
I am using proxmox 7.3-4. All packaged are up to date. I have rebooted the host(s) repeatedly throughout testing.
pve/ceph.conf is:
The contents of /var/lib/ceph/mds/ tree is empty:
/etc/pve/priv/ does not having a keyring that matches the pattern identified in the client section:
Any help is appreciated.
Thanks!
I've been tinkering with Ceph for a bit, and I've evidently done a bad thing with CephFS and I can't create a new fs called 'cephfs'.
The error generated is:
Code:
creating data pool 'cephfs_data'...
pool cephfs_data: applying application = cephfs
pool cephfs_data: applying pg_num = 128
creating metadata pool 'cephfs_metadata'...
pool cephfs_metadata: applying pg_num = 32
configuring new CephFS 'cephfs'
Successfully create CephFS 'cephfs'
Adding 'cephfs' to storage configuration...
Waiting for an MDS to become active
Waiting for an MDS to become active
TASK ERROR: adding storage for CephFS 'cephfs' failed, check log and add manually! create storage failed: ceph authx keyring file for storage 'cephfs' already exists!However, I don't know where the keyring is.
If I create the CephFS, but don't add it to storage in Proxmox, the creation is successful, but I get the same TASK ERROR when I try to add it as storage.
If I create a CephFS called something else, like cephfs2, the whole process succeeds.
I am using proxmox 7.3-4. All packaged are up to date. I have rebooted the host(s) repeatedly throughout testing.
pve/ceph.conf is:
Code:
root@proxmox1:~# cat /etc/pve/ceph.conf
[global]
auth_client_required = cephx
auth_cluster_required = cephx
auth_service_required = cephx
cluster_network = 192.168.100.1/24
fsid = e02ec1de-8a0d-476a-b7db-de78e8c541dc
mon_allow_pool_delete = true
mon_host = 192.168.100.1 192.168.100.2
ms_bind_ipv4 = true
ms_bind_ipv6 = false
osd_pool_default_min_size = 2
osd_pool_default_size = 3
public_network = 192.168.100.1/24
[client]
keyring = /etc/pve/priv/$cluster.$name.keyring
[mds]
keyring = /var/lib/ceph/mds/ceph-$id/keyring
[mon.proxmox1]
public_addr = 192.168.100.1
[mon.proxmox2]
public_addr = 192.168.100.2The contents of /var/lib/ceph/mds/ tree is empty:
Code:
root@proxmox1:~# ls -al /var/lib/ceph/mds/
total 8
drwxr-xr-x 2 ceph ceph 4096 Jan 1 19:22 .
drwxr-xr-x 14 root root 4096 Dec 30 13:42 ../etc/pve/priv/ does not having a keyring that matches the pattern identified in the client section:
Code:
root@proxmox1:~# ls -al /etc/pve/priv/
total 4
drwx------ 2 root www-data 0 Dec 16 13:13 .
drwxr-xr-x 2 root www-data 0 Dec 31 1969 ..
drwx------ 2 root www-data 0 Dec 16 13:13 acme
-rw------- 1 root www-data 1675 Jan 1 17:54 authkey.key
-rw------- 1 root www-data 1974 Dec 28 14:18 authorized_keys
drwx------ 2 root www-data 0 Dec 30 15:28 ceph
-rw------- 1 root www-data 151 Dec 30 13:42 ceph.client.admin.keyring
-rw------- 1 root www-data 228 Dec 30 13:42 ceph.mon.keyring
-rw------- 1 root www-data 3957 Dec 30 10:16 known_hosts
drwx------ 2 root www-data 0 Dec 16 13:13 lock
-rw------- 1 root www-data 3243 Dec 16 13:13 pve-root-ca.key
-rw------- 1 root www-data 3 Dec 21 19:48 pve-root-ca.srlAny help is appreciated.
Thanks!
