I can't mount proxmox cephfs.

[akong]

Hello,
I use proxmox build ceph storage.And another proxmox want mount cephfs system.But I got error message.

create storage failed: mount error: Job failed. See "journalctl -xe" for details. (500)

I run journalctl -xe

Aug 17 17:48:34 vps1 kernel: ceph: Unknown parameter 'fs'
Aug 17 17:48:34 vps1 systemd[1]: Failed to mount /mnt/pve/cephfs.
░░ Subject: A start job for unit mnt-pve-cephfs.mount has failed
░░ Defined-By: systemd
░░ Support: https://www.debian.org/support
░░
░░ A start job for unit mnt-pve-cephfs.mount has finished with a failure.
░░
░░ The job identifier is 3231 and the job result is failed.

How to fix it?

 

[Stoiko Ivanov]

please check `pveversion -v` from the nodes running ceph, and the node where you want to mount the cephfs

 

[akong]

I use pveversion -v command
Ceph node:

proxmox-ve: 7.2-1 (running kernel: 5.15.39-3-pve)
pve-manager: 7.2-7 (running version: 7.2-7/d0dd0e85)
pve-kernel-5.15: 7.2-8
pve-kernel-helper: 7.2-8
pve-kernel-5.15.39-3-pve: 5.15.39-3
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph: 16.2.9-pve1
ceph-fuse: 16.2.9-pve1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve1
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-4
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.2-2
libpve-guest-common-perl: 4.1-2
libpve-http-server-perl: 4.1-3
libpve-storage-perl: 7.2-7
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.2.5-1
proxmox-backup-file-restore: 2.2.5-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.5.1
pve-cluster: 7.2-2
pve-container: 4.2-2
pve-docs: 7.2-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.5-1
pve-ha-manager: 3.4.0
pve-i18n: 2.7-2
pve-qemu-kvm: 6.2.0-11
pve-xtermjs: 4.16.0-1
qemu-server: 7.2-3
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.7.1~bpo11+1
vncterm: 1.7-1
zfsutils-linux: 2.1.5-pve1

Ceph Client:

proxmox-ve: 7.2-1 (running kernel: 5.15.39-3-pve)
pve-manager: 7.2-7 (running version: 7.2-7/d0dd0e85)
pve-kernel-5.15: 7.2-8
pve-kernel-helper: 7.2-8
pve-kernel-5.15.39-3-pve: 5.15.39-3
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph: 16.2.9-pve1
ceph-fuse: 16.2.9-pve1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve1
libproxmox-acme-perl: 1.4.2
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.2-4
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.2-2
libpve-guest-common-perl: 4.1-2
libpve-http-server-perl: 4.1-3
libpve-storage-perl: 7.2-7
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.2.5-1
proxmox-backup-file-restore: 2.2.5-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.5.1
pve-cluster: 7.2-2
pve-container: 4.2-2
pve-docs: 7.2-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.5-1
pve-ha-manager: 3.4.0
pve-i18n: 2.7-2
pve-qemu-kvm: 6.2.0-11
pve-xtermjs: 4.16.0-1
qemu-server: 7.2-3
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.7.1~bpo11+1
vncterm: 1.7-1
zfsutils-linux: 2.1.5-pve1

 

[akong]

It's seem the same.

 

[akong]

Where to found about log?

 

[Stoiko Ivanov]

I just tried that - it works here.
I managed to get an error by providing the wrong monitors though

please check the resulting mount unit:
it should be:

systemctl cat mnt-pve-cephfs.mount

You can always remove the storage and try to readd it.

I hope this helps!

 

[akong]

I use command to mount it.

ceph-fuse --id admin --conf /etc/ceph/ceph.conf -m 192.168.2.51:6789 /mnt/ceph/

It's can mount it.But use gui can't mount.

 

[Stoiko Ivanov]

as said - please provide the complete contents of the relevant mount-unit `systemctl cat mnt-pve-cephfs.mount` - else it's not possible to see what is going wrong where

 

[akong]

Hello,

root@pve-tp:~# systemctl cat mnt-pve-cephfs.mount
# /run/systemd/system/mnt-pve-cephfs.mount
[Unit]
Description=/mnt/pve/cephfs
DefaultDependencies=no
Requires=system.slice
Wants=network-online.target
Before=umount.target remote-fs.target
After=systemd-journald.socket system.slice network.target -.mount remote-fs-pre.target network-online.target
Conflicts=umount.target

[Mount]
Where=/mnt/pve/cephfs
What=192.168.2.51,192.168.2.52,192.168.2.53,192.168.2.54:/
Type=ceph
Options=name=admin,secretfile=/etc/pve/priv/ceph/cephfs.secret,fs=cephfs

 

[Stoiko Ivanov]

My guess is that the ceph-common version you have installed is not matching (most likely the one from debian upstream)

what's the output of `dpkg -l |grep -i ceph` on the machine which cannot mount the cephfs?

see also:
https://forum.proxmox.com/threads/s...ant-mount-or-create-new-cephfs-storage.65850/

 

[akong]

The proxmox client version is 14.The node version is 16.So could I need install ceph with gui to upgrade to 16?

 

[Stoiko Ivanov]

It would be a good start and most likely the cause of your issue (you might need to remove the storage and readd it via the GUI as well)

I hope this helps!