Unable to read cephfs when mounted remotely

cclloyd

Active Member
Dec 4, 2018
17
1
43
47
When I try to mount a cephfs remotely, I am unable to browse it at all, and the attributes are all question marks.

Code:
❯ ls -lah /mnt
ls: cannot access 'skipspace': Permission denied
total 20K
drwxr-xr-x 13 root    root          159 Oct  6 00:24 .
drwxr-xr-x 19 root    root          292 Jun  6 18:06 ..
drwxr-xr-x  4 cclloyd admins         38 Jun  9 22:45 Cache
drwxr-xr-x  2 root    root            6 Jun  6 20:20 Home
drwxr-xr-x  2 root    root            6 Jun  6 23:57 rbd
d?????????  ? ?       ?               ?            ? skipspace
drwxr-xr-x  2 root    root            6 Jun  6 23:57 tmp



When mounting using the same arguments from a monitor host, I can mount and view just fine. But when I try to mount it in a few of the VMs its mounted on, it fails.

However, Kubernetes still seems to be able to mount it just fine. Exec'ing into a pod that has a folder from cephfs mounted allows me to view and modify the contents just fine.

So it is only VM hosts that are failing to be able to mount it.

Why?



Some relevant info:

Code:
MONITOR:
Pve version: 7.0-1
Ceph OSD version: 16.2.5
Cluster status: healthy

Code:
CLIENT:
OS: Ubuntu 20.04
Mount command:  mount -t ceph mon1:/ /mnt/skipspace -o name=admin,secretfile=/etc/ceph/admin.key
Packages:
    ceph-common/focal-updates,now 15.2.14-0ubuntu0.20.04.1 amd64 [installed]
    libcephfs2/focal-updates,now 15.2.14-0ubuntu0.20.04.1 amd64 [installed,automatic]
    python3-ceph-argparse/focal-updates,now 15.2.14-0ubuntu0.20.04.1 amd64 [installed,automatic]
    python3-ceph-common/focal-updates,now 15.2.14-0ubuntu0.20.04.1 all [installed,automatic]
    python3-cephfs/focal-updates,now 15.2.14-0ubuntu0.20.04.1 amd64 [installed,automatic]
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!