CephFS user/permission conflict between different nodes (best practices?)

[encore]

Hi,
we are using CephFS on a 3-node proxmox cluster. We have mounted the CephFS to /home on several different Debian clients.

All Debian clients (server) see the files of the other Debian clients in the cephfs mount (/home).
It happens that client XY has services on Debian client 1 and Debian client 2. Example:
/home/customerXY/service123 (on Debian Client 1)
/home/customerXY/service234 on (Debian Client 2)
If I now set the permissions for /home/customerXY to user customerXY on Debian Client 1, Debian Client 2 will no longer have access with the customerXY user, because of course they have different user IDs in their Debian environment.

How could you work around this problem? Can CephFS be configured so that each Debian client (server) can see the CephFS mounted to /home but not the folders/files of the other Debian clients (servers)?

 

[gurubert]

they have different user IDs in their Debian environment.

You need to fix this. CephFS can only record one userid per file.
You need to make the user IDs and group IDs consistent across all machines that use the same filesystem. NFS would have the same issue. This is usally done with a central user management like Samba 4 Active Directory.

You do not need to mount the root of CephFS but can mount a subdirectory on a client. This may help you right now.