CephFS: df versus du versus getfattr

[Rainerle]

So it looks like this graph is coming from df:


This is what df shows:

root@proxmox01:~# df -h
Filesystem                          Size  Used Avail Use% Mounted on
udev                                252G     0  252G   0% /dev
tmpfs                                51G  2.2M   51G   1% /run
rpool/ROOT/pve-1                    180G   11G  169G   6% /
tmpfs                               252G   66M  252G   1% /dev/shm
tmpfs                               5.0M     0  5.0M   0% /run/lock
rpool                               169G  128K  169G   1% /rpool
rpool/ROOT                          169G  128K  169G   1% /rpool/ROOT
rpool/data                          169G  128K  169G   1% /rpool/data
/dev/fuse                           128M   76K  128M   1% /etc/pve
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-12
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-1
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-0
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-13
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-3
tmpfs                               252G   28K  252G   1% /var/lib/ceph/osd/ceph-2
10.20.42.1,10.20.42.2,10.20.42.3:/  965G  232G  733G  25% /mnt/pve/cephfs
tmpfs                                51G     0   51G   0% /run/user/0

But looking at du and getfattr...

root@proxmox01:~# du -hd1 /mnt/pve/cephfs
0       /mnt/pve/cephfs/snippets
0       /mnt/pve/cephfs/delete
0       /mnt/pve/cephfs/backup
0       /mnt/pve/cephfs/dump
1.1G    /mnt/pve/cephfs/template
23G     /mnt/pve/cephfs/vol
24G     /mnt/pve/cephfs
root@proxmox01:~# getfattr -n ceph.dir.rbytes /mnt/pve/cephfs
getfattr: Removing leading '/' from absolute path names
# file: mnt/pve/cephfs
ceph.dir.rbytes="24577801075"

root@proxmox01:~#

And what is this???


No idea what to look at anymore in the cleaners business...