pve-root almost full

[bonez]

My root partition (LVM /dev/mapper/pve-root) is almost full and I can't figure out what's taking up the space.

root@pve:/# df -h
Filesystem            Size  Used Avail Use% Mounted on
udev                  7.7G     0  7.7G   0% /dev
tmpfs                 1.6G  3.0M  1.6G   1% /run
/dev/mapper/pve-root   68G   63G  1.5G  98% /
tmpfs                 7.7G   34M  7.7G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
efivarfs              256K   74K  178K  30% /sys/firmware/efi/efivars
/dev/nvme0n1p2       1022M   12M 1011M   2% /boot/efi
/dev/sda1             916G  539G  331G  62% /mnt/ssd1
/dev/fuse             128M   24K  128M   1% /etc/pve
/dev/sdb              2.7T  1.5T  1.2T  57% /mnt/disk1
/dev/sdf1             2.7T  833G  1.8T  32% /mnt/disk2
tmpfs                 1.6G     0  1.6G   0% /run/user/0
root@pve:/#

This shows that only 5.8GB is used:

root@pve:/# du -h -x -d1 /
6.8M    /etc
4.0K    /opt
36K    /tmp
2.2G    /var
3.4G    /usr
173M    /boot
4.0K    /media
20K    /home
4.0K    /srv
20K    /mnt
48M    /root
16K    /lost+found
5.8G    /
root@pve:/#

If I run ncdu it shows as below:
Note that /mnt contains 3 USB mounted hard disks and nothing else.




I have backups running to a dedicated volume named 'backups', which is one of the mounted USB disks.
There is only a single ISO on disk which is less than 700MB.

Does anyone have any tips on finding what is taking up the remainder of the root partition?

 

[dietmar]

Note that /mnt contains 3 USB mounted hard disks and nothing else.

Maybe that mount failed sometimes in the past, and the backup wrote data there?

 

[bonez]

Maybe that mount failed sometimes in the past, and the backup wrote data there?

Thank you, that was exactly the issue. I unmounted one of the disks and found that Proxmox had written some backups there.

Cheers!

 

[Dunuin]

Thank you, that was exactly the issue. I unmounted one of the disks and found that Proxmox had written some backups there.

Cheers!

To prevent that in the future you should tell PVE about those mountpoints so it won't allow writes to a non-mounted mountpoint.
Like: pvesm set YourStorageId --is_mountpoint /path/to/mountpoint