Local storage filling up, but can't see why

[MattF]

Hi all. Apologies in advance if this is a dumb question. I really appreciate the help. I am new to Proxmox and trying to sort out an issue. Have reviewed forums and internet and have not found this answer...

I have a single node. Recently, my backups started failing. It is clearly a storage capacity issue. What I noticed, and I suspect is the problem, is that my 'local' storage is full.

Details:
hdd size: 512 GB
local lvm size: 375 GB and shows as 103.78 GB (27%) used; content is disk images and containers only
local size: 100 GB and shows 83 GB (83%) used; iso images and container templates only

In my original setup, that was all I had and my backups were directed to local. Subsequently, I added an external 1 TB hdd to the storage pool. Some backups occurred after I added the external storage and I can see the usage there is 700 GB, so I know it is working.

What I can't figure out is why 'local' still shows 83 GB used. It is mapped to /var/lib/vz

However, /var/lib/vz shows only 2.9 GB of contents. What am I missing here?

Thanks again!

 

[bbgeek17]

Hi @MattF , welcome to the forum.

It always helps to provide more details rather than less. Also, please use text output enclosed in CODE </> tags.
What is the output of:
du -hxd1 /
mount
df -h

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[MattF]

Thanks @bbgeek17 . Output for those commands is below.

It looks like there is a good chunk of data in /home/backups (72GB). Would that show up as 'local' storage?

Any reason I shouldn't just remove that file and see what happens? Worst I'd lose if my previous backups, right?

<
root@pve-mealie:~# du -hxd1 /
3.2G /var
8.0K /mnt
16K /lost+found
36K /tmp
174M /boot
56K /root
4.0K /media
72G /home
4.9M /etc
4.0K /srv
4.0K /opt
2.9G /usr
78G /
/>


<
root@pve-mealie:~# mount
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,relatime)
udev on /dev type devtmpfs (rw,nosuid,relatime,size=8043016k,nr_inodes=2010754,mode=755,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,noexec,relatime,size=1615268k,mode=755,inode64)
/dev/mapper/pve-root on / type ext4 (rw,relatime,errors=remount-ro)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k,inode64)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5033)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
ramfs on /run/credentials/systemd-sysusers.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
ramfs on /run/credentials/systemd-tmpfiles-setup-dev.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
/dev/nvme0n1p2 on /boot/efi type vfat (rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)
/dev/sdb1 on /mnt/backups type ext4 (rw,relatime)
/dev/sda1 on /mnt/jellyfin-media type ext4 (rw,relatime)
ramfs on /run/credentials/systemd-sysctl.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
ramfs on /run/credentials/systemd-tmpfiles-setup.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
sunrpc on /run/rpc_pipefs type rpc_pipefs (rw,relatime)
lxcfs on /var/lib/lxcfs type fuse.lxcfs (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)
/dev/fuse on /etc/pve type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=1615264k,nr_inodes=403816,mode=700,inode64)
tracefs on /sys/kernel/debug/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
/>



<
root@pve-mealie:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 7.7G 0 7.7G 0% /dev
tmpfs 1.6G 1.6M 1.6G 1% /run
/dev/mapper/pve-root 94G 78G 12G 88% /
tmpfs 7.8G 46M 7.7G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
efivarfs 192K 99K 89K 53% /sys/firmware/efi/efivars
/dev/nvme0n1p2 1022M 12M 1011M 2% /boot/efi
/dev/sdb1 916G 669G 201G 77% /mnt/backups
/dev/sda1 916G 106G 764G 13% /mnt/jellyfin-media
/dev/fuse 128M 16K 128M 1% /etc/pve
tmpfs 1.6G 0 1.6G 0% /run/user/0
/>

 

[bbgeek17]

It looks like there is a good chunk of data in /home/backups (72GB). Would that show up as 'local' storage?

yes, "local" is the name of Directory type storage location on your root disk, same place where /home is.

Any reason I shouldn't just remove that file and see what happens? Worst I'd lose if my previous backups, right?

Nobody but you knows what is in that folder. So only you can decide whether to remove it.

Good luck

PS I should have clarified that </> refers to the icon located in the menu of the Post box.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[MattF]

Thanks for your time @bbgeek17. Will delete the home/backups/dump and see what happens! Appreciate you helping me locate that!