Local suddenly full and I can't understand why

bfish2

New Member
Mar 28, 2023
9
0
1
I have a node running the following
1740767353178.png


Last night I added syncthings to the docker and successfully synced about 5GB of files from a local Windows PC.

This morning, when I checked my backups they didn't complete successfully last night and I discovered that Local is full:

1740767402272.png

I have no Backups, ISO, or CT on that Local storage.

I have looked high and low, following various older forum posts, and I am at a loss what is the issue. I have moved most CTs/VMs off the node, rebooted, but to no avail.

Here is some additional info:

1740767492103.png

The two external USB drives (1TB each) are setup as a mirrored ZFS pool within PBackupServer.

1740767548339.png

Any help would be GREATLY appreciated. TIA!
 
OK, here is the issue. Local is 72GB total and these first two entries account for 68GB of it.

1740768762589.png

Now, not sure what causing it or what to do about it.
 
I see that the space occupied is in directories other than /mnt/pve/NAS_Storage

The naming of the "offending" directories suggests that you intended to use them as a mount location for external disks (i.e. EXT_1TB)

What likely happened is that you dumped the data in these folders but the disks were NOT mounted.

You can mount these disks in a new location, i.e. /mnt/temp. Move or Copy the data from "offending" directories to the disk. Once the copy is complete - remove the data from local disk.


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Are you sure that you have unmounted the NFS mount as previously suggested?
Rerun the command with -x option to exclude non local locations: du -hxd1


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
I'm sorry, but I don't understand. The NAS (NFS) share is tiny. It's the External 1 TB drives (and now re-reading it, I see that the ZFS pool is also big) that are huge. I do have backups on them but nowhere close to their capacity.

1740769225676.png
 
I see that the space occupied is in directories other than /mnt/pve/NAS_Storage

The naming of the "offending" directories suggests that you intended to use them as a mount location for external disks (i.e. EXT_1TB)

What likely happened is that you dumped the data in these folders but the disks were NOT mounted.

You can mount these disks in a new location, i.e. /mnt/temp. Move or Copy the data from "offending" directories to the disk. Once the copy is complete - remove the data from local disk.


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
THANK YOU! So before I do this, I want to be clear I understand what I should be doing:

1. Create new mount points (directories) for these 2 disks
2. In Datacenter, Storage, mount them to the new mount points
3. Delete the old directories on Proxmox03

Is that right? If so, then I need to update FSTAB file, right?
 
1. Create new mount points (directories) for these 2 disks
sure: mkdir /mnt/d1 /mnt/d2
2. In Datacenter, Storage, mount them to the new mount points
thats one way. Another is simply:
mount /dev/sdc1 /mnt/d1
Delete the old directories on Proxmox03
if you dont need the data in them, you can delete them.

If you do need the data, then copy it first: cp -r /mnt/pve/EXT_1TB_DISK/ /mnt/d1/

Is that right? If so, then I need to update FSTAB file, right?
If you use Proxmox to configure the mounts, then you dont need fstab. If you do it manually , then you MAY need fstab.
There are many variables.

Good luck


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
  • Like
Reactions: bfish2
sure: mkdir /mnt/d1 /mnt/d2

thats one way. Another is simply:
mount /dev/sdc1 /mnt/d1

if you dont need the data in them, you can delete them.

If you do need the data, then copy it first: cp -r /mnt/pve/EXT_1TB_DISK/ /mnt/d1/


If you use Proxmox to configure the mounts, then you dont need fstab. If you do it manually , then you MAY need fstab.
There are many variables.

Good luck


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
THANK YOU very much @bbgeek17 . My Local is back to where it belongs!