PBS backup space grow up constantly

UdoB said:
Nothing.

But we are debugging the "Prune 0" shown on the dashboard. It does not feel right, correct? Perhaps it is a "display"-error in the sense that it shows the number of prunes for the Datastore but not if there is only pruning only of a (sub-) namespace.

I am just guessing, I did not test/verify that...
Click to expand...
That's ok. My goal is debug/understand the constant growth of backups.
It's an evidence that the prune work fine, that the number on dashboard it's wrong.
If someone from proxmox want investigate also this issue, I'm available.
But secondary.
 
fabian said:
increasing space usage like this can also be caused by VMs not freeing up unused space properly (i.e., not discarding it). VM backups happen on the block layer - the full VM virtual disk is backed up. if applications inside the VM do a lot of temporary writes, they might dirty a lot of the disk even though within the VM it looks like most space is unused. I'd check the backup task logs to see if there are VMs that have an unexpectedly high rate of change. of course it could also just be natural growth over time - e.g., log files/state/.. accumulating inside the guests.
Click to expand...
Hi fabian can I send you some logs to help you understand?
Let me know what you need.

But is it possible that nobody have this problem?
My vm are very simple, windows server DC, some windows 11 client, some linux mint, ecc... no big databases, some small firewalls...
 
Last edited:
And definitely also check the garbage collect logs like mentioned before, because that's the process that should actually clear out space.
 
Hi,

I don't think the GC is the culprit here. From the WebUI screenshot, the GC seems to clean from 50 to 80Gb per day (which is huge if the VM is in low usage[0]).

[0]
tomasich said:
Vm are the same, just one has a small database but modification by day are very small, many other vm has no data incremets or better, only os maintenace like updates and so on
Click to expand...

That why checking the backup task logs will certainly reveal some details.

Best regards,
 
Last edited:
janus57 said:
Hi,

Have you checked your backup task logs like said before ?

Best regards,
Click to expand...
Sorry but I'm not skill to understand PBS logs... ths's why I ask help.
I attach a vm backup example, some days, same hour.
If someone can help me to "read" this log exactly, may I learn how to manage this problem.
It's not good, at all... see the storage space going full in some days like dashboad announce.
 

Attachments

tomasich said:
Hi fabian can I send you some logs to help you understand?
Let me know what you need.

But is it possible that nobody have this problem?
My vm are very simple, windows server DC, some windows 11 client, some linux mint, ecc... no big databases, some small firewalls...
Click to expand...
I try to provide something to evaluare, sorry I'm not skill to understand PBS logs... ths's why I ask help.
I attach a vm backup example, some days, same hour.
If someone can help me to "read" this log exactly, may I learn how to manage this problem.
It's not good, at all... see the storage space going full in some days like dashboad announce.
 

Attachments

Hi,

First you don't need to post the same 2 logs 2 times with different quotes (it's losses of time).

Second, it seems that you created a namespace "BKP-Pol-One-VM" inside a datastore named "BKP-Pol-One-VM" (that's why @UdoB was confused).

Third you need to check at the same time all your backup for the "BKP-Pol-One" datastore and check the "Size:" (which is in bytes if I'm not mistaken) of your VM to find out which one is "eating" your space.

Best regards,
 
  • Like
Reactions: Johannes S
could you also post the config of that VM (110)?
 
FWIW, those logs look okay (those backups uploaded <100 chunks each, and a chunk can be at most 4M). maybe check the other task logs for other VMs? there must be some VM with more churn ;)

maybe you could post all backup tasks for one of the datastores for the last three days, and the last three GC task logs of that datastore as well?
 
The dashboard shows the usage of the underlying file system. Is there anything else using it?

Could you provide the output of these commands? I took the datastore path from your prune logs.

Code: 
df -h /mnt/BKP-Pol-One/PBS
du --all --max-depth=1 --human-readable /mnt/BKP-Pol-One/PBS
 
You must log in or register to reply here.
Top Bottom
Back