Error for garbage collection: "Permission denied (os error 13) "

[antipiot]

Hello!

My PBS is configured to automatically do garbage collection tasks but it seems to fail:
TASK ERROR: IO error for operation on /mnt/datastore/datastore1/lost+found: Permission denied (os error 13)

Tried to trigger manually act the same:


Any hint?

 

[Stefan_R]

Garbage collection should run as root AFAIK, so this seems very strange. It it always that 'lost+found' directory? If so, you should be able to safely delete that, if you didn't use it to deliberately recover data. Try running a manualy GC afterwards to see if that fixed it.

If not, what are the permissions for /mnt/datastore/datastore1 ? Also, I'm assuming this is an external disk since it's under /mnt, what file system are you using?

 

[antipiot]

Yes it was always lost+found directory causing trouble.

As far as i know, i did not changed / edited anything related to this thus it had to be done on the system side.
Its on a VM on my PVE host for testing at the moment, so the drive is a virtual disk.
Used EXT4 as filesystem. created with PBS tools.



Here's datastore permissions


Here's lost+found permissions:


Corrected with

chown backup:backup "/mnt/datastore/datastore1/lost+found/"

now GC is working correctly:

 

[Stefan_R]

Are you sure you're using the newest version? I just tried replicating your problem but could not do so... Looking at the code we actually have a special rule to exclude the lost+found file, which should have prevented this.

 

[antipiot]

i guess so, installed with 1.0 ISO and updated with apt-get update / apt-get upgrade
Actually on

Backup Server 0.8-6
BETA

really strange

 

[Ansy]

Was:

TASK ERROR: cannot continue garbage-collection safely, permission denied on: /rpool/backup/basevol-100-disk-0/var/log/samba

Done some chmod g+r in /rpool/backup/basevol-100-disk-0/var/log, now stops in another directory:

TASK ERROR: cannot continue garbage-collection safely, permission denied on: /rpool/backup/basevol-100-disk-0/var/log/apache2

Then:

TASK ERROR: cannot continue garbage-collection safely, permission denied on: /rpool/backup/basevol-100-disk-0/var/cache/apt/partial
...
TASK ERROR: cannot continue garbage-collection safely, permission denied on: /rpool/backup/basevol-100-disk-0/var/cache/ldconfig

IMHO the trouble is somewhere else...

 

[Ansy]

Well, I've found the difference, what is that directory stopping garbage collection... it is cloned template of CT!
But why on earth it's here and messing things for PBS?
I'll delete it now and test garbage collection again.

 

[fabian]

that sounds like you somehow re-used a directory as PVE directory storage and PBS datastore, which is not a good idea..

 

[Ansy]

that sounds like you somehow re-used a directory as PVE directory storage and PBS datastore, which is not a good idea..

Yes, reused directory... not only directory, but ZFS volume -- somewhat hard to delete, because I've already wiped backup from PVE Storage in web interface, so deleting CT template failed... needed to recreate ZFS item there.

Finally, CT template has been purged, ZFS volume rpool/backup/basevol-100-disk-0 destroyed, all other than PBS' ct and vm directories too. Garbage collection finished OK now.