PBS looses connection to storage after Tape backup.

M

moored99

Member
Jul 27, 2023
8
0
6
I have a PBS server v 2.4.3 - (PBS no subscription), latest updates:
250TB main datastore (7 daily backups, keep 4 weekly backups, keep 12 monthly backup, 5 yearly backups)
I backup about 12TB each night.
I have a 18TB USB disk attached. After the nightly backup it does a last backup sync copy. Which works well.
I have a Quantum Superstore 3, LTO8, 16 tape library which I do a backup on a saturday morning. and rotate through 15 weeks. (1 spot for tape clean)

Well that is supposed to be my stratergy.
Last weekend and the weekend before after a good backup to the Tape drive the PBS stopped reading the main datastore (250TB) and also the USB drive.
The weekend before I ended up just rebuilding the server from scratch
But this weekend the same problem happend, so I think I need to dig in and find out what is going wrong in stead of just rebuilding.

unable to open chunk store at "/mnt/datastore/storage/.chunks" - Permission denied (os error 13)
unable to open chunk store at "/mnt/datastore/USB-C-Backup/.chunks" - Permission denied (os error 13)
I have tried to fix the permissions on the datastore's using the following:

chmod -R 777 /mnt/datastore/storage
chmod -R 750 /mnt/datastore/storage/.chunks
find /mnt/datastore/storage -type d -exec chmod 755 {} +
find /mnt/datastore/storage/.chunks -type d -exec chmod 750 {} +
chmod -R 644 /mnt/datastore/storage/.lock
chmod -R 644 /mnt/datastore/storage/.gc-status

I then rebooted the PBS but I am still not getting the permission to see the datastores, I have checked that the drives are mounted and all ok I can see the vm folder and the VM's ie 100,101,102 etc.

I am not an expert on Linux so could sombody suggest where I start to look to diagnose this problem.
Last but not least, backups were working perfectly (since March with no issues) until I introduced the Tape drive library 2 weeks ago.
 
Last edited:
moored99 said:
unable to open chunk store at "/mnt/datastore/storage/.chunks" - Permission denied (os error 13)
unable to open chunk store at "/mnt/datastore/USB-C-Backup/.chunks" - Permission denied (os error 13)
Click to expand...
Make sure the datastores are mounted before the proxmox backup proxy and api services are started. It could be that these services are still trying to open the chunk store via the now overmounted directory.

moored99 said:
I have a PBS server v 2.4.3 - (PBS no subscription)
Click to expand...
This version is EOL and gets no security and bugfixes, please upgrade to the latest version available.
 
>Make sure the datastores are mounted before the proxmox backup proxy and api services are started
How do I make sure they are mounted first.?

My bad, I should have said PBS v 4.2.3 which I belive is the latest.
 
moored99 said:
unable to open chunk store at "/mnt/datastore/storage/.chunks" - Permission denied (os error 13)
unable to open chunk store at "/mnt/datastore/USB-C-Backup/.chunks" - Permission denied (os error 13)
Click to expand...
Hi, @moored99
What is the owner (I mean the Linux user and group) of the datastore directories and files?
It must be backup
 
I belive they all should be backup:backup

/mnt/datastore/storage
drwxrwxrwx 5 backup backup 6 Jul 14 17:21 storage
drwxrwxrwx 4 backup backup 4096 Jul 25 21:26 USB-C-Backup
drwxr-xr-x 2 backup backup 2 Jul 18 14:57 USB-D-Backup

/mnt/datastore/storage/vm
drwxrwxrwx 47 backup backup 47 Jul 14 20:03 vm
 
@moored99
What about .chunks ?

Besides, your current permissions are too open. drwxrwxrwx ( rwx for "other" users ) isn't secure.
r-x as well.

edit:
Mine, for reference:

Code: 
drwxr-x--- 65538 backup backup 65538 Sep  5  2025 .chunks/
-rw-r--r--     1 backup backup   310 Jul 26 23:19 .gc-status
-rw-r--r--     1 backup backup     0 Sep  5  2025 .lock
drwxr-xr-x     3 backup backup     3 Sep 10  2025 host/
drwxr-xr-x     3 backup backup     3 Sep  5  2025 ns/
 
Last edited:
You must log in or register to reply here.
Top Bottom
Back