PBS 4 S3: Change local cache directory

[dw-cj]

Thank you for adding S3 support. I have a question and wasn't able to find the answer to in the docs.

I configured my S3 datastore with the 'local cache' set as a dedicated SSD. It turns out that SSD is going bad, and is very slow. How can I 'change' the local cache? Is it okay to delete all data in the folder and mount a fresh disk into that folder? Is there any way to see what has been synced and what is still living in local cache? How should I go about changing this.

 

[jiriteach]

Just remove the s3 datastore from PBS but make sure not to select -

Remove data from S3 bucket and local cache (dangerous!)

Then re-add the datastore with "Reuse existing datastore". It will reload from the S3 store. the local cache is temp for syncing. Will re-sync fine. I've done this several times.

 

[dw-cj]

Just remove the s3 datastore from PBS but make sure not to select -

Remove data from S3 bucket and local cache (dangerous!)

Then re-add the datastore with "Reuse existing datastore". It will reload from the S3 store. the local cache is on temp for syncing. Will re-sync fine. I've done this several times.

Thanks! Is there any way to know if its fully 'synced' before I do this?

 

[jiriteach]

Thanks! Is there any way to know if its fully 'synced' before I do this?

Yea - check the job and tasks. If all tasks are completed then it is.