storj for s3 storage

D

daschmidt

Member
Proxmox Subscriber
Feb 5, 2023
79
8
13
Österreich
Good morning,

Has anyone successfully integrated Storj as S3? The permissions must be correct; I set up rclone successfully with the same credentials. When setting up the datastore, I get the following error: failed to access bucket: bucket does not exist or no permission to access it (400)

Code: 
s3-endpoint: storj
        access-key xxxxxx
        endpoint gateway.eu1.storjshare.io
        secret-key xxxxxx


tried it also gateway.storjshare.io
 
Please try setting the region accordingly (i guess it should be eu1 in your case?). To explain, the region is part of the aws sign v4 scheme used to authenticate requests to the api.
 
Also, forgot to mention that you should use the path style bucket addressing, as your bucket name is not part of the endpoint url.
 
  • Like
Reactions: igort and daschmidt
Hello,

I connected PBS ver. 4.0.20 to Storj bucket without any problems, but after upgrading to 4.1.0 and rebooting the server it no longer works - "Datastore is not available". What should I try?

Thanks.
 
Check if the datastore local cache path is correctly mounted, e.g. in the output of mount. Further, you can check if the s3 endpoint is reachabe by using proxmox-backup-manager s3 check <endpoint-id> <bucket-name>
 
I see the point. It was obviously a bad idea to set /tmp for Local Cache. The reboot probably deleted the /tmp/.chunks directory.
lookup_datastore failed - unable to open chunk store at "/tmp/.chunks" - No such file or directory (os error 2)

Is the solution to create /tmp/.chunks or how to change the Local Cache path for an existing S3 datastore?
 
igort said:
Is the solution to create /tmp/.chunks or how to change the Local Cache path for an existing S3 datastore?
Click to expand...
I would recommend to just remove the datastore without deleting any contents and then recreate it using the same name and enpdoint (with reuse datastore and overwrite in-use marker flags set) ,but with a persisten local store cache path. Further, you might want to set the cache up on a dedicated partition or with a quota, see https://pbs.proxmox.com/docs/storage.html#datastores-with-s3-backend
 
Last edited:
You must log in or register to reply here.
Top Bottom