I'm trying out the new S3 backed datastore and realized that it doesn't seem to be possible to restore individual files from a backup like it can be done with container backups on a local disk. It's also not possibe to download the .didx file, which is possibly the cause of this unavailable feature?
I would like to be able to download individual files, especially from an S3 backup since restoring the full thing will take a lot of time (download) and cost money (egress traffic, requests). For a remote datastore like S3, being able to restore a small part of it seems like an important feature.
Might it be possible to keep enough information locally to enable this option? The didx file (if that would help) isn't very big and is certainly a lot smaller than the cache usage for the S3 datastore. At the moment, the S3 cache is the same size as the data on the bucket, is there a way to limit that size and keep most of the data only on S3?
I would like to be able to download individual files, especially from an S3 backup since restoring the full thing will take a lot of time (download) and cost money (egress traffic, requests). For a remote datastore like S3, being able to restore a small part of it seems like an important feature.
Might it be possible to keep enough information locally to enable this option? The didx file (if that would help) isn't very big and is certainly a lot smaller than the cache usage for the S3 datastore. At the moment, the S3 cache is the same size as the data on the bucket, is there a way to limit that size and keep most of the data only on S3?