S3 object retention

[asteffen]

I was looking at setting up a S3 based datastore and wanted to setup immutable objects for all of the chunks and index files for the snapshots. My plan was to set up a bucket with a default compliance mode so all new objects are immutable for 7 days. The problem is this only protects the initial chunks for 7 days. Any chunk that is referenced by a snapshot created after those 7 days would no longer be immutable.

Is there a way for a sync job to extend the retention period of all of the chunks it references?

The reason for 7 days is so chunks can age out and get garbage collected.

 

[Chris]

Hi,
immutable objects are currently not supported by the PBS S3 implementation, this is tracked as issue https://bugzilla.proxmox.com/show_bug.cgi?id=6780

Garbage collection must be handled by the PBS, not by retention settings of the S3 backend. In PBS, chunks are marked as in use if still referenced by an index file and only deleted if no longer used by any snapshot during garbage collection.

 

[asteffen]

Ah, thank you for finding that. I now see in the original bug tracker for implementing S3 support that object locking was not included initially but may be considered in the future.