s3 backup local cache

jamesdev

Member
Feb 6, 2021
2
0
21
38
Hi,

I didn't see this anywhere in docs or search. When I set up the s3 datastore for s3 it asks for local cache. I tried using my OS disk but it started using too much space. I'm setting it up again to use a new folder in my ZFS pool. I was wondering, when I set up the Sync Job to pull my other backups into this datastore, is it always going to duplicate my other backups using the same amount of disk space? Is it going to delete these files at a certain threshold? I guess I'm trying to understand how much data will go into the local s3 datastore cache. I have 23TB of files I want to push to s3 so I want to make sure I get this right the first time.

Thanks for any help!
 
Disregard. I figured it out after reading through the docs again. You limit the size of the cache location.
I just applied (probably overkill) zfs set quota=2T backup/s3-cache