s3 backup local cache

[jamesdev]

Hi,

I didn't see this anywhere in docs or search. When I set up the s3 datastore for s3 it asks for local cache. I tried using my OS disk but it started using too much space. I'm setting it up again to use a new folder in my ZFS pool. I was wondering, when I set up the Sync Job to pull my other backups into this datastore, is it always going to duplicate my other backups using the same amount of disk space? Is it going to delete these files at a certain threshold? I guess I'm trying to understand how much data will go into the local s3 datastore cache. I have 23TB of files I want to push to s3 so I want to make sure I get this right the first time.

Thanks for any help!

 

[jamesdev]

Disregard. I figured it out after reading through the docs again. You limit the size of the cache location.
I just applied (probably overkill) zfs set quota=2T backup/s3-cache

 

[jamesdev]

Hey, I'm back. The disk I set as cache filled up and isn't clearing. It seems like it's treating it as an actual backup location instead.

Getting:

2025-12-22T11:56:24-07:00: skipped: 31 snapshot(s) (2025-11-27T18:28:06Z .. 2025-12-16T20:26:22Z) - older than the newest snapshot present on sync target

2025-12-22T11:56:24-07:00: re-sync snapshot host/2025-12-17T06:00:05Z

2025-12-22T11:56:24-07:00: percentage done: 2.63% (8/310 groups, 1/6 snapshots in group #9)

2025-12-22T11:56:24-07:00: sync group host/- Disk quota exceeded (os error 122)

2025-12-22T11:56:29-07:00: skipped: 31 snapshot(s) (2025-11-27T18:29:43Z .. 2025-12-16T20:26:22Z) - older than the newest snapshot present on sync target

2025-12-22T11:56:29-07:00: re-sync snapshot host/2025-12-17T06:00:05Z

2025-12-22T11:56:29-07:00: percentage done: 2.96% (9/310 groups, 1/6 snapshots in group #10)

Can anyone help me out? How do I pull data from another backup datastore into this one so it goes to S3?

datastore: aws-s3-backup
        backend bucket=oht-cephfs-pbs-offsite,client=oht-cephfs-pbs-offsite,type=s3
        comment aws
        gc-schedule sat 18:15
        notification-mode notification-system
        path /backup/s3-cache
root@pbs:~#

I was hoping to have this running over the holiday, so I'm caught up next week. Any ideas?

Thanks

 

[jamesdev]

Okay, so I guess I should have done more searching. Looks like it was a bug, I updated and ran garbage collection. Looks like it's freeing up space. I think everything is good now