[SOLVED] Does verify "read" the whole data every time?

dekiesel

Member
Apr 30, 2023
88
12
13
I am considering using cold storage storage s3 for my backups since storing data is much cheaper, but:

When a verify runs, does it read the whole backup every time? Or just a certain percentage?

Reading from cold storage is much more expensive, which is why I'm trying to figure out how much data a verify reads from the remote.

Thanks!
 
Hey!

When a verify job runs, all chunks are read, there is no skipping at the chunk level.

When creating a verify job, you can enable "Skip Verified", which will skip already verified snapshots. Additionally, you may set "Re-Verify After" to force a reverification of the snapshots every X days.
 
  • Like
Reactions: dekiesel
Hi,
to add some more context to the answer already provided by @a.bied-charreton especially relevant to avoid costs from data egress with S3: Verfication jobs are optimized to only verify chunks once, not re-verifying it for each backup snapshot they are referenced by. Since a large number of chunks are very likely to be shared by subsequent incremental backup snapshots, it can make sense to not verify each snapshots individually, but rather in batches. A more lightweight verification option was requested and is tracked in https://bugzilla.proxmox.com/show_bug.cgi?id=4594