Recent content by rwithd

UPDATE 2 So we have been running this new setup for a month and a half. The preliminary conclusions have proved mostly correct. But I have implemented a few changes. Chiefly, the implementation of ZFS metadata devices. This significantly improves loading times when looking at the contents of...

UPDATE 1 Data Collection and Methodology: I used "Flexible I/O tester" (fio) with 1GB files and eight threads. This resulted in about 85% CPU usage and generated 8GB files to test with. Average usage was verified against GUI stats and AWS monitoring. Only 4k Random reads performed below...

How is verification handled on S3 storage? that sounds like it could get very expensive very quickly.

For some extra Data, I had AI throw this together for me: Clearly this is best case senario, sequential reads and writes. and does not take into account overhead from ZFS. Note: maximum EBS throughput is 1,250 MiB/s for the instance Option Per-vol (MiB/s) base / burst Array...

In a previous post, I discussed how an St1 Volume backs our remote backups on EC2. As we rapidly reached the Maximum size of an ST1 EBS Volume. ZFS has entered to save the day with v2.3 and the ability to quickly and easily add disks to zraids. On paper, an array of 4 8TB ST1 volumes should...

So, for now, we should stick with Instant retrieval? How does S3 interact with Backup Verification? Are the backups still verified on a regular basis or is that left to the object storage provider?

Side question: backing up LVM snapshots? good idea?

This is more of an "Am I just stupid" post. I have some legacy VMware VMs that I cannot move to Proxmox because of software licenses that are tied to (virtual) hardware. I have set up and configured our VMWare server to perform frequent backups. Of the /vmware mount point. It's standard stuff...

Any chance you could share that script if you made it?

Fiona, Thank you I will do that now.

When we started using PBS there were no namespaces. so we needed a retention policy that worked for EVERYTHING. that became policy, and we have the storage to accommodate it so why bother changing policy. Most backups are Daily... so we retain 142 days of daily backups. RDP and virtual...

Victor covered this perfectly. But also this is our active example. Yes that is what we do, We have local retention times that are not the same, our local retention times are geared more for user error, so short interval backups, that fade quickly over time. you do have to make sure you do not...

OK, I know that this is not an issue that most people are dealing with. 2023-02-02T09:27:20-06:00: sync group vm/105 failed - unable to acquire lock on snapshot directory "/mnt/datastore/PBS-01_ZFS-1/vm/105/2023-02-02T15:30:03Z" - locked by another operation We take backups of our Logging an...

Thanks Dominik, very helpful as always. I'll stick to 30 min intervals :P

That makes sense, I think I was just thinking about how to accomplish the task from the wrong direction. I think this would work too. which is closer to how I was imagining the problem. *:10/30. based on this in the provided documentation. How would I express running a task every 40 min for...