Wish: Amazon S3 integration
- Thread starter guyman
- Start date
No integration planned. The backup writes one big file (GB/TB size) and needs local network speeds to transport the data to the storage. But, you can use hook scripts to move the backup file to amazon S3 after backup.
https://pve.proxmox.com/pve-docs/chapter-vzdump.html#_hook_scripts
https://pve.proxmox.com/pve-docs/chapter-vzdump.html#_hook_scripts
Here is an example from another user:
https://forum.proxmox.com/threads/backup-mysql-database.16764/
The encryption is crucial if you want to store backups in a cloud in the EU.
Bacula Systems
New Member
You could try Bacula Community or Enterprise instead. They both have encryption, however you'll have to include a third-party system in the process.
https://forum.proxmox.com/threads/proxmox-backup-solution-from-bacula-systems.43731/
Hi LnxBil
thanks for the reference post, had a quick look at the script and its quiet straight forward.
What i would prefer is to have these additional features:
- incorporate some sort of process for error checking once the backup is uploaded (verify)
- Another process here that just slipped my mind
- ability to pull from S3 > local and restore or restore directly from S3 > verify
just food for thought.
Hence why i thought to have the script custom developed by the PVE team as a paid project and it could be offered back to the community in a future release as a feature.
""Cheers
G
Unfortunately, you cannot. The VMA file itself is not deduplicable, however, the extracted block image is.
If you're familiar with administration of Linux servers, another approach would be mounting S3 buckets using s3fs. You could then add the mounted directory as backup storage. Feel free to read the s3fs-fuse README to get an idea how to do that and possible pitfalls of it.
In case you have very large VMs to backup, I'd not recommend storing backups on any servers outside of the local datacenter for obvious performance reasons.
In case you have very large VMs to backup, I'd not recommend storing backups on any servers outside of the local datacenter for obvious performance reasons.