Backup de-duplication, and general guidance?

79corvette

New Member
Jun 20, 2023
10
1
3
Is the preferred way to backup LXC and VMs in Proxmox to use the Backups tool in Datacenter -> Backups? By default these backups appear to be saved in the "local" filesystem. Is the idea that LXC backups will go here and then the entire pve disk (local + local-LVM, including the LXC backups) will be backed up somewhere else, ie to an external disk?

Also, is it possible to configure de-duplicated LXC backups through the Proxmox VE gui? I am just starting to learn Proxmox have a very simple setup to test/figure things out. Currently my backups appear to generate full snapshots of each LXC which over time will start to consume a significant amount of storage (see image).

Really appreciate any help you can offer!

1688348077138.png
 
Highly recommend using Proxmox Backup Server for this. It's a separate but related product for backing up Proxmox VE VMs. It handles deduplication and retention policies. For production use they recommend running it on separate hardware, but you can run it as a VM for testing.
 
  • Like
Reactions: Darkk
Highly recommend using Proxmox Backup Server for this. It's a separate but related product for backing up Proxmox VE VMs. It handles deduplication and retention policies. For production use they recommend running it on separate hardware, but you can run it as a VM for testing.

Thanks for your reply. I looked at Proxmox Backup Server briefly, but moved on when I saw the recommendation to use dedicated hardware. This will never be "production" in the sense that a corporation or large org will rely on it, but it will be part of my home lab and needs to be robust, stable and reliably backed up.

I'll do some more reading on Backup Server, but in your experience would it be reasonable to run permanently in a VM in this application or do I need a different solution?
 
Thanks for your reply. I looked at Proxmox Backup Server briefly, but moved on when I saw the recommendation to use dedicated hardware. This will never be "production" in the sense that a corporation or large org will rely on it, but it will be part of my home lab and needs to be robust, stable and reliably backed up.

I'll do some more reading on Backup Server, but in your experience would it be reasonable to run permanently in a VM in this application or do I need a different solution?
Against the official advice, I do run PBS in a VM in production. As long as you have the contents of the datastore and any encryption keys you can rebuild. Just be mindful to copy them elsewhere - rsync or rclone is fine. Official advice is also to keep the PBS datastore on SSDs, but I get by with an enterprise HDD and I've heard others also use HDDs. I suspect a consumer HDD would be fine for a home lab. Verification jobs do take a while on HDDs (about 5 hours/day in my setup), but I don't notice any detrimental effects.
 
Thanks everyone for your suggestions. Really appreciate it.

you can also install pbs packages on the proxmox node if you want. (for an homelab with a single node, it can be ok)

https://pbs.proxmox.com/docs/installation.html
"Install Proxmox Backup Server on Proxmox VE"
What are the disadvantages of doing this? Just more complex setup and less "interchangeability" of the host if you ever want to migrate to a different physical computer with a clean proxmox installation?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!