Delta changes only instead of full LXC backup on Mount Points

[Stav1994]

Hi all,

I have a Turnkey File Server LXC with 4 Mount Points (7.1 TBs of total Data)
Every night i backup all my CTs and VMs and all but the Mount Points take minutes in time to backup. I am aware that 7.1 TBs is a lot of Data to backup and it normally takes 5 and a half hours everyday for that CT with the mount points to back up.
I would like to, if there is a way, have incremental delta backups for the mount points. Is this possible to do? as the mount points grow in size the full backups will only get longer and longer to backup.

Any guidance on this is appreciated

 

[tcabernoch]

Are you backing up to a Proxmox Backup Server? PBS has pretty extreme dedupe. Maybe the delay isn't quite where you think it is?
It has to read all your data in order to evaluate if its already present in the .chunks database, so that can take a while, but it will only upload a copy of that data once.

(If you are backing up to a NAS, ignore this.)

 

[Stav1994]

Yes, I am using a PBS server as a Backup Server, yes, as you can see per the attached image this CT File-Server has a 5 to 6 hour backup time and this is nearly every day/backup. hence why i posed the question

 

[tcabernoch]

Can I ask, what are the specs on your PBS server?

CPU - PBS is fairly single-threaded, extra cores don't help a lot. The most I've thrown at it is 16 physical cores.
RAM - It doesn't need a ton of ram. I provision about 2gb per core.

Network - 1gb or 10gb? Obviously this matters a ton.
Storage - SSD, right? Because PBS expects it to be SSD. And it matters.

 

[Stav1994]

The OS is only on an SSD the pool or datastore is 8 10TB WD Red Pro drives in RAIDZ2 as for the CPU its a repurposed i7-10700k from an earlier Proxmox Build. As for connection it's a 5Gbps pipe

 

[Neobin]

• https://pbs.proxmox.com/docs/technical-overview.html#change-detection-mode-for-file-based-backups
• https://pve.proxmox.com/pve-docs/chapter-vzdump.html#_ct_change_detection_mode