[SOLVED] How much resources does the Proxmox backup functionality use?

hohl

Member
Jun 18, 2020
33
2
13
30
I'd be especially interest in how Proxmox handles the compression for backups? Is this done in RAM (does it require the entire disk to be loaded into RAM)? How would that work out with large VMs? Let's say, a virtual server that runs on a 800 GB virtual disk. Would this cause extreme pressure to RAM and CPU?

Currently, I'm running a large Proxmox host node with small VMs without issues (as in tons of RAM and each VM is usually somewhere in the 2 GB RAM, 25 GB disks, ... range). However, at another host with limited RAM and CPU power, but only few VMs with large disks (multiples of 100 GB up to 800 GB) and the system seems to get unresponsive during backups (VMs run slow and the Proxmox interface gets completely unusable). Looking at monitoring it seems the otherwise mostly under-utilized nodes jumps to heavy loads (system load > CPU count and heavy disk I/O, although disk I/O probably is expectable of course). So I'm wondering what I could do to improve the situation (besides increasing the specs of the host).

As it's the default choice, I'm using ZSTD. Might this cause this quite some load? How does the compression work? Is compression done in a streaming fashion and should it scale well with large disks or is trying compression on 800 GB disks a bad idea in general?


EDIT: Never mind, the issues still persist even when using RAW backups and in both cases the system gets unresponsive after ~280 GiB. However, if anybody has any ideas why these issues might occur I'd still be looking for ideas.

EDIT2: Odd. After trying multiple different setups, it only seems to occur when using NFS shares for the backups (doesn't matter whether they are local as in same rack or off-site either). Well, probably a sign I should finally transition everything to PBS. ;)

Can be considered solved for me.
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!