pbs client backup performance tuning

DerDanilo

Renowned Member
Jan 21, 2017
477
139
83
I just started testing the pbs backup client for some advanced backup scenarios. One question of course is how to get the maximum performance out of the server that creates backups.
In multiple larger infrastructures there are so called 'backupworkers' (VMs) who have plenty of CPU and RAM as well as 'read-only' access to certain filesystems/mounts. They create backups and handle snapshot schedules etc..

One setting allows specifying "Max number of entries loaded at once into memory".
--entries-max <integer> (0 - 9223372036854775807) (default=1048576):

Is this related to "Chunk size in KB. Must be a power of 2."?
--chunk-size <integer> (64 - 4096) (default=4096):
  • But how does one know how much the server can handle?
  • How does one calculate the entries-max value?
  • So available "RAM / chunk-size = entries-max" ? (Which wouldn't work with the default value on most systems)
  • What is the meaning of "entry" (entries) here?
Thanks in advance!

What I am also trying to achieve is a someonewhat interactive UI where support staff is able to check on customer backups and restore certain backups. Is there something on the roadmap that will allow LDAP login to the PBS UI and configure "service desk" roles that can only restore, never delete files?
 
  • Like
Reactions: Ultranium
@proxmox Team - no comment on this?

Could you please provide settings for the backup client that allows to use more CPU and parallel threads to speed up the backup process?
Until now it seems that it rund (more or less) single threaded. Running several folder/file Backup tasks locally allows to run tasks parallel. But it still will not speed up single backup tasks.

Thanks
 
  • Like
Reactions: jaff
Hi,
Did you by any chance found some tuning setting regarding entries-max or any other optimization to make your client send the backup faster to the backup server ?

In my case i can run 8 backup in parallel from 8 source servers, reaching 10gbit/s speed on the network and my PBS server is okay with that, but with one backup i see a bottleneck near 1.2gbit/s, regardless of the server i use in the other side
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!