pbs client backup performance tuning

DerDanilo

Famous Member
Jan 21, 2017
477
141
108
I just started testing the pbs backup client for some advanced backup scenarios. One question of course is how to get the maximum performance out of the server that creates backups.
In multiple larger infrastructures there are so called 'backupworkers' (VMs) who have plenty of CPU and RAM as well as 'read-only' access to certain filesystems/mounts. They create backups and handle snapshot schedules etc..

One setting allows specifying "Max number of entries loaded at once into memory".
--entries-max <integer> (0 - 9223372036854775807) (default=1048576):

Is this related to "Chunk size in KB. Must be a power of 2."?
--chunk-size <integer> (64 - 4096) (default=4096):
  • But how does one know how much the server can handle?
  • How does one calculate the entries-max value?
  • So available "RAM / chunk-size = entries-max" ? (Which wouldn't work with the default value on most systems)
  • What is the meaning of "entry" (entries) here?
Thanks in advance!

What I am also trying to achieve is a someonewhat interactive UI where support staff is able to check on customer backups and restore certain backups. Is there something on the roadmap that will allow LDAP login to the PBS UI and configure "service desk" roles that can only restore, never delete files?
 
  • Like
Reactions: Ultranium
@proxmox Team - no comment on this?

Could you please provide settings for the backup client that allows to use more CPU and parallel threads to speed up the backup process?
Until now it seems that it rund (more or less) single threaded. Running several folder/file Backup tasks locally allows to run tasks parallel. But it still will not speed up single backup tasks.

Thanks
 
  • Like
Reactions: jaff
Hi,
Did you by any chance found some tuning setting regarding entries-max or any other optimization to make your client send the backup faster to the backup server ?

In my case i can run 8 backup in parallel from 8 source servers, reaching 10gbit/s speed on the network and my PBS server is okay with that, but with one backup i see a bottleneck near 1.2gbit/s, regardless of the server i use in the other side