proxmox-backup-client rate limit

[spearox]

Hi,

Its possible to limit the backup to 100Mb/s instead of 1Gb/s?
I got this error: Error: parameter verification failed - 'rate': value must have a minimum value of 100000 (got 10000)

I'll try to use this command:
proxmox-backup-client backup test.pxar:/root --keyfile /root/backup.key --rate 10000

But with 100.000 the speed around 1Gb/s.

 

[UdoB]

Well..., did you look into the man page? It tells me

       --rate <integer> (100000 - N)
              Rate limit (for Token bucket filter) in bytes/second.

So "--rate 100000000" should be 100MByte/s

 

[spearox]

Ofc i read the man page first, this is why i write here.
If i use the 100.000 (minimum) its near 100MByte/s in real.

Check the proof:
I have 1G size test file for backup and it clearly say the speed and you can see on the time its soo fast.

root@xxxxxxxx:~# ls -lh
összesen 1,1G
-rw-r--r-- 1 root root 1,0G 2021 jún   16 1GB.bin
-rw------- 1 root root  256 júl    5 16.58 backup.key
-rw-r--r-- 1 root root  302 júl    5 16.57 backup.sh
-rw-r--r-- 1 root root  267 júl   13 19.49 test.sh
root@xxxxxxxx:~# proxmox-backup-client backup test.pxar:/root --keyfile /root/backup.key --rate 100000
Starting backup: host/xxxxxxxx/2024-07-13T17:51:06Z
Client name: xxxxxxxx
Starting backup protocol: Sat Jul 13 19:51:06 2024
Using encryption key from '/root/backup.key'..
Encryption key fingerprint: a7:7f:ee:50:98:f7:fd:0a
storing login ticket failed: $XDG_RUNTIME_DIR must be set
Downloading previous manifest (Sat Jul 13 18:00:01 2024)
Upload directory '/root' to 'xxxx@pbs@pbsxxx:8007:backup2' as test.pxar.didx
Previous manifest does not contain an archive called 'test.pxar.didx', skipping download..
test.pxar: had to backup 1 GiB of 1 GiB (compressed 1 GiB) in 10.38s
test.pxar: average backup speed: 98.636 MiB/s
Uploaded backup catalog (559 B)
Duration: 10.93s
End Time: Sat Jul 13 19:51:17 2024
root@xxxxxxxx:~#

Also there is a picture about the traffic in the interface while running the backup.


So maybe I found a bug or misunderstand something.

 

[UdoB]

So maybe I found a bug or misunderstand something.

Then I am in the same boat Perhaps some other forum user can tell us what we misunderstand. Unfortunately I can not test it now.

Another guess: is this the first time you backup this 1GB.bin? Probably not? Only differences are transmitted over the wire, if checksuming shows that the data is "new". Or is that file empty (sparse) and compressable by a factor of a million or so?

Create another fresh non-empty and not-compressable file like dd if=/dev/urandom bs=1M count=1000 of=test1gb.random and try again. If you want to repeat the test: create another file first.

If these ideas are wrong you may cross check https://bugzilla.proxmox.com/ and create a new bug.

 

[spearox]

As you can see on the prev task log its not reused, clean backup. And you can see the interface usage too.

Previous manifest does not contain an archive called 'test.pxar.didx', skipping download..
test.pxar: had to backup 1 GiB of 1 GiB (compressed 1 GiB) in 10.38s

Ofc I do the new test file generation and backup. The result same.

root@xxxxxx:~# ls -lh
összesen 2,0G
-rw-r--r-- 1 root root  1,0G 2021 jún   16 1GB.bin
-rw------- 1 root root   256 júl    5 16.58 backup.key
-rw-r--r-- 1 root root   302 júl    5 16.57 backup.sh
-rw-r--r-- 1 root root 1000M júl   13 21.30 test1gb.random
-rw-r--r-- 1 root root   267 júl   13 19.49 test.sh
root@xxxxxx:~# proxmox-backup-client backup test.pxar:/root --keyfile /root/backup.key --rate 100000
Starting backup: host/xxxxxx/2024-07-13T19:30:41Z
Client name: xxxxxx
Starting backup protocol: Sat Jul 13 21:30:41 2024
Using encryption key from '/root/backup.key'..
Encryption key fingerprint: a7:7f:ee:50:98:f7:fd:0a
storing login ticket failed: $XDG_RUNTIME_DIR must be set
Downloading previous manifest (Sat Jul 13 19:51:06 2024)
Upload directory '/root' to 'xxxx@pbs@xxxxxx:8007:backup2' as test.pxar.didx
test.pxar: had to backup 1005.068 MiB of 1.977 GiB (compressed 1005.07 MiB) in 12.33s
test.pxar: average backup speed: 81.546 MiB/s
test.pxar: backup was done incrementally, reused 1018.949 MiB (50.3%)
Uploaded backup catalog (585 B)
Duration: 20.07s
End Time: Sat Jul 13 21:31:01 2024
root@xxxxxx:~#

 

[spearox]

UP!
Anyone can help me please?

 

[dcsapak]

Hi,

sorry for the late answer, yes I can reproduce that and did open a bug: https://bugzilla.proxmox.com/show_bug.cgi?id=5622

you can add yourself there and will then get an update when we update the bug with new infos (e.g. when it's fixed)

 

[spearox]

Hi,

sorry for the late answer, yes I can reproduce that and did open a bug: https://bugzilla.proxmox.com/show_bug.cgi?id=5622

you can add yourself there and will then get an update when we update the bug with new infos (e.g. when it's fixed)

Ahh good news. Thanks!