dirty-bitmap status: existing bitmap was invalid and has been cleared - every.single.time!

P

proxwolfe

Well-Known Member
Jun 20, 2020
526
62
48
50
Hi,

I have a three node PVE cluster running with a few VMs.

One of them, I back up every two hours.

And every time the backup runs (and completes successfully) the dirty bitmap from the previous run is - allegedly - invalid and is cleared. And so the backup (currently shy of 600GiB) takes forever.

Since there are no errors, I have no idea where to start debugging this.

How can it be that the dirty bitmap is invalid every single time, after less than two hours?

Any ideas?

Thanks!
 
What type of backup are you running? As soon as the VM is stopped the dirty-bitmap will become invalid. A "stop mode" backup for example won't be able to use any dirty-bitmapping because it will stop the VM before each backup.
 
Hi,
is this only a single backup job or do you have multiple jobs to different targets (different namespace also counts!)? Please share the VM configuration and backup log on both Proxmox VE and PBS side, and the output of pveversion -v and
proxmox-backup-manager versions --verbose.
 
  • Like
Reactions: leesteken
ah, yes. There are two backup jobs for this VM to different targets (I am in the process of migrating from my old PBS installation to a new one).

I have disabled one and will report back.
 
proxwolfe said:
ah, yes. There are two backup jobs for this VM to different targets (I am in the process of migrating from my old PBS installation to a new one).
Click to expand...
Then it's expected, because the bitmap is only valid for a given target (and we don't save multiple bitmaps).
proxwolfe said:
I have disabled one and will report back.
Click to expand...
If it still doesn't work, something weird is going on.
 
fiona said:
Then it's expected, because the bitmap is only valid for a given target (and we don't save multiple bitmaps).
Click to expand...
Hi, and is it possible to do so? Save one bitmap by (pbs,namespace) couple?

More and more PVE users have multiple target PBS...

Regards,

Christophe.
 
christophe said:
More and more PVE users have multiple target PBS...
Click to expand...
IMHO it's better to use PBS sync to copy backups from one PBS to another instead of doing backup of the VM multiple times, even if PVE could use multiple dirty-maps for a few PBS. Less load on source PVE, less load on VMs and you offload the responsibility of doing the second backup replica to the backup server.
 
Last edited:
  • Like
Reactions: fiona
  • Like
Reactions: christophe
VictorSTS said:
IMHO it's better to use PBS sync to copy backups from one PBS to another instead of doing backup of the VM multiple times, even if PVE could use multiple dirty-maps for a few PBS. Less load on source PVE, less load on VMs and you offload the responsibility of doing the second backup replica to the backup server.
Click to expand...
Well, it's also my point but some users asked for such a feature.
 
You must log in or register to reply here.
Top Bottom