dirty image too big

A

ayozeve

Member
Oct 16, 2020
23
3
8
36
Hi, first of all thank you for the work you do with the backup server, the software and its integration with proxmox is great.

I have a client who has a porxmox 7.2 machine (Windows server 2012 r2) that contains a 700 GB hard drive (virtio). Well, every day when making backup copies with the backup server, a copy of over 500 GB of space is generated, which is almost the entire system.

My question would be if there is any way to verify the reason why the copies are generated with such a large size and if there is any method to better check it and find out what it is due to.

Regards!
 
I thought about that at first, but defragmentation is disabled since ssd drives are used, and also the "ssd emulation" and "discard" option of the drive is checked.
 
Ok, I attach bakups log:


Code: 
INFO: starting new backup job: vzdump 100 101 102 --quiet 1 --mailto XXX --mode snapshot --mailnotification failure --storage XXX
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2022-07-07 20:00:03
INFO: status = running
INFO: VM Name: XXX
INFO: include disk 'scsi0' 'DATOS:vm-103-disk-0' 1T
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating Proxmox Backup Server archive 'vm/100/2022-07-07T19:00:03Z'
INFO: issuing guest-agent 'fs-freeze' command
INFO: enabling encryption
INFO: issuing guest-agent 'fs-thaw' command
ERROR: VM 100 qmp command 'guest-fsfreeze-thaw' failed - got timeout
INFO: started backup task '9cd26f19-e6db-4464-b51f-49eb7c53d8bc'
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: OK (490.8 GiB of 1.0 TiB dirty)
INFO: using fast incremental mode (dirty-bitmap), 490.8 GiB dirty of 1.0 TiB total
INFO:   0% (752.0 MiB of 490.8 GiB) in 3s, read: 250.7 MiB/s, write: 250.7 MiB/s
INFO:   1% (4.9 GiB of 490.8 GiB) in 2m 47s, read: 26.1 MiB/s, write: 26.1 MiB/s
INFO:   2% (9.8 GiB of 490.8 GiB) in 6m 4s, read: 25.5 MiB/s, write: 25.5 MiB/s
INFO:   3% (14.7 GiB of 490.8 GiB) in 9m 7s, read: 27.5 MiB/s, write: 27.5 MiB/s
INFO:   4% (19.7 GiB of 490.8 GiB) in 12m 17s, read: 26.5 MiB/s, write: 26.5 MiB/s
INFO:   5% (24.6 GiB of 490.8 GiB) in 15m 24s, read: 26.9 MiB/s, write: 26.8 MiB/s
INFO:   6% (29.5 GiB of 490.8 GiB) in 18m 21s, read: 28.3 MiB/s, write: 28.3 MiB/s
INFO:   7% (34.4 GiB of 490.8 GiB) in 21m 8s, read: 30.2 MiB/s, write: 30.0 MiB/s
INFO:   8% (39.3 GiB of 490.8 GiB) in 24m 19s, read: 26.2 MiB/s, write: 26.2 MiB/s
INFO:   9% (44.2 GiB of 490.8 GiB) in 27m 28s, read: 26.6 MiB/s, write: 26.5 MiB/s
INFO:  10% (49.1 GiB of 490.8 GiB) in 30m 30s, read: 27.6 MiB/s, write: 27.6 MiB/s
INFO:  11% (54.0 GiB of 490.8 GiB) in 33m 33s, read: 27.5 MiB/s, write: 27.5 MiB/s
INFO:  12% (58.9 GiB of 490.8 GiB) in 36m 31s, read: 28.1 MiB/s, write: 28.1 MiB/s
INFO:  13% (63.8 GiB of 490.8 GiB) in 41m 1s, read: 18.6 MiB/s, write: 18.5 MiB/s
INFO:  14% (68.7 GiB of 490.8 GiB) in 44m 11s, read: 26.5 MiB/s, write: 26.4 MiB/s
INFO:  15% (73.6 GiB of 490.8 GiB) in 47m 9s, read: 28.2 MiB/s, write: 28.2 MiB/s
INFO:  16% (78.6 GiB of 490.8 GiB) in 49m 58s, read: 29.9 MiB/s, write: 29.8 MiB/s
INFO:  17% (83.5 GiB of 490.8 GiB) in 53m 12s, read: 26.0 MiB/s, write: 25.9 MiB/s
INFO:  18% (88.4 GiB of 490.8 GiB) in 56m 8s, read: 28.4 MiB/s, write: 28.3 MiB/s
INFO:  19% (93.3 GiB of 490.8 GiB) in 59m 20s, read: 26.2 MiB/s, write: 26.1 MiB/s
INFO:  20% (98.2 GiB of 490.8 GiB) in 1h 2m 16s, read: 28.5 MiB/s, write: 25.6 MiB/s
INFO:  21% (103.1 GiB of 490.8 GiB) in 1h 6m 6s, read: 21.8 MiB/s, write: 21.7 MiB/s
INFO:  22% (108.0 GiB of 490.8 GiB) in 1h 9m 46s, read: 22.8 MiB/s, write: 22.7 MiB/s
INFO:  23% (112.9 GiB of 490.8 GiB) in 1h 13m 26s, read: 22.8 MiB/s, write: 22.8 MiB/s
INFO:  24% (117.8 GiB of 490.8 GiB) in 1h 17m 9s, read: 22.6 MiB/s, write: 22.6 MiB/s
INFO:  25% (122.7 GiB of 490.8 GiB) in 1h 20m 38s, read: 23.9 MiB/s, write: 23.9 MiB/s
INFO:  26% (127.6 GiB of 490.8 GiB) in 1h 24m 35s, read: 21.2 MiB/s, write: 21.2 MiB/s
INFO:  27% (132.5 GiB of 490.8 GiB) in 1h 28m 21s, read: 22.2 MiB/s, write: 22.2 MiB/s
INFO:  28% (137.5 GiB of 490.8 GiB) in 1h 31m 50s, read: 24.1 MiB/s, write: 24.1 MiB/s
INFO:  29% (142.4 GiB of 490.8 GiB) in 1h 36m 3s, read: 19.8 MiB/s, write: 19.8 MiB/s
INFO:  30% (147.3 GiB of 490.8 GiB) in 1h 41m 42s, read: 14.9 MiB/s, write: 14.7 MiB/s
INFO:  31% (152.2 GiB of 490.8 GiB) in 1h 47m 15s, read: 15.0 MiB/s, write: 15.0 MiB/s
INFO:  32% (157.1 GiB of 490.8 GiB) in 1h 51m 5s, read: 21.9 MiB/s, write: 21.9 MiB/s
INFO:  33% (162.0 GiB of 490.8 GiB) in 1h 54m 42s, read: 23.1 MiB/s, write: 23.1 MiB/s
INFO:  34% (166.9 GiB of 490.8 GiB) in 1h 57m 34s, read: 29.2 MiB/s, write: 29.2 MiB/s
INFO:  35% (171.8 GiB of 490.8 GiB) in 2h 1m 35s, read: 20.9 MiB/s, write: 20.6 MiB/s
INFO:  36% (176.7 GiB of 490.8 GiB) in 2h 6m 16s, read: 17.9 MiB/s, write: 17.2 MiB/s
INFO:  37% (181.6 GiB of 490.8 GiB) in 2h 10m 44s, read: 18.8 MiB/s, write: 18.8 MiB/s
INFO:  38% (186.5 GiB of 490.8 GiB) in 2h 15m 13s, read: 18.6 MiB/s, write: 18.1 MiB/s
INFO:  39% (191.4 GiB of 490.8 GiB) in 2h 19m 30s, read: 19.6 MiB/s, write: 18.9 MiB/s
INFO:  40% (196.3 GiB of 490.8 GiB) in 2h 23m 13s, read: 22.5 MiB/s, write: 20.7 MiB/s
INFO:  41% (201.2 GiB of 490.8 GiB) in 2h 26m 52s, read: 22.9 MiB/s, write: 22.0 MiB/s
INFO:  42% (206.1 GiB of 490.8 GiB) in 2h 30m 43s, read: 21.7 MiB/s, write: 21.7 MiB/s
INFO:  43% (211.1 GiB of 490.8 GiB) in 2h 34m 1s, read: 25.5 MiB/s, write: 24.1 MiB/s
INFO:  44% (216.0 GiB of 490.8 GiB) in 2h 37m 10s, read: 26.5 MiB/s, write: 24.7 MiB/s
INFO:  45% (220.9 GiB of 490.8 GiB) in 2h 40m 8s, read: 28.2 MiB/s, write: 25.5 MiB/s
INFO:  46% (225.8 GiB of 490.8 GiB) in 2h 43m 20s, read: 26.2 MiB/s, write: 24.3 MiB/s
INFO:  47% (230.7 GiB of 490.8 GiB) in 2h 46m 31s, read: 26.3 MiB/s, write: 25.0 MiB/s
INFO:  48% (235.6 GiB of 490.8 GiB) in 2h 49m 37s, read: 27.0 MiB/s, write: 25.7 MiB/s
INFO:  49% (240.5 GiB of 490.8 GiB) in 2h 52m 50s, read: 26.1 MiB/s, write: 25.3 MiB/s
INFO:  50% (245.4 GiB of 490.8 GiB) in 2h 55m 57s, read: 27.0 MiB/s, write: 26.0 MiB/s
INFO:  51% (250.3 GiB of 490.8 GiB) in 2h 58m 57s, read: 27.8 MiB/s, write: 26.4 MiB/s
INFO:  52% (255.2 GiB of 490.8 GiB) in 3h 1m 55s, read: 28.2 MiB/s, write: 26.6 MiB/s
INFO:  53% (260.2 GiB of 490.8 GiB) in 3h 5m, read: 27.3 MiB/s, write: 25.7 MiB/s
INFO:  54% (265.1 GiB of 490.8 GiB) in 3h 7m 47s, read: 30.1 MiB/s, write: 28.3 MiB/s
INFO:  55% (270.0 GiB of 490.8 GiB) in 3h 10m 48s, read: 27.7 MiB/s, write: 25.7 MiB/s
INFO:  56% (274.9 GiB of 490.8 GiB) in 3h 13m 34s, read: 30.2 MiB/s, write: 28.4 MiB/s
INFO:  57% (279.8 GiB of 490.8 GiB) in 3h 16m 28s, read: 29.0 MiB/s, write: 27.7 MiB/s
INFO:  58% (284.7 GiB of 490.8 GiB) in 3h 19m 9s, read: 31.1 MiB/s, write: 28.9 MiB/s
INFO:  59% (289.6 GiB of 490.8 GiB) in 3h 22m 9s, read: 28.0 MiB/s, write: 26.2 MiB/s
INFO:  60% (294.5 GiB of 490.8 GiB) in 3h 25m 26s, read: 25.4 MiB/s, write: 24.1 MiB/s
INFO:  61% (299.4 GiB of 490.8 GiB) in 3h 30m 1s, read: 18.3 MiB/s, write: 17.8 MiB/s
INFO:  62% (304.3 GiB of 490.8 GiB) in 3h 32m 51s, read: 29.5 MiB/s, write: 27.7 MiB/s
INFO:  63% (309.2 GiB of 490.8 GiB) in 3h 35m 57s, read: 27.1 MiB/s, write: 25.5 MiB/s
INFO:  64% (314.1 GiB of 490.8 GiB) in 3h 38m 40s, read: 30.9 MiB/s, write: 28.2 MiB/s
INFO:  65% (319.0 GiB of 490.8 GiB) in 3h 41m 36s, read: 28.5 MiB/s, write: 26.6 MiB/s
INFO:  66% (323.9 GiB of 490.8 GiB) in 3h 44m 28s, read: 29.2 MiB/s, write: 27.4 MiB/s
INFO:  67% (328.9 GiB of 490.8 GiB) in 3h 47m 33s, read: 27.3 MiB/s, write: 25.8 MiB/s
INFO:  68% (333.8 GiB of 490.8 GiB) in 3h 50m 23s, read: 29.7 MiB/s, write: 28.9 MiB/s
INFO:  69% (338.7 GiB of 490.8 GiB) in 3h 53m 16s, read: 28.9 MiB/s, write: 28.1 MiB/s
INFO:  70% (343.6 GiB of 490.8 GiB) in 3h 57m 25s, read: 20.1 MiB/s, write: 19.5 MiB/s
INFO:  71% (348.5 GiB of 490.8 GiB) in 4h 2m 37s, read: 16.1 MiB/s, write: 15.3 MiB/s
INFO:  72% (353.4 GiB of 490.8 GiB) in 4h 7m 51s, read: 16.0 MiB/s, write: 15.3 MiB/s
INFO:  73% (358.3 GiB of 490.8 GiB) in 4h 12m 51s, read: 16.8 MiB/s, write: 15.4 MiB/s
INFO:  74% (363.2 GiB of 490.8 GiB) in 4h 20m 7s, read: 11.5 MiB/s, write: 10.6 MiB/s
INFO:  75% (368.1 GiB of 490.8 GiB) in 4h 27m 3s, read: 12.1 MiB/s, write: 11.4 MiB/s
INFO:  76% (373.0 GiB of 490.8 GiB) in 4h 31m 50s, read: 17.5 MiB/s, write: 16.6 MiB/s
INFO:  77% (377.9 GiB of 490.8 GiB) in 4h 37m 12s, read: 15.6 MiB/s, write: 14.6 MiB/s
INFO:  78% (382.8 GiB of 490.8 GiB) in 4h 41m 55s, read: 17.8 MiB/s, write: 17.0 MiB/s
INFO:  79% (387.8 GiB of 490.8 GiB) in 4h 47m 28s, read: 15.1 MiB/s, write: 13.9 MiB/s
INFO:  80% (392.7 GiB of 490.8 GiB) in 4h 53m 16s, read: 14.4 MiB/s, write: 13.7 MiB/s
INFO:  81% (397.6 GiB of 490.8 GiB) in 4h 58m 9s, read: 17.2 MiB/s, write: 16.2 MiB/s
INFO:  82% (402.5 GiB of 490.8 GiB) in 5h 3m 35s, read: 15.4 MiB/s, write: 14.9 MiB/s
INFO:  83% (407.4 GiB of 490.8 GiB) in 5h 8m 24s, read: 17.4 MiB/s, write: 16.7 MiB/s
INFO:  84% (412.3 GiB of 490.8 GiB) in 5h 12m 56s, read: 18.5 MiB/s, write: 18.0 MiB/s
INFO:  85% (417.2 GiB of 490.8 GiB) in 5h 17m 31s, read: 18.3 MiB/s, write: 17.8 MiB/s
INFO:  86% (422.1 GiB of 490.8 GiB) in 5h 22m 7s, read: 18.2 MiB/s, write: 18.0 MiB/s
INFO:  87% (427.0 GiB of 490.8 GiB) in 5h 26m 27s, read: 19.3 MiB/s, write: 18.8 MiB/s
INFO:  88% (431.9 GiB of 490.8 GiB) in 5h 30m 43s, read: 19.7 MiB/s, write: 19.3 MiB/s
INFO:  89% (436.8 GiB of 490.8 GiB) in 5h 35m 26s, read: 17.7 MiB/s, write: 17.3 MiB/s
INFO:  90% (441.8 GiB of 490.8 GiB) in 5h 40m 14s, read: 17.5 MiB/s, write: 17.0 MiB/s
INFO:  91% (446.7 GiB of 490.8 GiB) in 5h 45m 13s, read: 16.8 MiB/s, write: 16.3 MiB/s
INFO:  92% (451.6 GiB of 490.8 GiB) in 5h 50m, read: 17.5 MiB/s, write: 16.9 MiB/s
INFO:  93% (456.5 GiB of 490.8 GiB) in 5h 55m 8s, read: 16.3 MiB/s, write: 15.8 MiB/s
INFO:  94% (461.4 GiB of 490.8 GiB) in 6h 51s, read: 14.6 MiB/s, write: 14.3 MiB/s
INFO:  95% (466.3 GiB of 490.8 GiB) in 6h 6m 10s, read: 15.8 MiB/s, write: 15.5 MiB/s
INFO:  96% (471.2 GiB of 490.8 GiB) in 6h 10m 52s, read: 17.9 MiB/s, write: 17.1 MiB/s
INFO:  97% (476.1 GiB of 490.8 GiB) in 6h 15m 21s, read: 18.7 MiB/s, write: 18.0 MiB/s
INFO:  98% (481.0 GiB of 490.8 GiB) in 6h 19m 29s, read: 20.3 MiB/s, write: 19.2 MiB/s
INFO:  99% (485.9 GiB of 490.8 GiB) in 6h 23m 49s, read: 19.4 MiB/s, write: 18.1 MiB/s
INFO: 100% (490.8 GiB of 490.8 GiB) in 6h 27m 50s, read: 20.8 MiB/s, write: 19.1 MiB/s
INFO: backup is sparse: 812.00 MiB (0%) total zero data
INFO: backup was done incrementally, reused 549.20 GiB (53%)
INFO: transferred 490.82 GiB in 23293 seconds (21.6 MiB/s)
INFO: Finished Backup of VM 100 (06:29:28)
INFO: Backup finished at 2022-07-08 02:29:31
INFO: Starting Backup of VM 101 (lxc)
INFO: Backup started at 2022-07-08 02:29:31
INFO: status = running
INFO: CT Name: Debian
INFO: including mount point rootfs ('/') in backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: create storage snapshot 'vzdump'
INFO: creating Proxmox Backup Server archive 'ct/101/2022-07-08T01:29:31Z'
INFO: run: lxc-usernsexec -m u:0:100000:65536 -m g:0:100000:65536 -- /usr/bin/proxmox-backup-client backup --crypt-mode=encrypt --keyfd=11 pct.conf:/var/tmp/vzdumptmp1150383_101/etc/vzdump/pct.conf root.pxar:/mnt/vzsnap0 --include-dev /mnt/vzsnap0/./ --skip-lost-and-found --exclude=/tmp/?* --exclude=/var/tmp/?* --exclude=/var/run/?*.pid --backup-type ct --backup-id 101 --backup-time 1657243771 --repository XXX
INFO: Starting backup: ct/101/2022-07-08T01:29:31Z
INFO: Client name: XXX
INFO: Starting backup protocol: Fri Jul  8 02:29:31 2022
INFO: Using encryption key from file descriptor..
INFO: Encryption key fingerprint: 68:f5:17:28:1b:99:55:04
INFO: Downloading previous manifest (Wed Jul  6 23:28:42 2022)
INFO: Upload config file '/var/tmp/vzdumptmp1150383_101/etc/vzdump/pct.conf' to 'XXX' as pct.conf.blob
INFO: Upload directory '/mnt/vzsnap0' to 'XXX' as root.pxar.didx
INFO: root.pxar: had to backup 125.71 MiB of 1.62 GiB (compressed 15.803 MiB) in 10.63s
INFO: root.pxar: average backup speed: 11.823 MiB/s
INFO: root.pxar: backup was done incrementally, reused 1.497 GiB (92.4%)
INFO: Uploaded backup catalog (444.794 KiB)
INFO: Duration: 12.76s
INFO: End Time: Fri Jul  8 02:29:44 2022
INFO: cleanup temporary 'vzdump' snapshot
INFO: Finished Backup of VM 101 (00:00:13)
INFO: Backup finished at 2022-07-08 02:29:44
INFO: Starting Backup of VM 102 (qemu)
INFO: Backup started at 2022-07-08 02:29:45
INFO: status = running
INFO: VM Name: VPN
INFO: include disk 'scsi0' 'DATOS:vm-102-disk-0' 10G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating Proxmox Backup Server archive 'vm/102/2022-07-08T01:29:45Z'
INFO: issuing guest-agent 'fs-freeze' command
INFO: enabling encryption
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '8f284a8e-55fd-4f33-8129-53791eabc2cf'
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: OK (160.0 MiB of 10.0 GiB dirty)
INFO: using fast incremental mode (dirty-bitmap), 160.0 MiB dirty of 10.0 GiB total
INFO: 100% (160.0 MiB of 160.0 MiB) in 3s, read: 53.3 MiB/s, write: 32.0 MiB/s
INFO: backup was done incrementally, reused 9.91 GiB (99%)
INFO: transferred 160.00 MiB in 6 seconds (26.7 MiB/s)
INFO: Finished Backup of VM 102 (00:00:08)
INFO: Backup finished at 2022-07-08 02:29:53
INFO: Backup job finished successfully
TASK OK

I thinks its looks like well, but it is too much data. Thanks
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back