Hi,
I've got a Win10 guest, during backup some process of the guest are killed. One is BlueIIris CCTV software (which runs as a service) the other is DeepStack which runs as a server.
As these are supposed to answer http request I can send requests and see when they're no more answering. Surely there's other process killed as, for example, after a while I no more get RDPaccess.
Each time a backup runs I'm waiting for it to finish then reset the guest ( reboot doesn't answer and I beleive it's because Guest agent is killed).
Here is the backup log :
As you can see backup is very slow, and dedup can't do anything cause most of the files are CCTV video files (it should cause most of the time the video is the same but it does not).
I was wondering if it would be wise to not wait for the end of the backup to issue the guest reset or would it corrupt the backup ?
Is there any way to exclude some files (in my case video files) from a snapshot ?
I tried both backup methods (Snapshot and Stop) but this doesn't make any difference.
I also saw that during backup the Windows Memory usage is going off the roof.
Host is 64G i7 Guest has 12G and it's most of the time it's using 10.
If someone has an idea...
Thanks for your help
V.
I've got a Win10 guest, during backup some process of the guest are killed. One is BlueIIris CCTV software (which runs as a service) the other is DeepStack which runs as a server.
As these are supposed to answer http request I can send requests and see when they're no more answering. Surely there's other process killed as, for example, after a while I no more get RDPaccess.
Each time a backup runs I'm waiting for it to finish then reset the guest ( reboot doesn't answer and I beleive it's because Guest agent is killed).
Here is the backup log :
Code:
Proxmox
Virtual Environment 6.4-13
Virtual Machine 102 (Win10Pro) on node 'pve'
(backup)
Status
running (shutdown)
HA State
none
Node
pve
CPU usage
0.17% of 6 CPU(s)
Memory usage
72.20% (8.66 GiB of 12.00 GiB)
Bootdisk size
96.00 GiB
IPs
Guest Agent not running
virtio1: NStorage:vm-102-disk-0,backup=0,cache=writeback,size=168G
virtio2: NStorage:vm-102-disk-1,backup=0,cache=writeback,size=500G
virtio3: NStorage:vm-102-disk-2,backup=0,cache=writeback,size=500G
scsi2: NStorage:vm-109-disk-0,backup=0,cache=writeback,size=1168G
virtio1: local-lvm:vm-109-disk-1,backup=0,cache=writeback,size=832G
Logs
()
INFO: starting new backup job: vzdump 102 --mailnotification always --quiet 1 --mailto vartthetech@gmail.com --storage BckSrv --all 0 --mode snapshot --node pve
INFO: Starting Backup of VM 102 (qemu)
INFO: Backup started at 2021-12-20 05:09:38
INFO: status = running
INFO: VM Name: Win10Pro
INFO: exclude disk 'scsi2' 'NStorage:vm-109-disk-0' (backup=no)
INFO: include disk 'virtio0' 'local-lvm:vm-102-disk-0' 96G
INFO: exclude disk 'virtio1' 'local-lvm:vm-109-disk-1' (backup=no)
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating Proxmox Backup Server archive 'vm/102/2021-12-20T11:09:38Z'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '85d7fe36-0b14-484c-a1c6-24f16989e750'
INFO: resuming VM again
INFO: virtio0: dirty-bitmap status: created new
INFO: 0% (412.0 MiB of 96.0 GiB) in 3s, read: 137.3 MiB/s, write: 120.0 MiB/s
INFO: 1% (996.0 MiB of 96.0 GiB) in 53s, read: 11.7 MiB/s, write: 11.6 MiB/s
INFO: 2% (1.9 GiB of 96.0 GiB) in 2m 24s, read: 10.8 MiB/s, write: 10.7 MiB/s
INFO: 3% (2.9 GiB of 96.0 GiB) in 7m 42s, read: 3.1 MiB/s, write: 3.1 MiB/s
INFO: 4% (3.8 GiB of 96.0 GiB) in 12m 53s, read: 3.2 MiB/s, write: 3.2 MiB/s
INFO: 5% (4.8 GiB of 96.0 GiB) in 25m 26s, read: 1.3 MiB/s, write: 1.3 MiB/s
INFO: 6% (5.8 GiB of 96.0 GiB) in 32m 18s, read: 2.4 MiB/s, write: 2.4 MiB/s
INFO: 7% (6.7 GiB of 96.0 GiB) in 44m 12s, read: 1.4 MiB/s, write: 1.4 MiB/s
INFO: 8% (7.7 GiB of 96.0 GiB) in 53m 14s, read: 1.8 MiB/s, write: 1.8 MiB/s
INFO: 9% (8.6 GiB of 96.0 GiB) in 1h 5m 49s, read: 1.3 MiB/s, write: 1.3 MiB/s
INFO: 10% (9.6 GiB of 96.0 GiB) in 1h 8m 35s, read: 5.9 MiB/s, write: 5.9 MiB/s
INFO: 11% (10.6 GiB of 96.0 GiB) in 1h 9m 32s, read: 17.5 MiB/s, write: 16.8 MiB/s
INFO: 12% (11.5 GiB of 96.0 GiB) in 1h 18m 44s, read: 1.8 MiB/s, write: 1.6 MiB/s
INFO: 13% (12.5 GiB of 96.0 GiB) in 1h 25m, read: 2.6 MiB/s, write: 2.5 MiB/s
INFO: 14% (13.4 GiB of 96.0 GiB) in 1h 38m 14s, read: 1.2 MiB/s, write: 1.2 MiB/s
INFO: 15% (14.4 GiB of 96.0 GiB) in 1h 53m 10s, read: 1.1 MiB/s, write: 1.0 MiB/s
INFO: 16% (15.4 GiB of 96.0 GiB) in 2h 2m 2s, read: 1.8 MiB/s, write: 1.7 MiB/s
INFO: 17% (16.3 GiB of 96.0 GiB) in 2h 10m 1s, read: 2.0 MiB/s, write: 2.0 MiB/s
INFO: 18% (17.3 GiB of 96.0 GiB) in 2h 11m 1s, read: 16.5 MiB/s, write: 15.9 MiB/s
INFO: 19% (18.2 GiB of 96.0 GiB) in 2h 23m 42s, read: 1.3 MiB/s, write: 1.3 MiB/s
INFO: 20% (19.2 GiB of 96.0 GiB) in 2h 32m 35s, read: 1.8 MiB/s, write: 1.8 MiB/s
INFO: 21% (20.2 GiB of 96.0 GiB) in 2h 42m 37s, read: 1.6 MiB/s, write: 1.5 MiB/s
INFO: 22% (21.1 GiB of 96.0 GiB) in 2h 54m 11s, read: 1.4 MiB/s, write: 1.4 MiB/s
INFO: 23% (22.1 GiB of 96.0 GiB) in 3h 5m, read: 1.5 MiB/s, write: 1.4 MiB/s
INFO: 24% (23.0 GiB of 96.0 GiB) in 3h 14m 46s, read: 1.7 MiB/s, write: 1.6 MiB/s
INFO: 25% (24.0 GiB of 96.0 GiB) in 3h 24m 41s, read: 1.6 MiB/s, write: 1.5 MiB/s
INFO: 26% (25.0 GiB of 96.0 GiB) in 3h 34m 51s, read: 1.6 MiB/s, write: 1.4 MiB/s
INFO: 27% (25.9 GiB of 96.0 GiB) in 3h 45m 28s, read: 1.5 MiB/s, write: 1.4 MiB/s
INFO: 28% (26.9 GiB of 96.0 GiB) in 3h 57m 35s, read: 1.4 MiB/s, write: 1.2 MiB/s
INFO: 29% (27.8 GiB of 96.0 GiB) in 4h 7m 44s, read: 1.6 MiB/s, write: 1.1 MiB/s
INFO: 30% (28.8 GiB of 96.0 GiB) in 4h 12m 32s, read: 3.5 MiB/s, write: 597.3 KiB/s
INFO: 31% (29.8 GiB of 96.0 GiB) in 4h 13m 46s, read: 13.1 MiB/s, write: 5.0 MiB/s
INFO: 32% (30.7 GiB of 96.0 GiB) in 4h 19m 41s, read: 2.7 MiB/s, write: 1.7 MiB/s
INFO: 33% (31.7 GiB of 96.0 GiB) in 4h 25m 19s, read: 2.9 MiB/s, write: 2.2 MiB/s
INFO: 34% (32.7 GiB of 96.0 GiB) in 4h 31m 50s, read: 2.6 MiB/s, write: 1.5 MiB/s
INFO: 35% (33.6 GiB of 96.0 GiB) in 4h 37m 39s, read: 2.8 MiB/s, write: 1.8 MiB/s
INFO: 36% (34.6 GiB of 96.0 GiB) in 4h 44m 58s, read: 2.2 MiB/s, write: 2.0 MiB/s
INFO: 37% (35.5 GiB of 96.0 GiB) in 4h 55m 15s, read: 1.6 MiB/s, write: 1.2 MiB/s
INFO: 38% (36.5 GiB of 96.0 GiB) in 5h 2m 30s, read: 2.2 MiB/s, write: 1.3 MiB/s
INFO: 39% (37.4 GiB of 96.0 GiB) in 5h 6m 33s, read: 4.0 MiB/s, write: 2.3 MiB/s
INFO: 40% (38.4 GiB of 96.0 GiB) in 5h 14m 37s, read: 2.0 MiB/s, write: 1.6 MiB/s
INFO: 41% (39.5 GiB of 96.0 GiB) in 5h 20m 27s, read: 3.1 MiB/s, write: 1.2 MiB/s
INFO: 42% (40.3 GiB of 96.0 GiB) in 5h 21m 6s, read: 22.5 MiB/s, write: 17.8 MiB/s
INFO: 43% (41.3 GiB of 96.0 GiB) in 5h 30m 42s, read: 1.7 MiB/s, write: 1.2 MiB/s
INFO: 44% (42.2 GiB of 96.0 GiB) in 5h 31m 22s, read: 23.9 MiB/s, write: 17.4 MiB/s
INFO: 45% (43.2 GiB of 96.0 GiB) in 5h 34m 48s, read: 4.8 MiB/s, write: 2.8 MiB/s
INFO: 46% (44.2 GiB of 96.0 GiB) in 5h 39m 22s, read: 3.6 MiB/s, write: 1.5 MiB/s
INFO: 47% (45.1 GiB of 96.0 GiB) in 5h 41m 24s, read: 8.1 MiB/s, write: 2.3 MiB/s
INFO: 48% (46.1 GiB of 96.0 GiB) in 5h 45m 45s, read: 3.8 MiB/s, write: 1.4 MiB/s
INFO: 49% (47.1 GiB of 96.0 GiB) in 5h 48m 34s, read: 5.8 MiB/s, write: 2.0 MiB/s
INFO: 50% (48.0 GiB of 96.0 GiB) in 5h 51m 13s, read: 6.1 MiB/s, write: 1.9 MiB/s
INFO: 51% (49.0 GiB of 96.0 GiB) in 5h 54m 42s, read: 4.7 MiB/s, write: 1.4 MiB/s
INFO: 52% (50.0 GiB of 96.0 GiB) in 5h 57m 5s, read: 7.3 MiB/s, write: 887.9 KiB/s
INFO: 53% (50.9 GiB of 96.0 GiB) in 5h 58m 39s, read: 9.8 MiB/s, write: 2.6 MiB/s
INFO: 54% (51.8 GiB of 96.0 GiB) in 6h 2m 21s, read: 4.4 MiB/s, write: 2.2 MiB/s
INFO: 55% (52.8 GiB of 96.0 GiB) in 6h 5m 27s, read: 5.3 MiB/s, write: 1.6 MiB/s
INFO: 56% (53.8 GiB of 96.0 GiB) in 6h 9m 6s, read: 4.6 MiB/s, write: 1.3 MiB/s
INFO: 57% (54.7 GiB of 96.0 GiB) in 6h 11m 9s, read: 7.7 MiB/s, write: 3.3 MiB/s
INFO: 58% (55.7 GiB of 96.0 GiB) in 6h 15m 58s, read: 3.4 MiB/s, write: 1.9 MiB/s
INFO: 59% (56.7 GiB of 96.0 GiB) in 6h 21m 7s, read: 3.3 MiB/s, write: 2.0 MiB/s
INFO: 60% (57.6 GiB of 96.0 GiB) in 6h 27m 57s, read: 2.3 MiB/s, write: 1.3 MiB/s
INFO: 61% (58.6 GiB of 96.0 GiB) in 6h 33m 44s, read: 2.8 MiB/s, write: 1.7 MiB/s
INFO: 62% (59.5 GiB of 96.0 GiB) in 6h 39m 43s, read: 2.7 MiB/s, write: 1.4 MiB/s
INFO: 63% (60.5 GiB of 96.0 GiB) in 6h 46m 55s, read: 2.3 MiB/s, write: 1.0 MiB/s
INFO: 64% (61.4 GiB of 96.0 GiB) in 6h 51m 5s, read: 3.9 MiB/s, write: 1.8 MiB/s
INFO: 65% (62.4 GiB of 96.0 GiB) in 6h 56m, read: 3.3 MiB/s, write: 2.0 MiB/s
INFO: 66% (63.4 GiB of 96.0 GiB) in 7h 3m 18s, read: 2.3 MiB/s, write: 1.3 MiB/s
INFO: 67% (64.3 GiB of 96.0 GiB) in 7h 9m 2s, read: 2.8 MiB/s, write: 1.7 MiB/s
INFO: 68% (65.3 GiB of 96.0 GiB) in 7h 15m 2s, read: 2.7 MiB/s, write: 1.2 MiB/s
INFO: 69% (66.3 GiB of 96.0 GiB) in 7h 17m 31s, read: 6.7 MiB/s, write: 2.1 MiB/s
INFO: 70% (67.2 GiB of 96.0 GiB) in 7h 21m 51s, read: 3.7 MiB/s, write: 2.0 MiB/s
INFO: 71% (68.2 GiB of 96.0 GiB) in 7h 27m 58s, read: 2.8 MiB/s, write: 1.3 MiB/s
INFO: 72% (69.1 GiB of 96.0 GiB) in 7h 34m 25s, read: 2.5 MiB/s, write: 1.6 MiB/s
INFO: 73% (70.1 GiB of 96.0 GiB) in 7h 40m 32s, read: 2.7 MiB/s, write: 1.3 MiB/s
INFO: 74% (71.2 GiB of 96.0 GiB) in 7h 45m 12s, read: 4.0 MiB/s, write: 1.2 MiB/s
INFO: 75% (72.0 GiB of 96.0 GiB) in 7h 47m 6s, read: 7.5 MiB/s, write: 1.6 MiB/s
INFO: 76% (73.0 GiB of 96.0 GiB) in 7h 47m 30s, read: 42.5 MiB/s, write: 170.7 KiB/s
INFO: 77% (74.0 GiB of 96.0 GiB) in 7h 48m 43s, read: 13.8 MiB/s, write: 2.4 MiB/s
INFO: 78% (74.9 GiB of 96.0 GiB) in 7h 51m 15s, read: 6.0 MiB/s, write: 2.1 MiB/s
INFO: 79% (75.8 GiB of 96.0 GiB) in 7h 54m 44s, read: 4.7 MiB/s, write: 3.1 MiB/s
INFO: 80% (76.8 GiB of 96.0 GiB) in 7h 58m 29s, read: 4.4 MiB/s, write: 3.1 MiB/s
INFO: 81% (77.8 GiB of 96.0 GiB) in 8h 6m 2s, read: 2.2 MiB/s, write: 1.4 MiB/s
INFO: 82% (78.8 GiB of 96.0 GiB) in 8h 6m 47s, read: 22.8 MiB/s, write: 10.0 MiB/s
INFO: 83% (79.8 GiB of 96.0 GiB) in 8h 10m 11s, read: 5.1 MiB/s, write: 2.4 MiB/s
INFO: 84% (80.6 GiB of 96.0 GiB) in 8h 15m 23s, read: 2.8 MiB/s, write: 1.7 MiB/s
INFO: 85% (81.6 GiB of 96.0 GiB) in 8h 21m 58s, read: 2.5 MiB/s, write: 881.4 KiB/s
INFO: 86% (82.6 GiB of 96.0 GiB) in 8h 25m 16s, read: 4.9 MiB/s, write: 2.3 MiB/s
INFO: 87% (83.6 GiB of 96.0 GiB) in 8h 29m 37s, read: 4.0 MiB/s, write: 549.3 KiB/s
INFO: 88% (84.5 GiB of 96.0 GiB) in 8h 30m 52s, read: 12.3 MiB/s, write: 4.8 MiB/s
INFO: 89% (85.5 GiB of 96.0 GiB) in 8h 38m 44s, read: 2.1 MiB/s, write: 1.2 MiB/s
INFO: 90% (86.5 GiB of 96.0 GiB) in 8h 44m 26s, read: 3.0 MiB/s, write: 1.3 MiB/s
INFO: 91% (87.4 GiB of 96.0 GiB) in 8h 48m 50s, read: 3.5 MiB/s, write: 1.4 MiB/s
INFO: 92% (88.3 GiB of 96.0 GiB) in 8h 53m 19s, read: 3.7 MiB/s, write: 2.0 MiB/s
INFO: 93% (89.4 GiB of 96.0 GiB) in 8h 57m 32s, read: 4.1 MiB/s, write: 1.4 MiB/s
INFO: 94% (90.4 GiB of 96.0 GiB) in 8h 57m 58s, read: 41.5 MiB/s, write: 945.2 KiB/s
INFO: 95% (91.3 GiB of 96.0 GiB) in 8h 58m 3s, read: 181.6 MiB/s, write: 0 B/s
INFO: 96% (92.2 GiB of 96.0 GiB) in 8h 58m 7s, read: 229.0 MiB/s, write: 0 B/s
INFO: 97% (93.1 GiB of 96.0 GiB) in 8h 58m 15s, read: 119.5 MiB/s, write: 35.0 MiB/s
INFO: 98% (94.1 GiB of 96.0 GiB) in 9h 2m 53s, read: 3.7 MiB/s, write: 1.4 MiB/s
INFO: 99% (95.1 GiB of 96.0 GiB) in 9h 10m 32s, read: 2.1 MiB/s, write: 1.5 MiB/sAs you can see backup is very slow, and dedup can't do anything cause most of the files are CCTV video files (it should cause most of the time the video is the same but it does not).
I was wondering if it would be wise to not wait for the end of the backup to issue the guest reset or would it corrupt the backup ?
Is there any way to exclude some files (in my case video files) from a snapshot ?
I tried both backup methods (Snapshot and Stop) but this doesn't make any difference.
I also saw that during backup the Windows Memory usage is going off the roof.
Host is 64G i7 Guest has 12G and it's most of the time it's using 10.
If someone has an idea...
Thanks for your help
V.