Hallo,
Seit rund 1-2 Wochen habe ich große Probleme mit meinen Backup Tasks.
Ich habe zwei geplante Tasks definiert, einmal ein lokales Backup und ein weiteres Backup auf eine externen Storage VM via SMB/CIFS.
Das Lokale Backup läuft ohne Probleme durch, das externe Backup hängt stundenlang bei einer VM.
Die VMs davor wurden problemlos gesichert.
Siehe die letzten Zeilen im angehängten Log.
Die Verbindung via Iperf3 zeigt keine Auffälligkeiten
Hat jemand eine Idee woran das liegen könnte?
Danke!
Seit rund 1-2 Wochen habe ich große Probleme mit meinen Backup Tasks.
Ich habe zwei geplante Tasks definiert, einmal ein lokales Backup und ein weiteres Backup auf eine externen Storage VM via SMB/CIFS.
Das Lokale Backup läuft ohne Probleme durch, das externe Backup hängt stundenlang bei einer VM.
Die VMs davor wurden problemlos gesichert.
Siehe die letzten Zeilen im angehängten Log.
Die Verbindung via Iperf3 zeigt keine Auffälligkeiten
Hat jemand eine Idee woran das liegen könnte?
Danke!
Code:
INFO: starting new backup job: vzdump --storage storage --all 1 --node pve --compress zstd --mailnotification failure --quiet 1 --mode snapshot --mailto hi@mydomain.de
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2022-01-28 01:00:02
INFO: status = stopped
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: deb11
INFO: include disk 'scsi0' 'local-zfs:base-100-disk-0' 30G
INFO: creating vzdump archive '/mnt/pve/storage/dump/vzdump-qemu-100-2022_01_28-01_00_02.vma.zst'
INFO: starting template backup
INFO: /usr/bin/vma create -v -c /mnt/pve/storage/dump/vzdump-qemu-100-2022_01_28-01_00_02.tmp/qemu-server.conf exec:zstd --rsyncable --threads=1 > /mnt/pve/storage/dump/vzdump-qemu-100-2022_01_28-01_00_02.vma.dat drive-scsi0=/dev/zvol/rpool/data/base-100-disk-0
INFO: progress 0% 0/32212254720 0
INFO: progress 1% 322174976/32212254720 151797760
INFO: progress 2% 644284416/32212254720 221999104
INFO: progress 3% 966393856/32212254720 531156992
INFO: progress 4% 1288503296/32212254720 850649088
INFO: progress 5% 1610612736/32212254720 1172758528
INFO: progress 6% 1932787712/32212254720 1494933504
<< Zeilen musste ich entfern, da sonst zu lang für das Forum >>
INFO: progress 97% 31245926400/32212254720 29997776896
INFO: progress 98% 31568035840/32212254720 30319886336
INFO: progress 99% 31890145280/32212254720 30641995776
INFO: progress 100% 32212254720/32212254720 30964105216
INFO: image drive-scsi0: size=32212254720 zeros=30964105216 saved=1248149504
INFO: archive file size: 312MB
INFO: prune older backups with retention: keep-last=5
INFO: removing backup 'storage:backup/vzdump-qemu-100-2022_01_24-15_16_42.vma.zst'
INFO: pruned 1 backup(s) not covered by keep-retention policy
INFO: Finished Backup of VM 100 (00:00:26)
INFO: Backup finished at 2022-01-28 01:00:28
INFO: Starting Backup of VM 101 (qemu)
INFO: Backup started at 2022-01-28 01:00:29
INFO: status = running
INFO: VM Name: vpn.mydomain.de
INFO: include disk 'scsi0' 'local-zfs:vm-101-disk-0' 30G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/mnt/pve/storage/dump/vzdump-qemu-101-2022_01_28-01_00_28.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '3b544322-3db0-4f52-ad01-e1e824862eb3'
INFO: resuming VM again
INFO: 2% (906.2 MiB of 30.0 GiB) in 3s, read: 302.1 MiB/s, write: 212.3 MiB/s
INFO: 4% (1.4 GiB of 30.0 GiB) in 6s, read: 184.9 MiB/s, write: 160.5 MiB/s
INFO: 7% (2.2 GiB of 30.0 GiB) in 9s, read: 279.1 MiB/s, write: 223.3 MiB/s
INFO: 15% (4.7 GiB of 30.0 GiB) in 12s, read: 831.3 MiB/s, write: 257.2 MiB/s
INFO: 27% (8.2 GiB of 30.0 GiB) in 15s, read: 1.2 GiB/s, write: 210.1 MiB/s
INFO: 47% (14.3 GiB of 30.0 GiB) in 18s, read: 2.0 GiB/s, write: 150.4 MiB/s
INFO: 81% (24.3 GiB of 30.0 GiB) in 21s, read: 3.3 GiB/s, write: 56.0 MiB/s
INFO: 100% (30.0 GiB of 30.0 GiB) in 23s, read: 2.8 GiB/s, write: 16.0 KiB/s
INFO: backup is sparse: 26.28 GiB (87%) total zero data
INFO: transferred 30.00 GiB in 23 seconds (1.3 GiB/s)
INFO: archive file size: 1.03GB
INFO: prune older backups with retention: keep-last=5
INFO: removing backup 'storage:backup/vzdump-qemu-101-2022_01_24-15_17_07.vma.zst'
INFO: pruned 1 backup(s) not covered by keep-retention policy
INFO: Finished Backup of VM 101 (00:00:35)
INFO: Backup finished at 2022-01-28 01:01:03
INFO: Starting Backup of VM 102 (qemu)
INFO: Backup started at 2022-01-28 01:01:03
INFO: status = running
INFO: VM Name: web.mydomain.de
INFO: include disk 'scsi0' 'local-zfs:vm-102-disk-0' 50G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/storage/dump/vzdump-qemu-102-2022_01_28-01_01_03.vma.zst'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task 'bc09ac6c-4e23-4275-a5c5-bd036b9019e5'
INFO: resuming VM again
INFO: 1% (786.6 MiB of 50.0 GiB) in 3s, read: 262.2 MiB/s, write: 217.6 MiB/s
INFO: 2% (1.4 GiB of 50.0 GiB) in 6s, read: 212.7 MiB/s, write: 185.9 MiB/s
INFO: 4% (2.3 GiB of 50.0 GiB) in 9s, read: 296.0 MiB/s, write: 256.0 MiB/s
INFO: 6% (3.0 GiB of 50.0 GiB) in 12s, read: 255.0 MiB/s, write: 232.7 MiB/s
INFO: 7% (3.8 GiB of 50.0 GiB) in 15s, read: 268.2 MiB/s, write: 265.5 MiB/s
INFO: 9% (4.7 GiB of 50.0 GiB) in 18s, read: 306.9 MiB/s, write: 274.2 MiB/s
INFO: 11% (5.5 GiB of 50.0 GiB) in 21s, read: 277.9 MiB/s, write: 276.0 MiB/s
INFO: 12% (6.2 GiB of 50.0 GiB) in 24s, read: 234.4 MiB/s, write: 201.2 MiB/s
INFO: 13% (6.9 GiB of 50.0 GiB) in 27s, read: 257.4 MiB/s, write: 248.8 MiB/s
INFO: 15% (7.6 GiB of 50.0 GiB) in 30s, read: 215.1 MiB/s, write: 214.8 MiB/s
INFO: 16% (8.4 GiB of 50.0 GiB) in 33s, read: 271.9 MiB/s, write: 234.6 MiB/s
INFO: 17% (9.0 GiB of 50.0 GiB) in 36s, read: 209.0 MiB/s, write: 209.0 MiB/s
INFO: 19% (9.6 GiB of 50.0 GiB) in 39s, read: 219.9 MiB/s, write: 219.8 MiB/s
INFO: 20% (10.4 GiB of 50.0 GiB) in 42s, read: 275.5 MiB/s, write: 233.8 MiB/s
INFO: 22% (11.1 GiB of 50.0 GiB) in 45s, read: 213.9 MiB/s, write: 213.0 MiB/s
INFO: 23% (11.9 GiB of 50.0 GiB) in 48s, read: 294.8 MiB/s, write: 294.8 MiB/s
INFO: 25% (12.8 GiB of 50.0 GiB) in 51s, read: 294.8 MiB/s, write: 253.9 MiB/s
INFO: 26% (13.4 GiB of 50.0 GiB) in 54s, read: 224.8 MiB/s, write: 224.7 MiB/s
INFO: 27% (13.9 GiB of 50.0 GiB) in 57s, read: 168.0 MiB/s, write: 167.8 MiB/s
INFO: 29% (14.6 GiB of 50.0 GiB) in 1m, read: 224.8 MiB/s, write: 183.8 MiB/s
INFO: 30% (15.1 GiB of 50.0 GiB) in 1m 3s, read: 178.8 MiB/s, write: 178.6 MiB/s
INFO: 31% (15.9 GiB of 50.0 GiB) in 1m 6s, read: 257.4 MiB/s, write: 254.6 MiB/s
INFO: 33% (16.6 GiB of 50.0 GiB) in 1m 9s, read: 245.3 MiB/s, write: 207.1 MiB/s
INFO: 34% (17.3 GiB of 50.0 GiB) in 1m 12s, read: 229.6 MiB/s, write: 229.5 MiB/s
INFO: 35% (17.9 GiB of 50.0 GiB) in 1m 15s, read: 209.0 MiB/s, write: 208.6 MiB/s
INFO: 37% (18.7 GiB of 50.0 GiB) in 1m 18s, read: 284.0 MiB/s, write: 249.2 MiB/s
INFO: 38% (19.3 GiB of 50.0 GiB) in 1m 21s, read: 183.7 MiB/s, write: 183.6 MiB/s
INFO: 39% (20.0 GiB of 50.0 GiB) in 1m 24s, read: 244.1 MiB/s, write: 243.5 MiB/s
INFO: 41% (20.9 GiB of 50.0 GiB) in 1m 27s, read: 333.5 MiB/s, write: 293.7 MiB/s
INFO: 43% (21.6 GiB of 50.0 GiB) in 1m 30s, read: 232.0 MiB/s, write: 231.9 MiB/s
INFO: 44% (22.3 GiB of 50.0 GiB) in 1m 33s, read: 245.3 MiB/s, write: 207.1 MiB/s
INFO: 45% (22.9 GiB of 50.0 GiB) in 1m 36s, read: 193.3 MiB/s, write: 193.3 MiB/s
INFO: 47% (23.8 GiB of 50.0 GiB) in 1m 39s, read: 296.0 MiB/s, write: 296.0 MiB/s
INFO: 49% (24.6 GiB of 50.0 GiB) in 1m 42s, read: 265.8 MiB/s, write: 255.4 MiB/s
INFO: 50% (25.3 GiB of 50.0 GiB) in 1m 45s, read: 246.5 MiB/s, write: 246.5 MiB/s
INFO: 52% (26.2 GiB of 50.0 GiB) in 1m 48s, read: 327.5 MiB/s, write: 289.6 MiB/s
INFO: 53% (26.9 GiB of 50.0 GiB) in 1m 51s, read: 223.5 MiB/s, write: 223.5 MiB/s
INFO: 55% (27.5 GiB of 50.0 GiB) in 1m 54s, read: 224.8 MiB/s, write: 224.7 MiB/s
INFO: 56% (28.4 GiB of 50.0 GiB) in 1m 57s, read: 279.1 MiB/s, write: 241.0 MiB/s
INFO: 58% (29.0 GiB of 50.0 GiB) in 2m, read: 228.4 MiB/s, write: 228.3 MiB/s
INFO: 59% (29.8 GiB of 50.0 GiB) in 2m 3s, read: 262.2 MiB/s, write: 256.8 MiB/s
INFO: 61% (30.6 GiB of 50.0 GiB) in 2m 6s, read: 263.4 MiB/s, write: 223.7 MiB/s
INFO: 62% (31.2 GiB of 50.0 GiB) in 2m 9s, read: 223.5 MiB/s, write: 223.4 MiB/s
INFO: 63% (31.7 GiB of 50.0 GiB) in 2m 12s, read: 169.2 MiB/s, write: 169.1 MiB/s
INFO: 65% (32.5 GiB of 50.0 GiB) in 2m 15s, read: 280.3 MiB/s, write: 241.9 MiB/s
INFO: 66% (33.3 GiB of 50.0 GiB) in 2m 18s, read: 264.6 MiB/s, write: 264.6 MiB/s
INFO: 67% (34.0 GiB of 50.0 GiB) in 2m 21s, read: 222.3 MiB/s, write: 221.7 MiB/s
INFO: 69% (34.5 GiB of 50.0 GiB) in 2m 24s, read: 194.5 MiB/s, write: 156.3 MiB/s
INFO: 70% (35.0 GiB of 50.0 GiB) in 2m 28s, read: 120.5 MiB/s, write: 120.1 MiB/s
INFO: 71% (35.5 GiB of 50.0 GiB) in 2m 31s, read: 166.8 MiB/s, write: 166.6 MiB/s
INFO: 72% (36.4 GiB of 50.0 GiB) in 2m 36s, read: 176.2 MiB/s, write: 154.0 MiB/s
INFO: 73% (36.8 GiB of 50.0 GiB) in 2m 39s, read: 136.5 MiB/s, write: 136.5 MiB/s
INFO: 74% (37.4 GiB of 50.0 GiB) in 2m 42s, read: 207.8 MiB/s, write: 207.7 MiB/s
INFO: 76% (38.0 GiB of 50.0 GiB) in 2m 45s, read: 228.4 MiB/s, write: 217.7 MiB/s
INFO: 77% (38.6 GiB of 50.0 GiB) in 2m 48s, read: 197.0 MiB/s, write: 180.1 MiB/s
INFO: 78% (39.1 GiB of 50.0 GiB) in 2m 51s, read: 151.0 MiB/s, write: 151.0 MiB/s
INFO: 79% (39.6 GiB of 50.0 GiB) in 2m 54s, read: 168.0 MiB/s, write: 167.9 MiB/s
INFO: 80% (40.1 GiB of 50.0 GiB) in 2m 57s, read: 203.0 MiB/s, write: 167.4 MiB/s
INFO: 81% (40.7 GiB of 50.0 GiB) in 3m, read: 190.9 MiB/s, write: 190.9 MiB/s
INFO: 82% (41.2 GiB of 50.0 GiB) in 3m 3s, read: 172.8 MiB/s, write: 172.8 MiB/s
INFO: 83% (41.8 GiB of 50.0 GiB) in 3m 6s, read: 213.9 MiB/s, write: 213.6 MiB/s
INFO: 85% (42.5 GiB of 50.0 GiB) in 3m 9s, read: 234.4 MiB/s, write: 200.2 MiB/s
INFO: 86% (43.1 GiB of 50.0 GiB) in 3m 12s, read: 211.5 MiB/s, write: 210.0 MiB/s
INFO: 87% (43.7 GiB of 50.0 GiB) in 3m 15s, read: 182.5 MiB/s, write: 182.4 MiB/s
INFO: 88% (44.5 GiB of 50.0 GiB) in 3m 18s, read: 270.7 MiB/s, write: 236.1 MiB/s
INFO: 90% (45.1 GiB of 50.0 GiB) in 3m 21s, read: 217.5 MiB/s, write: 217.4 MiB/s
INFO: 91% (45.8 GiB of 50.0 GiB) in 3m 24s, read: 246.5 MiB/s, write: 246.0 MiB/s
INFO: 93% (46.6 GiB of 50.0 GiB) in 3m 27s, read: 258.6 MiB/s, write: 219.3 MiB/s
INFO: 94% (47.3 GiB of 50.0 GiB) in 3m 30s, read: 251.3 MiB/s, write: 251.2 MiB/s
INFO: 96% (48.0 GiB of 50.0 GiB) in 3m 33s, read: 241.7 MiB/s, write: 232.6 MiB/s
INFO: 97% (48.9 GiB of 50.0 GiB) in 3m 36s, read: 300.9 MiB/s, write: 272.4 MiB/s
INFO: 99% (49.8 GiB of 50.0 GiB) in 3m 39s, read: 291.2 MiB/s, write: 291.2 MiB/s
INFO: 100% (50.0 GiB of 50.0 GiB) in 3m 41s, read: 118.1 MiB/s, write: 114.8 MiB/s
INFO: backup is sparse: 2.90 GiB (5%) total zero data
INFO: transferred 50.00 GiB in 221 seconds (231.7 MiB/s)
INFO: archive file size: 24.43GB
INFO: prune older backups with retention: keep-last=5
INFO: removing backup 'storage:backup/vzdump-qemu-102-2022_01_24-15_17_42.vma.zst'
INFO: pruned 1 backup(s) not covered by keep-retention policy
INFO: Finished Backup of VM 102 (00:04:28)
INFO: Backup finished at 2022-01-28 01:05:31
INFO: Starting Backup of VM 103 (qemu)
INFO: Backup started at 2022-01-28 01:05:32
INFO: status = stopped
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: windows
INFO: include disk 'scsi0' 'local-zfs:vm-103-disk-0' 50G
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/storage/dump/vzdump-qemu-103-2022_01_28-01_05_31.vma.zst'
INFO: starting kvm to execute backup task
INFO: started backup task '4d4c119e-94d8-4ef6-9011-94cca079c1c1'
INFO: 2% (1.3 GiB of 50.0 GiB) in 3s, read: 427.8 MiB/s, write: 237.7 MiB/s
INFO: 4% (2.1 GiB of 50.0 GiB) in 6s, read: 300.9 MiB/s, write: 258.1 MiB/s
INFO: 5% (2.7 GiB of 50.0 GiB) in 9s, read: 189.7 MiB/s, write: 187.3 MiB/s
INFO: 6% (3.3 GiB of 50.0 GiB) in 12s, read: 197.0 MiB/s, write: 195.4 MiB/s
INFO: 7% (3.9 GiB of 50.0 GiB) in 15s, read: 218.7 MiB/s, write: 218.2 MiB/s
INFO: 8% (4.5 GiB of 50.0 GiB) in 18s, read: 194.5 MiB/s, write: 193.5 MiB/s
INFO: 10% (5.2 GiB of 50.0 GiB) in 21s, read: 259.8 MiB/s, write: 258.7 MiB/s
INFO: 12% (6.2 GiB of 50.0 GiB) in 24s, read: 313.0 MiB/s, write: 301.1 MiB/s
INFO: 13% (6.7 GiB of 50.0 GiB) in 27s, read: 194.5 MiB/s, write: 192.6 MiB/s
INFO: 14% (7.2 GiB of 50.0 GiB) in 30s, read: 175.2 MiB/s, write: 173.9 MiB/s
INFO: 15% (7.8 GiB of 50.0 GiB) in 33s, read: 201.8 MiB/s, write: 199.3 MiB/s
INFO: 16% (8.4 GiB of 50.0 GiB) in 36s, read: 203.0 MiB/s, write: 194.8 MiB/s
INFO: 17% (8.9 GiB of 50.0 GiB) in 39s, read: 175.2 MiB/s, write: 174.9 MiB/s
INFO: 19% (9.6 GiB of 50.0 GiB) in 42s, read: 224.8 MiB/s, write: 215.7 MiB/s
INFO: 20% (10.3 GiB of 50.0 GiB) in 45s, read: 250.1 MiB/s, write: 236.6 MiB/s
INFO: 22% (11.0 GiB of 50.0 GiB) in 48s, read: 238.0 MiB/s, write: 235.3 MiB/s
INFO: 23% (11.7 GiB of 50.0 GiB) in 51s, read: 227.2 MiB/s, write: 214.4 MiB/s
INFO: 25% (12.6 GiB of 50.0 GiB) in 54s, read: 300.9 MiB/s, write: 259.5 MiB/s
INFO: 26% (13.4 GiB of 50.0 GiB) in 57s, read: 285.2 MiB/s, write: 266.9 MiB/s
INFO: 28% (14.2 GiB of 50.0 GiB) in 1m, read: 258.6 MiB/s, write: 221.8 MiB/s
INFO: 29% (14.7 GiB of 50.0 GiB) in 1m 3s, read: 193.3 MiB/s, write: 179.1 MiB/s
INFO: 30% (15.0 GiB of 50.0 GiB) in 32m 53s, read: 147.7 KiB/s, write: 118.7 KiB/s
INFO: 31% (15.5 GiB of 50.0 GiB) in 3h 18m 55s, read: 52.5 KiB/s, write: 50.0 KiB/s