VM hängt nach Backup

T

Troubadix

Member
Proxmox Subscriber
Sep 9, 2021
43
1
13
55
Hallo,

leider hat eine der VMs das nächtliche Backup/Snapshot nicht überlebt.
CPU- und RAM-Auslastung bei 100%, keiner der Dienste ansprechbar, auch per Konsole in Proxmox nicht erreichbar.

Reset im Proxmox ohne Erfolg (Timeout), nur hartes Abschalten und erneutes booten der VM hat geholfen.

Ausgabe des Backup-Tasks:
Version:0.9 StartHTML:-1 EndHTML:-1 StartFragment:0000000121 EndFragment:0000130128 INFO: starting new backup job: vzdump 100 --mailto hostmaster@domain.tld --mode snapshot --compress zstd --quiet 1 --mailnotification failure --storage qnap-nfs INFO: Starting Backup of VM 100 (qemu) INFO: Backup started at 2022-07-08 21:00:16 INFO: status = running INFO: VM Name: lustiger-vm-name INFO: include disk 'ide0' 'local-lvm:vm-100-disk-0' 750G INFO: include disk 'sata1' 'local-lvm:vm-100-disk-1' 30G INFO: include disk 'tpmstate0' 'local-lvm:vm-100-disk-2' 4M INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-100-2022_07_08-21_00_03.vma.zst' INFO: attaching TPM drive to QEMU for backup INFO: issuing guest-agent 'fs-freeze' command INFO: issuing guest-agent 'fs-thaw' command INFO: started backup task '7dacf962-7b47-41bb-9404-32bf7e5ea3b4' INFO: resuming VM again INFO: 1% (15.5 GiB of 780.0 GiB) in 3s, read: 5.2 GiB/s, write: 17.6 MiB/s INFO: 3% (25.0 GiB of 780.0 GiB) in 6s, read: 3.2 GiB/s, write: 312.0 KiB/s INFO: 4% (31.2 GiB of 780.0 GiB) in 14s, read: 794.3 MiB/s, write: 129.0 MiB/s INFO: 5% (39.1 GiB of 780.0 GiB) in 1m 17s, read: 127.8 MiB/s, write: 126.9 MiB/s INFO: 6% (46.9 GiB of 780.0 GiB) in 1m 41s, read: 334.3 MiB/s, write: 148.0 MiB/s INFO: 7% (54.6 GiB of 780.0 GiB) in 2m 38s, read: 138.8 MiB/s, write: 137.8 MiB/s INFO: 8% (63.0 GiB of 780.0 GiB) in 3m 14s, read: 237.0 MiB/s, write: 145.4 MiB/s INFO: 9% (70.2 GiB of 780.0 GiB) in 3m 58s, read: 169.4 MiB/s, write: 149.1 MiB/s INFO: 10% (78.1 GiB of 780.0 GiB) in 4m 50s, read: 155.7 MiB/s, write: 154.5 MiB/s INFO: 11% (86.0 GiB of 780.0 GiB) in 5m 46s, read: 142.9 MiB/s, write: 142.4 MiB/s INFO: 12% (93.6 GiB of 780.0 GiB) in 6m 36s, read: 157.1 MiB/s, write: 157.0 MiB/s INFO: 13% (102.6 GiB of 780.0 GiB) in 7m 11s, read: 262.7 MiB/s, write: 192.0 MiB/s INFO: 14% (109.4 GiB of 780.0 GiB) in 7m 14s, read: 2.3 GiB/s, write: 66.5 MiB/s INFO: 15% (119.4 GiB of 780.0 GiB) in 7m 17s, read: 3.3 GiB/s, write: 0 B/s INFO: 16% (129.5 GiB of 780.0 GiB) in 7m 20s, read: 3.3 GiB/s, write: 0 B/s INFO: 17% (139.5 GiB of 780.0 GiB) in 7m 23s, read: 3.3 GiB/s, write: 0 B/s INFO: 19% (149.5 GiB of 780.0 GiB) in 7m 26s, read: 3.3 GiB/s, write: 0 B/s INFO: 20% (159.2 GiB of 780.0 GiB) in 7m 29s, read: 3.2 GiB/s, write: 0 B/s INFO: 21% (168.9 GiB of 780.0 GiB) in 7m 32s, read: 3.2 GiB/s, write: 0 B/s INFO: 22% (178.7 GiB of 780.0 GiB) in 7m 35s, read: 3.3 GiB/s, write: 21.3 KiB/s INFO: 24% (188.5 GiB of 780.0 GiB) in 7m 38s, read: 3.3 GiB/s, write: 21.3 KiB/s INFO: 25% (198.2 GiB of 780.0 GiB) in 7m 41s, read: 3.2 GiB/s, write: 0 B/s INFO: 26% (207.9 GiB of 780.0 GiB) in 7m 44s, read: 3.2 GiB/s, write: 0 B/s INFO: 27% (217.8 GiB of 780.0 GiB) in 7m 47s, read: 3.3 GiB/s, write: 0 B/s INFO: 29% (227.8 GiB of 780.0 GiB) in 7m 50s, read: 3.3 GiB/s, write: 0 B/s INFO: 30% (237.9 GiB of 780.0 GiB) in 7m 53s, read: 3.4 GiB/s, write: 0 B/s INFO: 31% (247.9 GiB of 780.0 GiB) in 7m 56s, read: 3.4 GiB/s, write: 0 B/s INFO: 33% (257.7 GiB of 780.0 GiB) in 7m 59s, read: 3.2 GiB/s, write: 0 B/s INFO: 34% (266.8 GiB of 780.0 GiB) in 8m 2s, read: 3.0 GiB/s, write: 0 B/s INFO: 35% (275.9 GiB of 780.0 GiB) in 8m 6s, read: 2.3 GiB/s, write: 16.0 KiB/s INFO: 36% (280.8 GiB of 780.0 GiB) in 8m 14s, read: 624.3 MiB/s, write: 99.9 MiB/s INFO: 37% (288.6 GiB of 780.0 GiB) in 9m 9s, read: 145.2 MiB/s, write: 140.8 MiB/s INFO: 38% (296.4 GiB of 780.0 GiB) in 9m 51s, read: 190.7 MiB/s, write: 190.4 MiB/s INFO: 39% (304.4 GiB of 780.0 GiB) in 10m 32s, read: 197.8 MiB/s, write: 197.3 MiB/s INFO: 40% (312.0 GiB of 780.0 GiB) in 11m 13s, read: 191.2 MiB/s, write: 190.8 MiB/s INFO: 41% (319.9 GiB of 780.0 GiB) in 11m 54s, read: 196.8 MiB/s, write: 196.3 MiB/s INFO: 42% (327.7 GiB of 780.0 GiB) in 12m 41s, read: 170.4 MiB/s, write: 170.0 MiB/s INFO: 43% (335.5 GiB of 780.0 GiB) in 13m 28s, read: 170.5 MiB/s, write: 165.3 MiB/s INFO: 44% (343.3 GiB of 780.0 GiB) in 14m 10s, read: 190.4 MiB/s, write: 189.9 MiB/s INFO: 45% (351.0 GiB of 780.0 GiB) in 14m 50s, read: 196.8 MiB/s, write: 196.3 MiB/s INFO: 46% (359.0 GiB of 780.0 GiB) in 15m 31s, read: 197.8 MiB/s, write: 197.6 MiB/s INFO: 47% (366.7 GiB of 780.0 GiB) in 16m 12s, read: 194.4 MiB/s, write: 194.1 MiB/s INFO: 48% (374.6 GiB of 780.0 GiB) in 16m 23s, read: 736.1 MiB/s, write: 155.8 MiB/s INFO: 49% (382.3 GiB of 780.0 GiB) in 17m 1s, read: 205.4 MiB/s, write: 194.5 MiB/s INFO: 50% (390.1 GiB of 780.0 GiB) in 17m 42s, read: 196.6 MiB/s, write: 196.1 MiB/s INFO: 51% (398.6 GiB of 780.0 GiB) in 18m 2s, read: 433.5 MiB/s, write: 182.1 MiB/s INFO: 52% (407.6 GiB of 780.0 GiB) in 18m 5s, read: 3.0 GiB/s, write: 0 B/s INFO: 53% (416.5 GiB of 780.0 GiB) in 18m 8s, read: 3.0 GiB/s, write: 0 B/s INFO: 54% (425.4 GiB of 780.0 GiB) in 18m 11s, read: 3.0 GiB/s, write: 0 B/s INFO: 55% (434.3 GiB of 780.0 GiB) in 18m 14s, read: 3.0 GiB/s, write: 1.3 KiB/s INFO: 56% (443.2 GiB of 780.0 GiB) in 18m 17s, read: 3.0 GiB/s, write: 0 B/s INFO: 57% (452.2 GiB of 780.0 GiB) in 18m 20s, read: 3.0 GiB/s, write: 0 B/s INFO: 59% (461.1 GiB of 780.0 GiB) in 18m 23s, read: 3.0 GiB/s, write: 0 B/s INFO: 60% (470.1 GiB of 780.0 GiB) in 18m 27s, read: 2.2 GiB/s, write: 0 B/s INFO: 61% (479.3 GiB of 780.0 GiB) in 18m 30s, read: 3.0 GiB/s, write: 0 B/s INFO: 62% (488.3 GiB of 780.0 GiB) in 18m 33s, read: 3.0 GiB/s, write: 0 B/s INFO: 63% (497.3 GiB of 780.0 GiB) in 18m 36s, read: 3.0 GiB/s, write: 0 B/s INFO: 64% (506.4 GiB of 780.0 GiB) in 18m 39s, read: 3.0 GiB/s, write: 0 B/s INFO: 66% (515.3 GiB of 780.0 GiB) in 18m 42s, read: 3.0 GiB/s, write: 0 B/s INFO: 67% (524.3 GiB of 780.0 GiB) in 18m 45s, read: 3.0 GiB/s, write: 0 B/s INFO: 68% (533.4 GiB of 780.0 GiB) in 18m 48s, read: 3.0 GiB/s, write: 0 B/s INFO: 69% (542.5 GiB of 780.0 GiB) in 18m 51s, read: 3.0 GiB/s, write: 0 B/s INFO: 70% (551.6 GiB of 780.0 GiB) in 18m 54s, read: 3.0 GiB/s, write: 0 B/s INFO: 71% (560.6 GiB of 780.0 GiB) in 18m 57s, read: 3.0 GiB/s, write: 0 B/s INFO: 73% (569.8 GiB of 780.0 GiB) in 19m, read: 3.1 GiB/s, write: 0 B/s INFO: 74% (578.9 GiB of 780.0 GiB) in 19m 3s, read: 3.0 GiB/s, write: 0 B/s INFO: 75% (587.8 GiB of 780.0 GiB) in 19m 6s, read: 3.0 GiB/s, write: 0 B/s INFO: 76% (596.8 GiB of 780.0 GiB) in 19m 9s, read: 3.0 GiB/s, write: 0 B/s INFO: 77% (605.8 GiB of 780.0 GiB) in 19m 12s, read: 3.0 GiB/s, write: 0 B/s INFO: 78% (614.9 GiB of 780.0 GiB) in 19m 15s, read: 3.0 GiB/s, write: 0 B/s INFO: 79% (623.8 GiB of 780.0 GiB) in 19m 18s, read: 3.0 GiB/s, write: 0 B/s INFO: 81% (632.8 GiB of 780.0 GiB) in 19m 21s, read: 3.0 GiB/s, write: 0 B/s INFO: 82% (641.6 GiB of 780.0 GiB) in 19m 24s, read: 3.0 GiB/s, write: 0 B/s INFO: 83% (650.6 GiB of 780.0 GiB) in 19m 27s, read: 3.0 GiB/s, write: 0 B/s INFO: 84% (659.5 GiB of 780.0 GiB) in 19m 30s, read: 3.0 GiB/s, write: 0 B/s INFO: 85% (668.4 GiB of 780.0 GiB) in 19m 33s, read: 3.0 GiB/s, write: 0 B/s INFO: 86% (677.3 GiB of 780.0 GiB) in 19m 36s, read: 3.0 GiB/s, write: 0 B/s INFO: 87% (686.2 GiB of 780.0 GiB) in 19m 39s, read: 3.0 GiB/s, write: 0 B/s INFO: 89% (695.2 GiB of 780.0 GiB) in 19m 42s, read: 3.0 GiB/s, write: 0 B/s INFO: 90% (704.1 GiB of 780.0 GiB) in 19m 45s, read: 3.0 GiB/s, write: 0 B/s INFO: 91% (713.0 GiB of 780.0 GiB) in 19m 48s, read: 3.0 GiB/s, write: 0 B/s INFO: 92% (722.1 GiB of 780.0 GiB) in 19m 51s, read: 3.0 GiB/s, write: 0 B/s INFO: 93% (731.0 GiB of 780.0 GiB) in 19m 54s, read: 3.0 GiB/s, write: 0 B/s INFO: 94% (739.9 GiB of 780.0 GiB) in 19m 57s, read: 3.0 GiB/s, write: 0 B/s INFO: 96% (748.9 GiB of 780.0 GiB) in 20m, read: 3.0 GiB/s, write: 0 B/s INFO: 97% (757.7 GiB of 780.0 GiB) in 20m 3s, read: 3.0 GiB/s, write: 0 B/s INFO: 98% (766.6 GiB of 780.0 GiB) in 20m 6s, read: 2.9 GiB/s, write: 0 B/s INFO: 99% (775.4 GiB of 780.0 GiB) in 20m 9s, read: 2.9 GiB/s, write: 0 B/s ERROR: VM 100 qmp command 'query-backup' failed - got timeout INFO: aborting backup job ERROR: VM 100 qmp command 'backup-cancel' failed - unable to connect to VM 100 qmp socket - timeout after 5974 retries INFO: resuming VM again ERROR: Backup of VM 100 failed - VM 100 qmp command 'cont' failed - unable to connect to VM 100 qmp socket - timeout after 450 retries INFO: Failed at 2022-07-08 21:41:52 INFO: Backup job finished with errors TASK ERROR: job errors
Ich verstehe das so, dass das Backup quasi fertig war, dann aber irgendwas schief gelaufen ist.

Der Fehler war vor 5-6 Wochen schon mal, nachdem das nun wiederholt mit gleichem Verhalten auftritt dachte ich mir ich frage mal nach... Evtl. kann man ja bessere Einstellungen setzen, um das zu umgehen, oder es ist ein bekannter Bug?

Ach ja: Ist eine Windows Server 2019 VM, falls das hilft

Danke!
 
Last edited:
Hallo,
Troubadix said:
Hallo,

leider hat eine der VMs das nächtliche Backup/Snapshot nicht überlebt.
CPU- und RAM-Auslastung bei 100%, keiner der Dienste ansprechbar, auch per Konsole in Proxmox nicht erreichbar.

Reset im Proxmox ohne Erfolg (Timeout), nur hartes Abschalten und erneutes booten der VM hat geholfen.

Ausgabe des Backup-Tasks:
Version:0.9 StartHTML:-1 EndHTML:-1 StartFragment:0000000121 EndFragment:0000130128 INFO: starting new backup job: vzdump 100 --mailto hostmaster@domain.tld --mode snapshot --compress zstd --quiet 1 --mailnotification failure --storage qnap-nfs INFO: Starting Backup of VM 100 (qemu) INFO: Backup started at 2022-07-08 21:00:16 INFO: status = running INFO: VM Name: fzimue-wsrv1 INFO: include disk 'ide0' 'local-lvm:vm-100-disk-0' 750G INFO: include disk 'sata1' 'local-lvm:vm-100-disk-1' 30G INFO: include disk 'tpmstate0' 'local-lvm:vm-100-disk-2' 4M INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-100-2022_07_08-21_00_03.vma.zst' INFO: attaching TPM drive to QEMU for backup INFO: issuing guest-agent 'fs-freeze' command INFO: issuing guest-agent 'fs-thaw' command INFO: started backup task '7dacf962-7b47-41bb-9404-32bf7e5ea3b4' INFO: resuming VM again INFO: 1% (15.5 GiB of 780.0 GiB) in 3s, read: 5.2 GiB/s, write: 17.6 MiB/s INFO: 3% (25.0 GiB of 780.0 GiB) in 6s, read: 3.2 GiB/s, write: 312.0 KiB/s INFO: 4% (31.2 GiB of 780.0 GiB) in 14s, read: 794.3 MiB/s, write: 129.0 MiB/s INFO: 5% (39.1 GiB of 780.0 GiB) in 1m 17s, read: 127.8 MiB/s, write: 126.9 MiB/s INFO: 6% (46.9 GiB of 780.0 GiB) in 1m 41s, read: 334.3 MiB/s, write: 148.0 MiB/s INFO: 7% (54.6 GiB of 780.0 GiB) in 2m 38s, read: 138.8 MiB/s, write: 137.8 MiB/s INFO: 8% (63.0 GiB of 780.0 GiB) in 3m 14s, read: 237.0 MiB/s, write: 145.4 MiB/s INFO: 9% (70.2 GiB of 780.0 GiB) in 3m 58s, read: 169.4 MiB/s, write: 149.1 MiB/s INFO: 10% (78.1 GiB of 780.0 GiB) in 4m 50s, read: 155.7 MiB/s, write: 154.5 MiB/s INFO: 11% (86.0 GiB of 780.0 GiB) in 5m 46s, read: 142.9 MiB/s, write: 142.4 MiB/s INFO: 12% (93.6 GiB of 780.0 GiB) in 6m 36s, read: 157.1 MiB/s, write: 157.0 MiB/s INFO: 13% (102.6 GiB of 780.0 GiB) in 7m 11s, read: 262.7 MiB/s, write: 192.0 MiB/s INFO: 14% (109.4 GiB of 780.0 GiB) in 7m 14s, read: 2.3 GiB/s, write: 66.5 MiB/s INFO: 15% (119.4 GiB of 780.0 GiB) in 7m 17s, read: 3.3 GiB/s, write: 0 B/s INFO: 16% (129.5 GiB of 780.0 GiB) in 7m 20s, read: 3.3 GiB/s, write: 0 B/s INFO: 17% (139.5 GiB of 780.0 GiB) in 7m 23s, read: 3.3 GiB/s, write: 0 B/s INFO: 19% (149.5 GiB of 780.0 GiB) in 7m 26s, read: 3.3 GiB/s, write: 0 B/s INFO: 20% (159.2 GiB of 780.0 GiB) in 7m 29s, read: 3.2 GiB/s, write: 0 B/s INFO: 21% (168.9 GiB of 780.0 GiB) in 7m 32s, read: 3.2 GiB/s, write: 0 B/s INFO: 22% (178.7 GiB of 780.0 GiB) in 7m 35s, read: 3.3 GiB/s, write: 21.3 KiB/s INFO: 24% (188.5 GiB of 780.0 GiB) in 7m 38s, read: 3.3 GiB/s, write: 21.3 KiB/s INFO: 25% (198.2 GiB of 780.0 GiB) in 7m 41s, read: 3.2 GiB/s, write: 0 B/s INFO: 26% (207.9 GiB of 780.0 GiB) in 7m 44s, read: 3.2 GiB/s, write: 0 B/s INFO: 27% (217.8 GiB of 780.0 GiB) in 7m 47s, read: 3.3 GiB/s, write: 0 B/s INFO: 29% (227.8 GiB of 780.0 GiB) in 7m 50s, read: 3.3 GiB/s, write: 0 B/s INFO: 30% (237.9 GiB of 780.0 GiB) in 7m 53s, read: 3.4 GiB/s, write: 0 B/s INFO: 31% (247.9 GiB of 780.0 GiB) in 7m 56s, read: 3.4 GiB/s, write: 0 B/s INFO: 33% (257.7 GiB of 780.0 GiB) in 7m 59s, read: 3.2 GiB/s, write: 0 B/s INFO: 34% (266.8 GiB of 780.0 GiB) in 8m 2s, read: 3.0 GiB/s, write: 0 B/s INFO: 35% (275.9 GiB of 780.0 GiB) in 8m 6s, read: 2.3 GiB/s, write: 16.0 KiB/s INFO: 36% (280.8 GiB of 780.0 GiB) in 8m 14s, read: 624.3 MiB/s, write: 99.9 MiB/s INFO: 37% (288.6 GiB of 780.0 GiB) in 9m 9s, read: 145.2 MiB/s, write: 140.8 MiB/s INFO: 38% (296.4 GiB of 780.0 GiB) in 9m 51s, read: 190.7 MiB/s, write: 190.4 MiB/s INFO: 39% (304.4 GiB of 780.0 GiB) in 10m 32s, read: 197.8 MiB/s, write: 197.3 MiB/s INFO: 40% (312.0 GiB of 780.0 GiB) in 11m 13s, read: 191.2 MiB/s, write: 190.8 MiB/s INFO: 41% (319.9 GiB of 780.0 GiB) in 11m 54s, read: 196.8 MiB/s, write: 196.3 MiB/s INFO: 42% (327.7 GiB of 780.0 GiB) in 12m 41s, read: 170.4 MiB/s, write: 170.0 MiB/s INFO: 43% (335.5 GiB of 780.0 GiB) in 13m 28s, read: 170.5 MiB/s, write: 165.3 MiB/s INFO: 44% (343.3 GiB of 780.0 GiB) in 14m 10s, read: 190.4 MiB/s, write: 189.9 MiB/s INFO: 45% (351.0 GiB of 780.0 GiB) in 14m 50s, read: 196.8 MiB/s, write: 196.3 MiB/s INFO: 46% (359.0 GiB of 780.0 GiB) in 15m 31s, read: 197.8 MiB/s, write: 197.6 MiB/s INFO: 47% (366.7 GiB of 780.0 GiB) in 16m 12s, read: 194.4 MiB/s, write: 194.1 MiB/s INFO: 48% (374.6 GiB of 780.0 GiB) in 16m 23s, read: 736.1 MiB/s, write: 155.8 MiB/s INFO: 49% (382.3 GiB of 780.0 GiB) in 17m 1s, read: 205.4 MiB/s, write: 194.5 MiB/s INFO: 50% (390.1 GiB of 780.0 GiB) in 17m 42s, read: 196.6 MiB/s, write: 196.1 MiB/s INFO: 51% (398.6 GiB of 780.0 GiB) in 18m 2s, read: 433.5 MiB/s, write: 182.1 MiB/s INFO: 52% (407.6 GiB of 780.0 GiB) in 18m 5s, read: 3.0 GiB/s, write: 0 B/s INFO: 53% (416.5 GiB of 780.0 GiB) in 18m 8s, read: 3.0 GiB/s, write: 0 B/s INFO: 54% (425.4 GiB of 780.0 GiB) in 18m 11s, read: 3.0 GiB/s, write: 0 B/s INFO: 55% (434.3 GiB of 780.0 GiB) in 18m 14s, read: 3.0 GiB/s, write: 1.3 KiB/s INFO: 56% (443.2 GiB of 780.0 GiB) in 18m 17s, read: 3.0 GiB/s, write: 0 B/s INFO: 57% (452.2 GiB of 780.0 GiB) in 18m 20s, read: 3.0 GiB/s, write: 0 B/s INFO: 59% (461.1 GiB of 780.0 GiB) in 18m 23s, read: 3.0 GiB/s, write: 0 B/s INFO: 60% (470.1 GiB of 780.0 GiB) in 18m 27s, read: 2.2 GiB/s, write: 0 B/s INFO: 61% (479.3 GiB of 780.0 GiB) in 18m 30s, read: 3.0 GiB/s, write: 0 B/s INFO: 62% (488.3 GiB of 780.0 GiB) in 18m 33s, read: 3.0 GiB/s, write: 0 B/s INFO: 63% (497.3 GiB of 780.0 GiB) in 18m 36s, read: 3.0 GiB/s, write: 0 B/s INFO: 64% (506.4 GiB of 780.0 GiB) in 18m 39s, read: 3.0 GiB/s, write: 0 B/s INFO: 66% (515.3 GiB of 780.0 GiB) in 18m 42s, read: 3.0 GiB/s, write: 0 B/s INFO: 67% (524.3 GiB of 780.0 GiB) in 18m 45s, read: 3.0 GiB/s, write: 0 B/s INFO: 68% (533.4 GiB of 780.0 GiB) in 18m 48s, read: 3.0 GiB/s, write: 0 B/s INFO: 69% (542.5 GiB of 780.0 GiB) in 18m 51s, read: 3.0 GiB/s, write: 0 B/s INFO: 70% (551.6 GiB of 780.0 GiB) in 18m 54s, read: 3.0 GiB/s, write: 0 B/s INFO: 71% (560.6 GiB of 780.0 GiB) in 18m 57s, read: 3.0 GiB/s, write: 0 B/s INFO: 73% (569.8 GiB of 780.0 GiB) in 19m, read: 3.1 GiB/s, write: 0 B/s INFO: 74% (578.9 GiB of 780.0 GiB) in 19m 3s, read: 3.0 GiB/s, write: 0 B/s INFO: 75% (587.8 GiB of 780.0 GiB) in 19m 6s, read: 3.0 GiB/s, write: 0 B/s INFO: 76% (596.8 GiB of 780.0 GiB) in 19m 9s, read: 3.0 GiB/s, write: 0 B/s INFO: 77% (605.8 GiB of 780.0 GiB) in 19m 12s, read: 3.0 GiB/s, write: 0 B/s INFO: 78% (614.9 GiB of 780.0 GiB) in 19m 15s, read: 3.0 GiB/s, write: 0 B/s INFO: 79% (623.8 GiB of 780.0 GiB) in 19m 18s, read: 3.0 GiB/s, write: 0 B/s INFO: 81% (632.8 GiB of 780.0 GiB) in 19m 21s, read: 3.0 GiB/s, write: 0 B/s INFO: 82% (641.6 GiB of 780.0 GiB) in 19m 24s, read: 3.0 GiB/s, write: 0 B/s INFO: 83% (650.6 GiB of 780.0 GiB) in 19m 27s, read: 3.0 GiB/s, write: 0 B/s INFO: 84% (659.5 GiB of 780.0 GiB) in 19m 30s, read: 3.0 GiB/s, write: 0 B/s INFO: 85% (668.4 GiB of 780.0 GiB) in 19m 33s, read: 3.0 GiB/s, write: 0 B/s INFO: 86% (677.3 GiB of 780.0 GiB) in 19m 36s, read: 3.0 GiB/s, write: 0 B/s INFO: 87% (686.2 GiB of 780.0 GiB) in 19m 39s, read: 3.0 GiB/s, write: 0 B/s INFO: 89% (695.2 GiB of 780.0 GiB) in 19m 42s, read: 3.0 GiB/s, write: 0 B/s INFO: 90% (704.1 GiB of 780.0 GiB) in 19m 45s, read: 3.0 GiB/s, write: 0 B/s INFO: 91% (713.0 GiB of 780.0 GiB) in 19m 48s, read: 3.0 GiB/s, write: 0 B/s INFO: 92% (722.1 GiB of 780.0 GiB) in 19m 51s, read: 3.0 GiB/s, write: 0 B/s INFO: 93% (731.0 GiB of 780.0 GiB) in 19m 54s, read: 3.0 GiB/s, write: 0 B/s INFO: 94% (739.9 GiB of 780.0 GiB) in 19m 57s, read: 3.0 GiB/s, write: 0 B/s INFO: 96% (748.9 GiB of 780.0 GiB) in 20m, read: 3.0 GiB/s, write: 0 B/s INFO: 97% (757.7 GiB of 780.0 GiB) in 20m 3s, read: 3.0 GiB/s, write: 0 B/s INFO: 98% (766.6 GiB of 780.0 GiB) in 20m 6s, read: 2.9 GiB/s, write: 0 B/s INFO: 99% (775.4 GiB of 780.0 GiB) in 20m 9s, read: 2.9 GiB/s, write: 0 B/s ERROR: VM 100 qmp command 'query-backup' failed - got timeout INFO: aborting backup job ERROR: VM 100 qmp command 'backup-cancel' failed - unable to connect to VM 100 qmp socket - timeout after 5974 retries INFO: resuming VM again ERROR: Backup of VM 100 failed - VM 100 qmp command 'cont' failed - unable to connect to VM 100 qmp socket - timeout after 450 retries INFO: Failed at 2022-07-08 21:41:52 INFO: Backup job finished with errors TASK ERROR: job errors
Ich verstehe das so, dass das Backup quasi fertig war, dann aber irgendwas schief gelaufen ist.

Der Fehler war vor 5-6 Wochen schon mal, nachdem das nun wiederholt mit gleichem Verhalten auftritt dachte ich mir ich frage mal nach... Evtl. kann man ja bessere Einstellungen setzen, um das zu umgehen, oder es ist ein bekannter Bug?

Ach ja: Ist eine Windows Server 2019 VM, falls das hilft

Danke!
Click to expand...
kannst Du bitte die Ausgabe von den folgenden Kommandos posten?
Code: 
pveversion -v
cat /etc/pve/storage.cfg
qm config 100
Gibt es in /var/log/syslog zum Zeitpunkt des Fehlers Meldungen?
 
Also ich erhalte timeouts für fs-freeze. Ich habe in diesem Thema auch davon gelesen https://forum.proxmox.com/threads/e...guest-fsfreeze-thaw-failed-got-timeout.68082/ und hier heißt der Work-Around "disable qemu quest agent". Das habe ich nun mal gemacht und schaue morgen mal wie sich das Backup verhält.

Aber dennoch komisch, dass es "auf einmal" bzw. nach den letzten pve/pbs updates auftaucht.

Disable:
  1. Login to pve > Your Machine > Options > QEMU Quest Agent > Set to disabled
Code: 
systemctl stop qemu-guest-agent.service
systemctl disable qemu-guest-agent.service
shutdown -r now
 
Guten Morgen,

10 Tage später... heute Nacht hat sich eine andere VM mit gleichem Fehlerbild während des Backups verabschiedet... Somit hier frische Logs:

INFO: trying to get global lock - waiting... INFO: got global lock INFO: starting new backup job: vzdump 104 --quiet 1 --mailto hostmaster@domain.tld --mode snapshot --compress zstd --storage qnap-nfs --mailnotification failure INFO: Starting Backup of VM 104 (qemu) INFO: Backup started at 2022-07-18 23:54:14 INFO: status = running INFO: VM Name: lustiger-vm-name INFO: include disk 'sata0' 'local-lvm:vm-104-disk-0' 512G INFO: include disk 'sata1' 'local-lvm:vm-104-disk-1' 30G INFO: include disk 'tpmstate0' 'local-lvm:vm-104-disk-2' 4M INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-104-2022_07_18-23_54_14.vma.zst' INFO: attaching TPM drive to QEMU for backup INFO: issuing guest-agent 'fs-freeze' command INFO: issuing guest-agent 'fs-thaw' command INFO: started backup task '03715d2b-9772-467f-b423-0b77ff389ff7' INFO: resuming VM again INFO: 2% (13.4 GiB of 542.0 GiB) in 4s, read: 3.3 GiB/s, write: 13.1 MiB/s INFO: 3% (20.9 GiB of 542.0 GiB) in 7s, read: 2.5 GiB/s, write: 444.0 KiB/s INFO: 4% (26.0 GiB of 542.0 GiB) in 10s, read: 1.7 GiB/s, write: 620.0 KiB/s INFO: 5% (30.3 GiB of 542.0 GiB) in 13s, read: 1.5 GiB/s, write: 65.3 MiB/s INFO: 6% (32.6 GiB of 542.0 GiB) in 30s, read: 136.3 MiB/s, write: 132.1 MiB/s INFO: 7% (38.0 GiB of 542.0 GiB) in 1m 15s, read: 123.7 MiB/s, write: 123.0 MiB/s INFO: 8% (43.5 GiB of 542.0 GiB) in 1m 53s, read: 145.8 MiB/s, write: 142.8 MiB/s INFO: 9% (48.9 GiB of 542.0 GiB) in 2m 31s, read: 148.0 MiB/s, write: 146.5 MiB/s INFO: 10% (54.2 GiB of 542.0 GiB) in 3m 11s, read: 135.2 MiB/s, write: 133.7 MiB/s INFO: 11% (59.7 GiB of 542.0 GiB) in 3m 49s, read: 148.8 MiB/s, write: 147.7 MiB/s INFO: 12% (65.2 GiB of 542.0 GiB) in 4m 30s, read: 135.5 MiB/s, write: 133.8 MiB/s INFO: 13% (70.5 GiB of 542.0 GiB) in 5m 8s, read: 143.8 MiB/s, write: 142.5 MiB/s INFO: 14% (76.0 GiB of 542.0 GiB) in 5m 59s, read: 109.8 MiB/s, write: 109.3 MiB/s INFO: 15% (81.4 GiB of 542.0 GiB) in 6m 37s, read: 146.0 MiB/s, write: 145.5 MiB/s INFO: 16% (86.8 GiB of 542.0 GiB) in 7m 30s, read: 104.4 MiB/s, write: 103.9 MiB/s INFO: 17% (92.1 GiB of 542.0 GiB) in 9m 38s, read: 42.8 MiB/s, write: 42.6 MiB/s INFO: 18% (97.6 GiB of 542.0 GiB) in 10m 59s, read: 69.2 MiB/s, write: 69.1 MiB/s INFO: 19% (103.3 GiB of 542.0 GiB) in 11m 18s, read: 306.8 MiB/s, write: 206.7 MiB/s INFO: 20% (109.0 GiB of 542.0 GiB) in 11m 22s, read: 1.4 GiB/s, write: 26.2 MiB/s INFO: 21% (116.9 GiB of 542.0 GiB) in 11m 27s, read: 1.6 GiB/s, write: 0 B/s INFO: 22% (123.5 GiB of 542.0 GiB) in 11m 31s, read: 1.6 GiB/s, write: 0 B/s INFO: 23% (130.0 GiB of 542.0 GiB) in 11m 34s, read: 2.2 GiB/s, write: 0 B/s INFO: 24% (131.0 GiB of 542.0 GiB) in 11m 37s, read: 352.8 MiB/s, write: 152.4 MiB/s INFO: 25% (135.6 GiB of 542.0 GiB) in 12m 6s, read: 161.1 MiB/s, write: 154.2 MiB/s INFO: 26% (143.2 GiB of 542.0 GiB) in 13m 22s, read: 102.5 MiB/s, write: 54.3 MiB/s INFO: 27% (148.6 GiB of 542.0 GiB) in 13m 44s, read: 251.6 MiB/s, write: 33.8 MiB/s INFO: 28% (152.0 GiB of 542.0 GiB) in 13m 58s, read: 248.6 MiB/s, write: 15.6 MiB/s INFO: 29% (157.3 GiB of 542.0 GiB) in 14m 30s, read: 169.4 MiB/s, write: 153.9 MiB/s INFO: 30% (162.7 GiB of 542.0 GiB) in 14m 57s, read: 206.4 MiB/s, write: 205.2 MiB/s INFO: 31% (168.1 GiB of 542.0 GiB) in 15m 23s, read: 211.1 MiB/s, write: 210.1 MiB/s INFO: 32% (173.5 GiB of 542.0 GiB) in 15m 49s, read: 213.3 MiB/s, write: 212.5 MiB/s INFO: 33% (181.3 GiB of 542.0 GiB) in 16m 15s, read: 305.8 MiB/s, write: 195.1 MiB/s INFO: 34% (187.4 GiB of 542.0 GiB) in 16m 18s, read: 2.0 GiB/s, write: 0 B/s INFO: 35% (193.1 GiB of 542.0 GiB) in 16m 21s, read: 1.9 GiB/s, write: 625.3 KiB/s INFO: 37% (201.4 GiB of 542.0 GiB) in 16m 24s, read: 2.7 GiB/s, write: 0 B/s INFO: 38% (206.9 GiB of 542.0 GiB) in 16m 27s, read: 1.9 GiB/s, write: 0 B/s INFO: 39% (215.4 GiB of 542.0 GiB) in 16m 30s, read: 2.8 GiB/s, write: 0 B/s INFO: 40% (221.1 GiB of 542.0 GiB) in 16m 33s, read: 1.9 GiB/s, write: 0 B/s INFO: 42% (229.2 GiB of 542.0 GiB) in 16m 36s, read: 2.7 GiB/s, write: 0 B/s INFO: 43% (234.8 GiB of 542.0 GiB) in 16m 39s, read: 1.8 GiB/s, write: 0 B/s INFO: 44% (243.1 GiB of 542.0 GiB) in 16m 42s, read: 2.8 GiB/s, write: 0 B/s INFO: 45% (248.6 GiB of 542.0 GiB) in 16m 45s, read: 1.8 GiB/s, write: 0 B/s INFO: 47% (256.5 GiB of 542.0 GiB) in 16m 49s, read: 2.0 GiB/s, write: 0 B/s INFO: 48% (264.4 GiB of 542.0 GiB) in 16m 52s, read: 2.6 GiB/s, write: 0 B/s INFO: 49% (269.9 GiB of 542.0 GiB) in 16m 55s, read: 1.8 GiB/s, write: 0 B/s INFO: 51% (278.5 GiB of 542.0 GiB) in 16m 58s, read: 2.9 GiB/s, write: 0 B/s INFO: 52% (283.9 GiB of 542.0 GiB) in 17m 1s, read: 1.8 GiB/s, write: 0 B/s INFO: 53% (292.3 GiB of 542.0 GiB) in 17m 4s, read: 2.8 GiB/s, write: 0 B/s INFO: 54% (297.5 GiB of 542.0 GiB) in 17m 7s, read: 1.7 GiB/s, write: 0 B/s INFO: 56% (305.9 GiB of 542.0 GiB) in 17m 10s, read: 2.8 GiB/s, write: 0 B/s INFO: 57% (311.4 GiB of 542.0 GiB) in 17m 13s, read: 1.8 GiB/s, write: 0 B/s INFO: 59% (319.9 GiB of 542.0 GiB) in 17m 16s, read: 2.8 GiB/s, write: 0 B/s INFO: 60% (325.7 GiB of 542.0 GiB) in 17m 19s, read: 1.9 GiB/s, write: 0 B/s INFO: 61% (333.1 GiB of 542.0 GiB) in 17m 23s, read: 1.9 GiB/s, write: 0 B/s INFO: 63% (342.5 GiB of 542.0 GiB) in 17m 27s, read: 2.3 GiB/s, write: 0 B/s INFO: 64% (350.6 GiB of 542.0 GiB) in 17m 30s, read: 2.7 GiB/s, write: 0 B/s INFO: 65% (356.0 GiB of 542.0 GiB) in 17m 33s, read: 1.8 GiB/s, write: 0 B/s INFO: 67% (364.2 GiB of 542.0 GiB) in 17m 36s, read: 2.7 GiB/s, write: 0 B/s INFO: 68% (369.3 GiB of 542.0 GiB) in 17m 39s, read: 1.7 GiB/s, write: 0 B/s INFO: 69% (377.6 GiB of 542.0 GiB) in 17m 42s, read: 2.8 GiB/s, write: 0 B/s INFO: 70% (383.0 GiB of 542.0 GiB) in 17m 45s, read: 1.8 GiB/s, write: 1.3 KiB/s INFO: 72% (391.8 GiB of 542.0 GiB) in 17m 49s, read: 2.2 GiB/s, write: 0 B/s INFO: 73% (399.8 GiB of 542.0 GiB) in 17m 52s, read: 2.7 GiB/s, write: 0 B/s INFO: 74% (405.3 GiB of 542.0 GiB) in 17m 55s, read: 1.8 GiB/s, write: 0 B/s INFO: 76% (413.7 GiB of 542.0 GiB) in 17m 59s, read: 2.1 GiB/s, write: 0 B/s INFO: 77% (421.6 GiB of 542.0 GiB) in 18m 2s, read: 2.7 GiB/s, write: 0 B/s INFO: 78% (427.0 GiB of 542.0 GiB) in 18m 5s, read: 1.8 GiB/s, write: 0 B/s INFO: 80% (434.9 GiB of 542.0 GiB) in 18m 8s, read: 2.6 GiB/s, write: 0 B/s INFO: 81% (440.2 GiB of 542.0 GiB) in 18m 11s, read: 1.8 GiB/s, write: 0 B/s INFO: 82% (448.6 GiB of 542.0 GiB) in 18m 14s, read: 2.8 GiB/s, write: 0 B/s INFO: 83% (454.0 GiB of 542.0 GiB) in 18m 17s, read: 1.8 GiB/s, write: 0 B/s INFO: 85% (462.4 GiB of 542.0 GiB) in 18m 20s, read: 2.8 GiB/s, write: 0 B/s INFO: 86% (467.9 GiB of 542.0 GiB) in 18m 23s, read: 1.8 GiB/s, write: 0 B/s INFO: 87% (476.2 GiB of 542.0 GiB) in 18m 26s, read: 2.8 GiB/s, write: 0 B/s INFO: 88% (481.5 GiB of 542.0 GiB) in 18m 29s, read: 1.8 GiB/s, write: 0 B/s INFO: 90% (490.5 GiB of 542.0 GiB) in 18m 32s, read: 3.0 GiB/s, write: 0 B/s INFO: 91% (495.9 GiB of 542.0 GiB) in 18m 35s, read: 1.8 GiB/s, write: 0 B/s INFO: 92% (502.0 GiB of 542.0 GiB) in 18m 38s, read: 2.0 GiB/s, write: 0 B/s INFO: 94% (510.3 GiB of 542.0 GiB) in 18m 41s, read: 2.8 GiB/s, write: 0 B/s INFO: 95% (516.0 GiB of 542.0 GiB) in 18m 44s, read: 1.9 GiB/s, write: 0 B/s INFO: 96% (522.9 GiB of 542.0 GiB) in 18m 47s, read: 2.3 GiB/s, write: 0 B/s INFO: 97% (531.0 GiB of 542.0 GiB) in 18m 50s, read: 2.7 GiB/s, write: 0 B/s INFO: 98% (536.3 GiB of 542.0 GiB) in 18m 53s, read: 1.8 GiB/s, write: 0 B/s ERROR: VM 104 qmp command 'query-backup' failed - got timeout INFO: aborting backup job ERROR: VM 104 qmp command 'backup-cancel' failed - unable to connect to VM 104 qmp socket - timeout after 5987 retries INFO: resuming VM again ERROR: Backup of VM 104 failed - VM 104 qmp command 'cont' failed - unable to connect to VM 104 qmp socket - timeout after 450 retries INFO: Failed at 2022-07-19 00:34:08 INFO: Backup job finished with errors TASK ERROR: job errors

root@xxx~# pveversion -v proxmox-ve: 7.2-1 (running kernel: 5.15.39-1-pve) pve-manager: 7.2-7 (running version: 7.2-7/d0dd0e85) pve-kernel-5.15: 7.2-6 pve-kernel-helper: 7.2-6 pve-kernel-5.13: 7.1-9 pve-kernel-5.4: 6.4-4 pve-kernel-5.15.39-1-pve: 5.15.39-1 pve-kernel-5.15.35-2-pve: 5.15.35-5 pve-kernel-5.13.19-6-pve: 5.13.19-15 pve-kernel-5.13.19-2-pve: 5.13.19-4 pve-kernel-5.4.124-1-pve: 5.4.124-1 pve-kernel-5.4.106-1-pve: 5.4.106-1 ceph-fuse: 14.2.21-1 corosync: 3.1.5-pve2 criu: 3.15-1+pve-1 glusterfs-client: 9.2-1 ifupdown: residual config ifupdown2: 3.1.0-1+pmx3 ksm-control-daemon: 1.4-1 libjs-extjs: 7.0.0-1 libknet1: 1.24-pve1 libproxmox-acme-perl: 1.4.2 libproxmox-backup-qemu0: 1.3.1-1 libpve-access-control: 7.2-3 libpve-apiclient-perl: 3.2-1 libpve-common-perl: 7.2-2 libpve-guest-common-perl: 4.1-2 libpve-http-server-perl: 4.1-3 libpve-storage-perl: 7.2-5 libqb0: 1.0.5-1 libspice-server1: 0.14.3-2.1 lvm2: 2.03.11-2.1 lxc-pve: 5.0.0-3 lxcfs: 4.0.12-pve1 novnc-pve: 1.3.0-3 proxmox-backup-client: 2.2.3-1 proxmox-backup-file-restore: 2.2.3-1 proxmox-mini-journalreader: 1.3-1 proxmox-widget-toolkit: 3.5.1 pve-cluster: 7.2-1 pve-container: 4.2-1 pve-docs: 7.2-2 pve-edk2-firmware: 3.20210831-2 pve-firewall: 4.2-5 pve-firmware: 3.4-2 pve-ha-manager: 3.3-4 pve-i18n: 2.7-2 pve-qemu-kvm: 6.2.0-11 pve-xtermjs: 4.16.0-1 qemu-server: 7.2-3 smartmontools: 7.2-pve3 spiceterm: 3.2-2 swtpm: 0.7.1~bpo11+1 vncterm: 1.7-1 zfsutils-linux: 2.1.4-pve1

root@xxx:~# cat /etc/pve/storage.cfg dir: local path /var/lib/vz content backup,vztmpl,iso lvmthin: local-lvm thinpool data vgname pve content images,rootdir nfs: qnap-nfs export /proxmox path /mnt/pve/qnap-nfs server 192.168.178.100 content images,backup prune-backups keep-last=7

root@xxx:~# qm config 104 user config - ignore invalid group member 'domaene\meinadmin2@bla.blubb.de' agent: 1 boot: order=sata0;ide2 cores: 14 ide2: none,media=cdrom machine: pc-i440fx-5.2 memory: 24576 name: lustiger-vm-name net0: virtio=A6:66:FA:E5:74:03,bridge=vmbr0,firewall=1 net1: virtio=EE:CC:B2:49:19:2A,bridge=vmbr1,firewall=1 numa: 0 onboot: 1 ostype: win10 sata0: local-lvm:vm-104-disk-0,size=512G sata1: local-lvm:vm-104-disk-1,size=30G,ssd=1 scsihw: virtio-scsi-pci smbios1: uuid=679bf6f8-9a23-4e2d-b375-51fd3f170b72 sockets: 1 startup: order=2,up=30,down=30 tpmstate0: local-lvm:vm-104-disk-2,size=4M,version=v2.0 vmgenid: c53058f5-a9a1-4d8e-ae45-c706369c365a
 
Last edited:
Und noch das Syslog:

Lt. Webinterface kam der Fehler um 00:34:10, aber davor und danach steht schon der gleiche Kram drin - bis ich dann ca. 7:20 die VM "abgeschossen" und neu gestartet habe.
 

Attachments

Nachdem nun einige Zeit Ruhe war, hat sich heute Nacht leider wieder eine VM beim Backup aufgehängt :(

vzdump 102 --mailto hostmaster@blafasel.de --compress zstd --storage qnap-nfs --quiet 1 --mode snapshot --mailnotification failure 102: 2022-09-08 00:00:04 INFO: Starting Backup of VM 102 (qemu) 102: 2022-09-08 00:00:04 INFO: status = running 102: 2022-09-08 00:00:04 INFO: VM Name: lustiger-vm-name 102: 2022-09-08 00:00:04 INFO: include disk 'sata0' 'local-lvm:vm-102-disk-0' 600G 102: 2022-09-08 00:00:04 INFO: include disk 'sata1' 'local-lvm:vm-102-disk-1' 30G 102: 2022-09-08 00:00:04 INFO: include disk 'tpmstate0' 'local-lvm:vm-102-disk-2' 4M 102: 2022-09-08 00:00:05 INFO: backup mode: snapshot 102: 2022-09-08 00:00:05 INFO: ionice priority: 7 102: 2022-09-08 00:00:05 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-102-2022_09_08-00_00_04.vma.zst' 102: 2022-09-08 00:00:05 INFO: attaching TPM drive to QEMU for backup 102: 2022-09-08 00:00:05 INFO: issuing guest-agent 'fs-freeze' command 102: 2022-09-08 00:00:47 INFO: issuing guest-agent 'fs-thaw' command 102: 2022-09-08 00:03:47 ERROR: VM 102 qmp command 'guest-fsfreeze-thaw' failed - got timeout 102: 2022-09-08 00:03:47 ERROR: got timeout 102: 2022-09-08 00:03:47 INFO: aborting backup job 102: 2022-09-08 00:13:47 ERROR: VM 102 qmp command 'backup-cancel' failed - unable to connect to VM 102 qmp socket - timeout after 5988 retries 102: 2022-09-08 00:13:47 INFO: resuming VM again 102: 2022-09-08 00:14:35 ERROR: Backup of VM 102 failed - VM 102 qmp command 'cont' failed - unable to connect to VM 102 qmp socket - timeout after 450 retries

pveversion -v proxmox-ve: 7.2-1 (running kernel: 5.15.39-4-pve) pve-manager: 7.2-7 (running version: 7.2-7/d0dd0e85) pve-kernel-5.15: 7.2-9 pve-kernel-helper: 7.2-9 pve-kernel-5.13: 7.1-9 pve-kernel-5.4: 6.4-4 pve-kernel-5.15.39-4-pve: 5.15.39-4 pve-kernel-5.15.39-3-pve: 5.15.39-3 pve-kernel-5.13.19-6-pve: 5.13.19-15 pve-kernel-5.13.19-2-pve: 5.13.19-4 pve-kernel-5.4.124-1-pve: 5.4.124-1 pve-kernel-5.4.73-1-pve: 5.4.73-1 ceph-fuse: 14.2.21-1 corosync: 3.1.5-pve2 criu: 3.15-1+pve-1 glusterfs-client: 9.2-1 ifupdown: residual config ifupdown2: 3.1.0-1+pmx3 ksm-control-daemon: 1.4-1 libjs-extjs: 7.0.0-1 libknet1: 1.24-pve1 libproxmox-acme-perl: 1.4.2 libproxmox-backup-qemu0: 1.3.1-1 libpve-access-control: 7.2-4 libpve-apiclient-perl: 3.2-1 libpve-common-perl: 7.2-2 libpve-guest-common-perl: 4.1-2 libpve-http-server-perl: 4.1-3 libpve-storage-perl: 7.2-8 libqb0: 1.0.5-1 libspice-server1: 0.14.3-2.1 lvm2: 2.03.11-2.1 lxc-pve: 5.0.0-3 lxcfs: 4.0.12-pve1 novnc-pve: 1.3.0-3 proxmox-backup-client: 2.2.5-1 proxmox-backup-file-restore: 2.2.5-1 proxmox-mini-journalreader: 1.3-1 proxmox-widget-toolkit: 3.5.1 pve-cluster: 7.2-2 pve-container: 4.2-2 pve-docs: 7.2-2 pve-edk2-firmware: 3.20220526-1 pve-firewall: 4.2-5 pve-firmware: 3.5-1 pve-ha-manager: 3.4.0 pve-i18n: 2.7-2 pve-qemu-kvm: 7.0.0-2 pve-xtermjs: 4.16.0-1 qemu-server: 7.2-4 smartmontools: 7.2-pve3 spiceterm: 3.2-2 swtpm: 0.7.1~bpo11+1 vncterm: 1.7-1 zfsutils-linux: 2.1.5-pve1

cat /etc/pve/storage.cfg dir: local path /var/lib/vz content backup,vztmpl,iso lvmthin: local-lvm thinpool data vgname pve content images,rootdir nfs: qnap-nfs export /proxmox path /mnt/pve/qnap-nfs server 192.168.178.100 content images,backup prune-backups keep-last=7

qm config 102 agent: 1 boot: order=sata0;ide2 cores: 14 ide2: none,media=cdrom machine: pc-i440fx-7.0 memory: 24576 name: lustiger-vm-name net0: virtio=66:69:E8:AB:AF:A8,bridge=vmbr0,firewall=1 net1: e1000=76:95:28:0E:48:DD,bridge=vmbr1,firewall=1 numa: 0 onboot: 1 ostype: win10 sata0: local-lvm:vm-102-disk-0,size=600G sata1: local-lvm:vm-102-disk-1,size=30G,ssd=1 scsihw: virtio-scsi-pci smbios1: uuid=b26cedff-eb0d-416f-b6da-762c9bf39016 sockets: 1 startup: order=1,up=30,down=30 tpmstate0: local-lvm:vm-102-disk-2,size=4M,version=v2.0 vmgenid: 41210554-a308-4634-a605-b4fd98461512

Und dann noch das Syslog im Anhang


Eine Idee, wie man das dauerhaft beheben kann?
Danke!
 

Attachments

Last edited:
Nachdem zuletzt lange Ruhe war hab ich am Samstag das Update von 7.3-4 auf 7.3-6 eingespielt. In der Nacht darauf hat es direkt zwei VMs auf zwei getrennten Hosts gekillt

INFO: starting new backup job: vzdump 100 --compress zstd --quiet 1 --storage qnap-nfs --mailnotification failure --mode snapshot --mailto hostmaster@domain.tld INFO: Starting Backup of VM 100 (qemu) INFO: Backup started at 2023-02-11 21:00:01 INFO: status = running INFO: VM Name: vm1 INFO: include disk 'ide0' 'local-lvm:vm-100-disk-0' 750G INFO: include disk 'sata1' 'local-lvm:vm-100-disk-1' 30G INFO: include disk 'tpmstate0' 'local-lvm:vm-100-disk-2' 4M INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-100-2023_02_11-21_00_01.vma.zst' INFO: attaching TPM drive to QEMU for backup INFO: issuing guest-agent 'fs-freeze' command INFO: issuing guest-agent 'fs-thaw' command ERROR: VM 100 qmp command 'guest-fsfreeze-thaw' failed - got timeout ERROR: got timeout INFO: aborting backup job ERROR: VM 100 qmp command 'backup-cancel' failed - unable to connect to VM 100 qmp socket - timeout after 5988 retries INFO: resuming VM again ERROR: Backup of VM 100 failed - VM 100 qmp command 'cont' failed - unable to connect to VM 100 qmp socket - timeout after 451 retries INFO: Failed at 2023-02-11 21:14:30 INFO: Backup job finished with errors TASK ERROR: job errors

NFO: starting new backup job: vzdump 102 --mode snapshot --mailto hostmaster@domain.tld --storage qnap-nfs --mailnotification failure --compress zstd --quiet 1 INFO: Starting Backup of VM 102 (qemu) INFO: Backup started at 2023-02-12 00:00:02 INFO: status = running INFO: VM Name: vm5 INFO: include disk 'sata0' 'local-lvm:vm-102-disk-0' 600G INFO: include disk 'sata1' 'local-lvm:vm-102-disk-1' 30G INFO: include disk 'tpmstate0' 'local-lvm:vm-102-disk-2' 4M INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: creating vzdump archive '/mnt/pve/qnap-nfs/dump/vzdump-qemu-102-2023_02_12-00_00_02.vma.zst' INFO: attaching TPM drive to QEMU for backup INFO: issuing guest-agent 'fs-freeze' command INFO: issuing guest-agent 'fs-thaw' command ERROR: VM 102 qmp command 'guest-fsfreeze-thaw' failed - unable to connect to VM 102 qga socket - timeout after 1797 retries ERROR: got timeout INFO: aborting backup job ERROR: VM 102 qmp command 'backup-cancel' failed - unable to connect to VM 102 qmp socket - timeout after 5987 retries INFO: resuming VM again ERROR: Backup of VM 102 failed - VM 102 qmp command 'cont' failed - unable to connect to VM 102 qmp socket - timeout after 450 retries INFO: Failed at 2023-02-12 00:14:43 INFO: Backup job finished with errors TASK ERROR: job errors

Langsam wird das lästig :(
 
Troubadix said:
Nachdem zuletzt lange Ruhe war hab ich am Samstag das Update von 7.3-4 auf 7.3-6 eingespielt. In der Nacht darauf hat es direkt zwei VMs auf zwei getrennten Hosts gekillt
:(
Click to expand...
Kann es sein, dass nur VMs mit SATA-Disken betroffen sind? Was läuft innerhalb der betroffenen VMs?

Du könntest versuchen, auf SCSI umzustellen (für Windows, siehe hier: https://pve.proxmox.com/wiki/Paravirtualized_Block_Drivers_for_Windows).

Vorher natürlich testen, ob Du ein funktionierendes Backup hast (mit anderer ID wiederherstellen). Insbesondere, weil es da einen weiteren Bug mit SATA (und vermutlich Backup) gibt, der sehr selten auftritt, aber einzelne Benutzer öfters zu betreffen scheint: https://bugzilla.proxmox.com/show_bug.cgi?id=2874 Konnten wir allerdings noch nie nachstellen und es ist nicht klar, was ihn auslöst.
 
You must log in or register to reply here.
Top Bottom