Backup Failed, VM not running

gdi2k

Renowned Member
Aug 13, 2016
83
1
73
I'm having an issue backing up a VM since reverting to a snapshot. A few days ago, I took a snapshot, installed some invasive updates into the VM OS, which went wrong, so I reverted to the snapshot. It went ok, although the VM showed as red for some time, before correcting itself.

Since then however, the backup has been failing. Here's the backup log:

Code:
INFO: /root/bin/backup-script: Running with action=log-end, vm=101
INFO: Starting Backup of VM 131 (qemu)
INFO: status = running
INFO: update VM 131: -lock backup
INFO: VM Name: freepbx90
INFO: include disk 'virtio0' 'ceph:vm-131-disk-1' 100G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: /root/bin/backup-script: Running with action=backup-start, vm=131
INFO: /root/bin/backup-script: Running with action=pre-stop, vm=131
INFO: /root/bin/backup-script: Running with action=pre-restart, vm=131
INFO: /root/bin/backup-script: Running with action=post-restart, vm=131
INFO: creating archive '/mnt/backup/dump/vzdump-qemu-131-2017_01_11-17_23_30.vma.lzo'
INFO: started backup task '68b654aa-2430-454b-b119-347a9f373c01'
INFO: status: 0% (463732736/107374182400), sparse 0% (322117632), duration 3, 154/47 MB/s
INFO: status: 1% (1158021120/107374182400), sparse 0% (330199040), duration 10, 99/98 MB/s
INFO: status: 2% (2187526144/107374182400), sparse 0% (340262912), duration 21, 93/92 MB/s
INFO: status: 3% (3310747648/107374182400), sparse 0% (374386688), duration 32, 102/99 MB/s
INFO: status: 4% (4322885632/107374182400), sparse 0% (383692800), duration 42, 101/100 MB/s
INFO: status: 5% (5439946752/107374182400), sparse 0% (415784960), duration 53, 101/98 MB/s
INFO: status: 6% (6446645248/107374182400), sparse 0% (416849920), duration 63, 100/100 MB/s
INFO: status: 7% (7605977088/107374182400), sparse 0% (467730432), duration 74, 105/100 MB/s
INFO: status: 8% (8602517504/107374182400), sparse 0% (467914752), duration 84, 99/99 MB/s
INFO: status: 9% (9698344960/107374182400), sparse 0% (500264960), duration 95, 99/96 MB/s
INFO: status: 10% (10786111488/107374182400), sparse 0% (500408320), duration 106, 98/98 MB/s
INFO: status: 11% (11890327552/107374182400), sparse 0% (534233088), duration 117, 100/97 MB/s
INFO: status: 12% (12885688320/107374182400), sparse 0% (534294528), duration 127, 99/99 MB/s
INFO: status: 13% (14026014720/107374182400), sparse 0% (566317056), duration 138, 103/100 MB/s
INFO: status: 14% (15109324800/107374182400), sparse 0% (566579200), duration 148, 108/108 MB/s
INFO: status: 15% (16158425088/107374182400), sparse 0% (581169152), duration 159, 95/94 MB/s
INFO: status: 16% (17181245440/107374182400), sparse 0% (597991424), duration 170, 92/91 MB/s
INFO: status: 17% (18298437632/107374182400), sparse 0% (633876480), duration 182, 93/90 MB/s
INFO: status: 18% (19377946624/107374182400), sparse 0% (637722624), duration 194, 89/89 MB/s
INFO: status: 19% (20431699968/107374182400), sparse 0% (673656832), duration 205, 95/92 MB/s
INFO: status: 20% (21519466496/107374182400), sparse 0% (673959936), duration 217, 90/90 MB/s
INFO: status: 21% (22605135872/107374182400), sparse 0% (707162112), duration 230, 83/80 MB/s
INFO: status: 22% (23714988032/107374182400), sparse 0% (724299776), duration 242, 92/91 MB/s
INFO: status: 23% (24758583296/107374182400), sparse 0% (758050816), duration 251, 115/112 MB/s
INFO: status: 24% (25814958080/107374182400), sparse 0% (758849536), duration 260, 117/117 MB/s
INFO: status: 25% (26883588096/107374182400), sparse 0% (796475392), duration 269, 118/114 MB/s
INFO: status: 26% (27937996800/107374182400), sparse 0% (796975104), duration 280, 95/95 MB/s
INFO: status: 27% (29025370112/107374182400), sparse 0% (830095360), duration 291, 98/95 MB/s
INFO: status: 28% (30154227712/107374182400), sparse 0% (830787584), duration 303, 94/94 MB/s
INFO: status: 29% (31238651904/107374182400), sparse 0% (864542720), duration 314, 98/95 MB/s
INFO: status: 30% (32290242560/107374182400), sparse 0% (866934784), duration 326, 87/87 MB/s
INFO: status: 31% (33350746112/107374182400), sparse 0% (904060928), duration 337, 96/93 MB/s
INFO: status: 32% (34399584256/107374182400), sparse 0% (904212480), duration 348, 95/95 MB/s
INFO: status: 33% (35463364608/107374182400), sparse 0% (938283008), duration 359, 96/93 MB/s
INFO: status: 34% (36555522048/107374182400), sparse 0% (939290624), duration 370, 99/99 MB/s
INFO: status: 35% (37644861440/107374182400), sparse 0% (971968512), duration 381, 99/96 MB/s
INFO: status: 36% (38721683456/107374182400), sparse 0% (983425024), duration 391, 107/106 MB/s
INFO: status: 37% (39777468416/107374182400), sparse 0% (1016700928), duration 402, 95/92 MB/s
INFO: status: 38% (40884502528/107374182400), sparse 0% (1017380864), duration 414, 92/92 MB/s
INFO: status: 39% (41929801728/107374182400), sparse 0% (1051234304), duration 425, 95/91 MB/s
INFO: status: 40% (43028316160/107374182400), sparse 0% (1053089792), duration 437, 91/91 MB/s
INFO: status: 41% (44066013184/107374182400), sparse 1% (1091452928), duration 448, 94/90 MB/s
INFO: status: 42% (45168197632/107374182400), sparse 1% (1093898240), duration 460, 91/91 MB/s
INFO: status: 43% (46187020288/107374182400), sparse 1% (1129009152), duration 471, 92/89 MB/s
INFO: status: 44% (47301197824/107374182400), sparse 1% (1133785088), duration 483, 92/92 MB/s
INFO: status: 45% (48327032832/107374182400), sparse 1% (1168171008), duration 494, 93/90 MB/s
INFO: status: 46% (49453596672/107374182400), sparse 1% (1251401728), duration 505, 102/94 MB/s
INFO: status: 47% (50533105664/107374182400), sparse 1% (1304305664), duration 516, 98/93 MB/s
INFO: status: 48% (51590922240/107374182400), sparse 1% (1369600000), duration 526, 105/99 MB/s
INFO: status: 49% (52672004096/107374182400), sparse 1% (1429786624), duration 535, 120/113 MB/s
INFO: status: 50% (53754200064/107374182400), sparse 1% (1450254336), duration 545, 108/106 MB/s
INFO: status: 51% (54792683520/107374182400), sparse 1% (1484300288), duration 555, 103/100 MB/s
INFO: status: 52% (55898800128/107374182400), sparse 1% (1499193344), duration 565, 110/109 MB/s
INFO: status: 53% (56955502592/107374182400), sparse 1% (1629294592), duration 575, 105/92 MB/s
INFO: status: 54% (58069221376/107374182400), sparse 1% (1697214464), duration 586, 101/95 MB/s
INFO: status: 55% (59084111872/107374182400), sparse 1% (1802317824), duration 596, 101/90 MB/s
INFO: status: 56% (60216836096/107374182400), sparse 1% (1826594816), duration 608, 94/92 MB/s
INFO: status: 57% (61296345088/107374182400), sparse 1% (1867538432), duration 619, 98/94 MB/s
INFO: status: 58% (62331944960/107374182400), sparse 1% (1872953344), duration 630, 94/93 MB/s
INFO: status: 59% (63375540224/107374182400), sparse 1% (1923272704), duration 641, 94/90 MB/s
INFO: status: 60% (64439844864/107374182400), sparse 1% (1948065792), duration 652, 96/94 MB/s
INFO: status: 61% (65574600704/107374182400), sparse 1% (2032304128), duration 663, 103/95 MB/s
INFO: status: 62% (66651357184/107374182400), sparse 1% (2034266112), duration 674, 97/97 MB/s
INFO: status: 63% (67716382720/107374182400), sparse 2% (2165972992), duration 684, 106/93 MB/s
INFO: status: 64% (68741693440/107374182400), sparse 2% (2175930368), duration 695, 93/92 MB/s
INFO: status: 65% (69799378944/107374182400), sparse 2% (2212122624), duration 706, 96/92 MB/s
INFO: status: 66% (70928302080/107374182400), sparse 2% (2243100672), duration 718, 94/91 MB/s
INFO: status: 67% (71982841856/107374182400), sparse 2% (2292207616), duration 727, 117/111 MB/s
INFO: status: 68% (73103245312/107374182400), sparse 2% (2398617600), duration 738, 101/92 MB/s
INFO: status: 69% (74116694016/107374182400), sparse 2% (2447216640), duration 746, 126/120 MB/s
INFO: status: 70% (75265015808/107374182400), sparse 2% (2462765056), duration 755, 127/125 MB/s
INFO: status: 71% (76319358976/107374182400), sparse 2% (2530893824), duration 763, 131/123 MB/s
INFO: status: 72% (77337788416/107374182400), sparse 2% (2589376512), duration 773, 101/95 MB/s
INFO: status: 73% (78458257408/107374182400), sparse 2% (2739662848), duration 784, 101/88 MB/s
INFO: status: 74% (79517253632/107374182400), sparse 2% (2760380416), duration 795, 96/94 MB/s
INFO: status: 75% (80606855168/107374182400), sparse 2% (2880483328), duration 805, 108/96 MB/s
INFO: status: 76% (81657200640/107374182400), sparse 2% (2892976128), duration 816, 95/94 MB/s
INFO: status: 77% (82681528320/107374182400), sparse 2% (3036491776), duration 826, 102/88 MB/s
INFO: status: 78% (83832340480/107374182400), sparse 2% (3045380096), duration 838, 95/95 MB/s
INFO: status: 79% (84883013632/107374182400), sparse 3% (3247431680), duration 848, 105/84 MB/s
INFO: status: 80% (85943386112/107374182400), sparse 3% (3258421248), duration 859, 96/95 MB/s
INFO: status: 81% (87001137152/107374182400), sparse 3% (3438473216), duration 869, 105/87 MB/s
INFO: status: 82% (88135827456/107374182400), sparse 3% (3468443648), duration 881, 94/92 MB/s
INFO: status: 83% (89177325568/107374182400), sparse 3% (3607633920), duration 891, 104/90 MB/s
INFO: status: 84% (90202832896/107374182400), sparse 3% (3613364224), duration 902, 93/92 MB/s
ERROR: VM 131 not running
INFO: aborting backup job
ERROR: VM 131 not running
ERROR: Backup of VM 131 failed - VM 131 not running
INFO: /root/bin/backup-script: Running with action=backup-abort, vm=131
INFO: /root/bin/backup-script: Running with action=log-end, vm=131
INFO: /root/bin/backup-script: Running with action=job-end, vm=
INFO: Backup job finished with errors
TASK ERROR: job errors

Any ideas? The VM itself is running fine.
 
Update: I moved the VM to another node in the cluster and re-ran the backup. It completed successfully, so I'll put it down to an issue with the original node.

I rebooted it, will see tomorrow if the backup job completes successfully on the original node.
 
Final update: Scheduled backup ran normally on the original node after rebooting it.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!