After update to 3.2: VM crashing during backup

Please test your RAM.


Hello Dietmar,

I can't believe that the RAM has problems after the Proxmox update from Version 3.1 to 3.2.
Before the backup was running fine.
I have 2 Proxmox servers, both showing the same behaviour.

But I have checked the server, where I have done the backupchecks today.
The RAM ist 100% OK.

Best regards Stephan
 
Hi all,

we have the same issue since update to lastest proxmox version. we have the issue only, if we use compress mode (gzip). mode lzo works fine. anyone have a idea?

best regards
 
Please can you do a few tests with gzip, i.e. can you compress/decompress larger files using gzip?

Could be also interesting to see how is the load of cpu, with gzip vs lzo backup. (I think gzip cannot use more than 1 core, so 1 core should be 100%)


As it seem to occur mainly on sync writes, maybe gzip is too slow, and something bad happen.


I don't known how is work with compression (piping to gzip), with sync writes ? are the writes flushed to a buffer memory before going to piping, and if this buffer is full, this crash the vm ?
 
Hi all,

we have the same issue since update to lastest proxmox version. we have the issue only, if we use compress mode (gzip). mode lzo works fine. anyone have a idea?

best regards

Hello together,

last night I change the compression from gzip to lzo. Now 2 of 3 VM's crashed during backup.

INFO: starting new backup job: vzdump 100 110 101 --quiet 1 --mode snapshot --compress lzo --storage backup
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/backup-server/iBackOffice/dump/vzdump-qemu-100-2014_03_26-00_00_01.vma.lzo'
INFO: started backup task '20273e5a-ea49-4509-9d19-25a33437ea45'
INFO: status: 0% (129236992/64424509440), sparse 0% (6660096), duration 3, 43/40 MB/s
INFO: status: 1% (676593664/64424509440), sparse 0% (233775104), duration 10, 78/45 MB/s
INFO: status: 2% (1322778624/64424509440), sparse 0% (487772160), duration 19, 71/43 MB/s
INFO: status: 3% (1946157056/64424509440), sparse 1% (977952768), duration 22, 207/44 MB/s
INFO: status: 4% (2710175744/64424509440), sparse 2% (1598431232), duration 25, 254/47 MB/s
INFO: status: 5% (3284140032/64424509440), sparse 3% (2036875264), duration 28, 191/45 MB/s
INFO: status: 7% (4888199168/64424509440), sparse 5% (3550650368), duration 31, 534/30 MB/s
INFO: status: 10% (6527451136/64424509440), sparse 7% (5107691520), duration 35, 409/20 MB/s
INFO: status: 11% (7146045440/64424509440), sparse 8% (5583630336), duration 39, 154/35 MB/s
INFO: status: 12% (7788429312/64424509440), sparse 9% (5841068032), duration 46, 91/54 MB/s
INFO: status: 13% (8424587264/64424509440), sparse 9% (6170947584), duration 51, 127/61 MB/s
INFO: status: 14% (9084600320/64424509440), sparse 9% (6421020672), duration 58, 94/58 MB/s
INFO: status: 15% (9715580928/64424509440), sparse 10% (6660538368), duration 66, 78/48 MB/s
INFO: status: 16% (10338959360/64424509440), sparse 10% (6732423168), duration 77, 56/50 MB/s
INFO: status: 17% (10995630080/64424509440), sparse 10% (6779637760), duration 90, 50/46 MB/s
INFO: status: 18% (11629297664/64424509440), sparse 10% (6890115072), duration 101, 57/47 MB/s
INFO: status: 19% (12278431744/64424509440), sparse 10% (6932324352), duration 113, 54/50 MB/s
INFO: status: 20% (12935102464/64424509440), sparse 10% (6987223040), duration 126, 50/46 MB/s
INFO: status: 21% (13596491776/64424509440), sparse 11% (7278616576), duration 133, 94/52 MB/s
INFO: status: 22% (14208466944/64424509440), sparse 11% (7343759360), duration 145, 50/45 MB/s
INFO: status: 23% (14843248640/64424509440), sparse 11% (7361122304), duration 164, 33/32 MB/s
INFO: status: 24% (15512240128/64424509440), sparse 11% (7402123264), duration 181, 39/36 MB/s
INFO: status: 25% (16143220736/64424509440), sparse 11% (7510380544), duration 197, 39/32 MB/s
INFO: status: 26% (16781803520/64424509440), sparse 11% (7617863680), duration 215, 35/29 MB/s
INFO: status: 27% (17433165824/64424509440), sparse 11% (7696596992), duration 231, 40/35 MB/s
INFO: status: 28% (18055168000/64424509440), sparse 12% (7778709504), duration 248, 36/31 MB/s
INFO: status: 29% (18697551872/64424509440), sparse 12% (7815606272), duration 263, 42/40 MB/s
INFO: status: 30% (19389349888/64424509440), sparse 12% (7889645568), duration 276, 53/47 MB/s
INFO: status: 31% (20012728320/64424509440), sparse 12% (7969693696), duration 289, 47/41 MB/s
INFO: status: 32% (20627128320/64424509440), sparse 12% (7980331008), duration 301, 51/50 MB/s
INFO: status: 33% (21278490624/64424509440), sparse 12% (7985025024), duration 321, 32/32 MB/s
INFO: status: 34% (22000435200/64424509440), sparse 12% (8149028864), duration 338, 42/32 MB/s
INFO: status: 35% (22559457280/64424509440), sparse 12% (8158863360), duration 353, 37/36 MB/s
INFO: status: 36% (23224647680/64424509440), sparse 12% (8216965120), duration 372, 35/31 MB/s
ERROR: VM 100 not running
INFO: aborting backup job
ERROR: VM 100 not running
ERROR: Backup of VM 100 failed - VM 100 not running
INFO: Starting Backup of VM 101 (qemu)
INFO: status = running
INFO: update VM 101: -lock backup
INFO: exclude disk 'virtio1' (backup=no)
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/backup-server/iBackOffice/dump/vzdump-qemu-101-2014_03_26-00_06_25.vma.lzo'
INFO: started backup task '33a7b084-047f-4ecc-8c3f-bce9584e080a'
INFO: status: 0% (212860928/64424509440), sparse 0% (113680384), duration 4, 53/24 MB/s
INFO: status: 1% (661389312/64424509440), sparse 0% (131457024), duration 17, 34/33 MB/s
INFO: status: 2% (1318977536/64424509440), sparse 0% (170192896), duration 32, 43/41 MB/s
INFO: status: 3% (1942355968/64424509440), sparse 0% (178593792), duration 49, 36/36 MB/s
INFO: status: 4% (2592342016/64424509440), sparse 0% (179908608), duration 65, 40/40 MB/s
INFO: status: 5% (3227123712/64424509440), sparse 0% (188039168), duration 90, 25/25 MB/s
INFO: status: 6% (3896115200/64424509440), sparse 0% (212398080), duration 109, 35/33 MB/s
INFO: status: 7% (4515692544/64424509440), sparse 0% (233213952), duration 132, 26/26 MB/s
INFO: status: 8% (5165678592/64424509440), sparse 0% (254414848), duration 150, 36/34 MB/s
INFO: status: 9% (5830868992/64424509440), sparse 0% (265052160), duration 167, 39/38 MB/s
INFO: status: 10% (6454247424/64424509440), sparse 0% (275726336), duration 181, 44/43 MB/s
INFO: status: 11% (7096631296/64424509440), sparse 0% (282222592), duration 194, 49/48 MB/s
INFO: status: 12% (7765622784/64424509440), sparse 0% (297709568), duration 206, 55/54 MB/s
INFO: status: 13% (8411807744/64424509440), sparse 0% (304799744), duration 222, 40/39 MB/s
INFO: status: 15% (10099490816/64424509440), sparse 2% (1544105984), duration 232, 168/44 MB/s
INFO: status: 16% (10327556096/64424509440), sparse 2% (1571876864), duration 235, 76/66 MB/s
INFO: status: 17% (10954735616/64424509440), sparse 2% (1596362752), duration 247, 52/50 MB/s
INFO: status: 18% (11600920576/64424509440), sparse 2% (1598029824), duration 261, 46/46 MB/s
INFO: status: 19% (12254707712/64424509440), sparse 2% (1600245760), duration 282, 31/31 MB/s
INFO: status: 20% (12916097024/64424509440), sparse 2% (1613897728), duration 299, 38/38 MB/s
INFO: status: 21% (13543276544/64424509440), sparse 2% (1618726912), duration 313, 44/44 MB/s
INFO: status: 22% (14206894080/64424509440), sparse 2% (1648545792), duration 325, 55/52 MB/s
INFO: status: 23% (14858452992/64424509440), sparse 2% (1667702784), duration 337, 54/52 MB/s
INFO: status: 24% (15497035776/64424509440), sparse 2% (1672712192), duration 353, 39/39 MB/s
INFO: status: 25% (16116613120/64424509440), sparse 2% (1680936960), duration 370, 36/35 MB/s
INFO: status: 26% (16797007872/64424509440), sparse 2% (1709404160), duration 383, 52/50 MB/s
INFO: status: 27% (17397514240/64424509440), sparse 2% (1831071744), duration 390, 85/68 MB/s
INFO: status: 28% (18108186624/64424509440), sparse 3% (2169778176), duration 395, 142/74 MB/s
INFO: status: 29% (18697551872/64424509440), sparse 3% (2187673600), duration 405, 58/57 MB/s
INFO: status: 30% (19366543360/64424509440), sparse 3% (2189615104), duration 417, 55/55 MB/s
INFO: status: 31% (20004470784/64424509440), sparse 3% (2189746176), duration 431, 45/45 MB/s
INFO: status: 32% (20635975680/64424509440), sparse 3% (2189762560), duration 446, 42/42 MB/s
INFO: status: 33% (21270888448/64424509440), sparse 3% (2189762560), duration 464, 35/35 MB/s
INFO: status: 34% (21924675584/64424509440), sparse 3% (2189762560), duration 485, 31/31 MB/s
INFO: status: 35% (22570860544/64424509440), sparse 3% (2217885696), duration 499, 46/44 MB/s
INFO: status: 36% (23236050944/64424509440), sparse 3% (2238357504), duration 512, 51/49 MB/s
INFO: status: 37% (23935057920/64424509440), sparse 3% (2468319232), duration 522, 69/46 MB/s
INFO: status: 38% (24501813248/64424509440), sparse 3% (2469580800), duration 533, 51/51 MB/s
INFO: status: 39% (25136594944/64424509440), sparse 3% (2480095232), duration 548, 42/41 MB/s
INFO: status: 40% (25778978816/64424509440), sparse 3% (2485469184), duration 569, 30/30 MB/s
INFO: status: 41% (26450919424/64424509440), sparse 3% (2486136832), duration 591, 30/30 MB/s
INFO: status: 42% (27067547648/64424509440), sparse 3% (2521804800), duration 603, 51/48 MB/s
INFO: status: 43% (27706130432/64424509440), sparse 3% (2555240448), duration 618, 42/40 MB/s
INFO: status: 44% (28371320832/64424509440), sparse 3% (2564210688), duration 634, 41/41 MB/s
INFO: status: 45% (28998500352/64424509440), sparse 4% (2587074560), duration 648, 44/43 MB/s
INFO: status: 46% (29656088576/64424509440), sparse 4% (2606247936), duration 676, 23/22 MB/s
INFO: status: 47% (30309875712/64424509440), sparse 4% (2615889920), duration 691, 43/42 MB/s
INFO: status: 48% (30933254144/64424509440), sparse 4% (2631352320), duration 706, 41/40 MB/s
INFO: status: 49% (31587041280/64424509440), sparse 4% (2665398272), duration 718, 54/51 MB/s
INFO: status: 50% (32252231680/64424509440), sparse 4% (2674761728), duration 731, 51/50 MB/s
INFO: status: 51% (32860405760/64424509440), sparse 4% (2690375680), duration 746, 40/39 MB/s
INFO: status: 52% (33556004864/64424509440), sparse 4% (2703495168), duration 760, 49/48 MB/s
INFO: status: 53% (34179383296/64424509440), sparse 4% (2714689536), duration 772, 51/51 MB/s
INFO: status: 54% (34791358464/64424509440), sparse 4% (2743504896), duration 782, 61/58 MB/s
INFO: status: 55% (35464151040/64424509440), sparse 4% (2840313856), duration 794, 56/47 MB/s
INFO: status: 56% (36136943616/64424509440), sparse 4% (2878328832), duration 815, 32/30 MB/s
INFO: status: 57% (36752719872/64424509440), sparse 4% (2908704768), duration 829, 43/41 MB/s
INFO: status: 58% (37398904832/64424509440), sparse 4% (2936238080), duration 843, 46/44 MB/s
INFO: status: 59% (38045089792/64424509440), sparse 4% (3001217024), duration 857, 46/41 MB/s
INFO: status: 60% (39261437952/64424509440), sparse 5% (3718950912), duration 869, 101/41 MB/s
INFO: status: 61% (39394476032/64424509440), sparse 5% (3724374016), duration 872, 44/42 MB/s
INFO: status: 62% (39987445760/64424509440), sparse 5% (3729522688), duration 885, 45/45 MB/s
INFO: status: 63% (40591818752/64424509440), sparse 5% (3747688448), duration 896, 54/53 MB/s
INFO: status: 69% (44801589248/64424509440), sparse 11% (7716872192), duration 903, 601/34 MB/s
INFO: status: 100% (64424509440/64424509440), sparse 42% (27339788288), duration 906, 6540/0 MB/s
INFO: transferred 64424 MB in 906 seconds (71 MB/s)
INFO: archive file size: 21.48GB
INFO: delete old backup '/mnt/backup-server/iBackOffice/dump/vzdump-qemu-101-2014_03_17-00_14_03.vma.gz'
INFO: Finished Backup of VM 101 (00:15:08)
INFO: Starting Backup of VM 110 (qemu)
INFO: status = running
INFO: update VM 110: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/backup-server/iBackOffice/dump/vzdump-qemu-110-2014_03_26-00_21_33.vma.lzo'
INFO: started backup task '2947f6bf-7dc7-4dcb-916a-92860cb0404b'
INFO: status: 0% (186253312/53687091200), sparse 0% (54472704), duration 3, 62/43 MB/s
INFO: status: 1% (843841536/53687091200), sparse 1% (598958080), duration 6, 219/37 MB/s
INFO: status: 2% (1136525312/53687091200), sparse 1% (687128576), duration 11, 58/40 MB/s
ERROR: VM 110 not running
INFO: aborting backup job
ERROR: VM 110 not running
ERROR: Backup of VM 110 failed - VM 110 not running
INFO: Backup job finished with errors
TASK ERROR: job errors

Best regards Stephan
 
Don't know if it helps in debugging, but I have also issues with vzdump in Proxmox 3.2. During backup to slower storage (in my case NFS on 1Gb net), VMs will crash.
I mostly see this on Windows VMs - maybe because they have higher load though..
If I backup to local storage everything works fine.
I have tried with serveral different NFS Mount options - but same result.


INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/pve/nfs_backup/dump/vzdump-qemu-100-2014_03_11-00_00_01.vma.lzo'
INFO: started backup task '70696f9c-cfdd-407a-bdbc-866a59833e55'
INFO: status: 0% (440926208/214748364800), sparse 0% (4407296), duration 3, 146/145 MB/s
INFO: status: 1% (2276392960/214748364800), sparse 0% (14864384), duration 15, 152/152 MB/s
INFO: status: 2% (4453105664/214748364800), sparse 0% (1190404096), duration 25, 217/100 MB/s
INFO: status: 3% (6660751360/214748364800), sparse 1% (3395428352), duration 32, 315/0 MB/s
INFO: status: 4% (8714584064/214748364800), sparse 2% (5443158016), duration 370, 6/0 MB/s
INFO: status: 5% (11018240000/214748364800), sparse 3% (7739228160), duration 378, 287/0 MB/s
INFO: status: 6% (12902924288/214748364800), sparse 4% (9608343552), duration 384, 314/2 MB/s
INFO: status: 7% (15271723008/214748364800), sparse 5% (11952431104), duration 391, 338/3 MB/s
INFO: status: 8% (17191993344/214748364800), sparse 6% (13856317440), duration 399, 240/2 MB/s
INFO: status: 9% (19511246848/214748364800), sparse 7% (16148779008), duration 406, 331/3 MB/s
INFO: status: 10% (21592342528/214748364800), sparse 8% (18195025920), duration 412, 346/5 MB/s
INFO: status: 11% (23626317824/214748364800), sparse 9% (19807789056), duration 419, 290/60 MB/s
INFO: status: 12% (25918504960/214748364800), sparse 9% (19820986368), duration 432, 176/175 MB/s
INFO: status: 13% (28052029440/214748364800), sparse 9% (19984896000), duration 446, 152/140 MB/s
INFO: status: 14% (30119821312/214748364800), sparse 9% (19991175168), duration 458, 172/171 MB/s
INFO: status: 15% (32225624064/214748364800), sparse 9% (19995144192), duration 472, 150/150 MB/s
INFO: status: 16% (34460663808/214748364800), sparse 9% (20002881536), duration 1240, 2/2 MB/s
INFO: status: 17% (36612079616/214748364800), sparse 9% (20004274176), duration 1252, 179/179 MB/s
INFO: status: 18% (38660866048/214748364800), sparse 9% (20005351424), duration 1263, 186/186 MB/s
INFO: status: 19% (40827486208/214748364800), sparse 9% (20008431616), duration 1276, 166/166 MB/s
INFO: status: 20% (42978902016/214748364800), sparse 9% (20025024512), duration 1287, 195/194 MB/s
INFO: status: 21% (45160726528/214748364800), sparse 9% (20114296832), duration 1303, 136/130 MB/s
INFO: status: 22% (47247523840/214748364800), sparse 9% (20117442560), duration 1501, 10/10 MB/s
ERROR: VM 100 qmp command 'query-backup' failed - got timeout
INFO: aborting backup job
ERROR: Backup of VM 100 failed - VM 100 qmp command 'query-backup' failed - got timeout
INFO: Backup job finished with errors
TASK ERROR: job errors
 
Thanks, it seems now solved with the problematic VM to local storage:
Code:
INFO: starting new backup job: vzdump 302 --compress gzip
INFO: Starting Backup of VM 302 (qemu)
INFO: status = running
INFO: update VM 302: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/srv/dump/vzdump-qemu-302-2014_03_27-13_44_30.vma.gz'
INFO: started backup task '7c8aa350-8d30-452e-bd3d-7c0b9cc12306'
...
INFO: transferred 16110 MB in 629 seconds (25 MB/s)
INFO: archive file size: 6.25GB
INFO: delete old backup '/srv/dump/vzdump-qemu-302-2014_03_24-00_23_05.vma.gz'
INFO: Finished Backup of VM 302 (00:10:31)
INFO: Backup job finished successfully
 
Hi Dietmar does the patch also applies to 3.1? Got some vms too shutting down during backup.

Thanks.
 
Old topic, but just wanted to share my experience with backup on Proxmox 3.2. I too did upgrade from 3.1 to 3.2. I have 7 nodes with about 37 VMs running pretty much at all times, since they are being used by both day shift and evening shift people. I do 2 full backups per week, split in 2 days. Other 5 days i do snapshots 2 per day per VM. So far i have not faced any issue of backup crash. There were few occasions when Snapshot did not want to run first time for 4 VMs(3 Linux, 1 Windows). But they always ran at second tries. So overall, i have to say i have no issue with upgrade. The cluster environment i have is a busy environment. No issue with uptime or backups. My main Storage is on CEPH on separate LAN and backup happens on NFS server also on separate LAN. On main Proxmox VM LAN there are no other traffic congestion(Storage or Backup) except the VMs themselves.
 
Hi All,

just discovered the problem of VM stop during shapshot backup in compressed mode:
Here is the scenario:

- proxmox 3.0.23
- backup on QNAP NAS via NFS on a Gbit ethernet LAN

Here the log:
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/pve/backup-vm/dump/vzdump-qemu-205-2014_10_11-01_32_59.vma.lzo'
INFO: started backup task '3dd30ed7-f42c-4001-a80c-644fe863a9bc'
INFO: status: 0% (502202368/107374182400), sparse 0% (2150400), duration 3, 167/166 MB/s
INFO: status: 1% (1143865344/107374182400), sparse 0% (7753728), duration 7, 160/159 MB/s
INFO: status: 2% (2315583488/107374182400), sparse 0% (10174464), duration 14, 167/167 MB/s
INFO: status: 3% (3313500160/107374182400), sparse 0% (11653120), duration 20, 166/166 MB/s
INFO: status: 4% (4397989888/107374182400), sparse 0% (42434560), duration 26, 180/175 MB/s
INFO: status: 5% (5376311296/107374182400), sparse 0% (108425216), duration 34, 122/114 MB/s
INFO: status: 6% (6587154432/107374182400), sparse 0% (109846528), duration 42, 151/151 MB/s
INFO: status: 7% (7553810432/107374182400), sparse 0% (110510080), duration 49, 138/137 MB/s
ERROR: VM 205 not running
INFO: aborting backup job
ERROR: VM 205 not running
ERROR: Backup of VM 205 failed - VM 205 not running
INFO: Backup job finished with errors
TASK ERROR: job errors

The VM is WIN2k3 server.

I can switch to "shutdown backup mode", but what happen if I put the VM in managed by HA mode ? HA will try to switch on che VM during backup ?

Regards
PieroB
 
I have the same situation with Proxmox 3.3. VM with SBS2008 1HDD-130 GB, 1HDD 180GB
its always happen on 44%. I think it's happen because i have 2 HDD


INFO: starting new backup job: vzdump 106 --quiet 1 --mailto xxx@xxx.xx --mode snapshot --compress lzo --storage ServerVMbackups
INFO: Starting Backup of VM 106 (qemu)
INFO: status = running
INFO: update VM 106: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating archive '/mnt/pve/ServerVM/dump/vzdump-qemu-106-2014_12_31-18_10_04.vma.lzo'
INFO: started backup task 'f06aa13e-a083-4b1d-941e-86d30985b7ad'
INFO: status: 0% (35323904/348966092800), sparse 0% (102400), duration 3, 11/11 MB/s
INFO: status: 1% (3496214528/348966092800), sparse 0% (55549952), duration 309, 11/11 MB/s
INFO: status: 2% (6981746688/348966092800), sparse 0% (117501952), duration 799, 7/6 MB/s
INFO: status: 3% (10474684416/348966092800), sparse 0% (147779584), duration 1166, 9/9 MB/s
INFO: status: 4% (13962772480/348966092800), sparse 0% (180535296), duration 1477, 11/11 MB/s
INFO: status: 5% (17452367872/348966092800), sparse 0% (207216640), duration 1787, 11/11 MB/s
INFO: status: 6% (20941242368/348966092800), sparse 0% (231149568), duration 2097, 11/11 MB/s
INFO: status: 7% (24433131520/348966092800), sparse 0% (240336896), duration 2406, 11/11 MB/s
INFO: status: 8% (27917418496/348966092800), sparse 0% (262766592), duration 2740, 10/10 MB/s
INFO: status: 9% (31407210496/348966092800), sparse 0% (273248256), duration 3314, 6/6 MB/s
INFO: status: 10% (34908405760/348966092800), sparse 0% (290787328), duration 3832, 6/6 MB/s
INFO: status: 11% (38394527744/348966092800), sparse 0% (302669824), duration 4142, 11/11 MB/s
INFO: status: 12% (41877241856/348966092800), sparse 0% (366923776), duration 4448, 11/11 MB/s
INFO: status: 13% (45375946752/348966092800), sparse 0% (370401280), duration 4760, 11/11 MB/s
INFO: status: 14% (48855252992/348966092800), sparse 0% (376909824), duration 5190, 8/8 MB/s
INFO: status: 15% (52349304832/348966092800), sparse 0% (384053248), duration 5624, 8/8 MB/s
INFO: status: 16% (55845519360/348966092800), sparse 0% (391606272), duration 5934, 11/11 MB/s
INFO: status: 17% (59325939712/348966092800), sparse 0% (418050048), duration 6244, 11/11 MB/s
INFO: status: 18% (62823333888/348966092800), sparse 0% (423538688), duration 6559, 11/11 MB/s
INFO: status: 19% (66303557632/348966092800), sparse 0% (448610304), duration 6866, 11/11 MB/s
INFO: status: 20% (69798920192/348966092800), sparse 0% (487649280), duration 7487, 5/5 MB/s
INFO: status: 21% (73286352896/348966092800), sparse 0% (516874240), duration 7988, 6/6 MB/s
INFO: status: 22% (76775096320/348966092800), sparse 0% (528998400), duration 8304, 11/11 MB/s
INFO: status: 23% (80264495104/348966092800), sparse 0% (542064640), duration 8619, 11/11 MB/s
INFO: status: 24% (83754156032/348966092800), sparse 0% (554909696), duration 8929, 11/11 MB/s
INFO: status: 25% (87251091456/348966092800), sparse 0% (578818048), duration 9241, 11/11 MB/s
INFO: status: 26% (90731708416/348966092800), sparse 0% (586272768), duration 9547, 11/11 MB/s
INFO: status: 27% (94226546688/348966092800), sparse 0% (591949824), duration 10095, 6/6 MB/s
INFO: status: 28% (97713455104/348966092800), sparse 0% (2204295168), duration 10398, 11/6 MB/s
INFO: status: 29% (101210324992/348966092800), sparse 0% (2219831296), duration 10960, 6/6 MB/s
INFO: status: 30% (104692908032/348966092800), sparse 0% (2232270848), duration 11273, 11/11 MB/s
INFO: status: 31% (108190236672/348966092800), sparse 0% (2249297920), duration 11586, 11/11 MB/s
INFO: status: 32% (111671115776/348966092800), sparse 0% (2269650944), duration 11964, 9/9 MB/s
INFO: status: 33% (115170541568/348966092800), sparse 0% (2365165568), duration 12445, 7/7 MB/s
INFO: status: 34% (118654566400/348966092800), sparse 1% (3539509248), duration 12752, 11/7 MB/s
INFO: status: 35% (122139312128/348966092800), sparse 1% (5505957888), duration 13055, 11/5 MB/s
INFO: status: 36% (125637361664/348966092800), sparse 2% (8017764352), duration 13355, 11/3 MB/s
INFO: status: 37% (129125580800/348966092800), sparse 2% (10314801152), duration 13656, 11/3 MB/s
INFO: status: 38% (132614062080/348966092800), sparse 3% (12419977216), duration 13958, 11/4 MB/s
INFO: status: 39% (136100577280/348966092800), sparse 3% (12618461184), duration 14487, 6/6 MB/s
INFO: status: 40% (139591483392/348966092800), sparse 3% (13888593920), duration 15050, 6/3 MB/s
INFO: status: 41% (143083962368/348966092800), sparse 4% (17267572736), duration 15348, 11/0 MB/s
INFO: status: 42% (146569494528/348966092800), sparse 5% (19593035776), duration 15650, 11/3 MB/s
INFO: status: 43% (150058696704/348966092800), sparse 6% (23027126272), duration 15947, 11/0 MB/s
INFO: status: 44% (153551372288/348966092800), sparse 6% (23281065984), duration 16253, 11/10 MB/s
ERROR: VM 106 not running
INFO: aborting backup job
ERROR: VM 106 not running
ERROR: Backup of VM 106 failed - VM 106 not running
INFO: Backup job finished with errors
TASK ERROR: job errors
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!