Error in Backup

Hi,

this means your backup can't write to the storage because the pipe is broken.
Why the pipe gets broken I can't tell. This can have several reasons.
Disk io error.
Timeouts.
reset connections from network storage.
....
 
@wolfgang and how do you prevent from failing a backup with a "broken pipe" error? My daily Backups are failing at least two of six times on a shared Storage.
 
You have to monitor your shared storage to find the problem.
Is the network overloaded? Is the shared storage overloaded or does it reset the connection, ....?

The fact that it works two out of six times suggests that it has something to do with an overload.
 
Hey @wolfgang, thank you for the fast reply!

Does an overload make sense when in one Backup-Job the first VM fails and the second one works?

vzdump log (cut a bit for length):

Code: 
ID: 2020-06-17 23:00:02 INFO: Starting Backup of VM ID (qemu)
ID: 2020-06-17 23:00:02 INFO: status = running
ID: 2020-06-17 23:00:02 INFO: update VM ID: -lock backup
ID: 2020-06-17 23:00:02 INFO: VM Name: vm_name
ID: 2020-06-17 23:00:02 INFO: include disk 'virtio0' 'local:ID/vm--disk-0.qcow2' 250G
ID: 2020-06-17 23:00:02 INFO: include disk 'virtio1' 'local:ID/vm-ID-disk-1.qcow2' 500G
ID: 2020-06-17 23:00:02 INFO: backup mode: snapshot
ID: 2020-06-17 23:00:02 INFO: ionice priority: 7
ID: 2020-06-17 23:00:02 INFO: creating archive '/mnt/my_storage/dump/vzdump-qemu-ID-2020_06_17-23_00_02.vma.lzo'
ID: 2020-06-17 23:00:02 INFO: issuing guest-agent 'fs-freeze' command
ID: 2020-06-17 23:00:05 INFO: issuing guest-agent 'fs-thaw' command
ID: 2020-06-17 23:00:07 INFO: started backup task '568d35e5-cb92-43f7-a505-6ca458314367'
ID: 2020-06-17 23:00:10 INFO: status: 0% (1780744192/805306368000), sparse 0% (150884352), duration 3, read/write 593/543 MB/s
ID: 2020-06-17 23:00:29 INFO: status: 1% (8309178368/805306368000), sparse 0% (235778048), duration 22, read/write 343/339 MB/s
ID: 2020-06-17 23:00:52 INFO: status: 2% (16295264256/805306368000), sparse 0% (389812224), duration 45, read/write 347/340 MB/s
ID: 2020-06-17 23:01:14 INFO: status: 3% (24500764672/805306368000), sparse 0% (545665024), duration 67, read/write 372/365 MB/s
ID: 2020-06-17 23:01:35 INFO: status: 4% (32449888256/805306368000), sparse 0% (685858816), duration 88, read/write 378/371 MB/s
ID: 2020-06-17 23:01:54 INFO: status: 5% (40415461376/805306368000), sparse 0% (907415552), duration 107, read/write 419/407 MB/s
ID: 2020-06-17 23:02:13 INFO: status: 6% (48448667648/805306368000), sparse 0% (1244971008), duration 126, read/write 422/405 MB/s
ID: 2020-06-17 23:02:33 INFO: status: 7% (56594399232/805306368000), sparse 0% (1917575168), duration 146, read/write 407/373 MB/s
ID: 2020-06-17 23:02:53 INFO: status: 8% (64754614272/805306368000), sparse 0% (1995739136), duration 166, read/write 408/404 MB/s
ID: 2020-06-17 23:03:11 INFO: status: 9% (72555626496/805306368000), sparse 0% (2082078720), duration 184, read/write 433/428 MB/s
ID: 2020-06-17 23:03:30 INFO: status: 10% (80985980928/805306368000), sparse 0% (2142777344), duration 203, read/write 443/440 MB/s
ID: 2020-06-17 23:03:47 INFO: status: 11% (88892243968/805306368000), sparse 0% (2144157696), duration 220, read/write 465/464 MB/s
ID: 2020-06-17 23:04:09 INFO: status: 12% (96999964672/805306368000), sparse 0% (2414800896), duration 242, read/write 368/356 MB/s
ID: 2020-06-17 23:04:29 INFO: status: 13% (104812249088/805306368000), sparse 0% (2557083648), duration 262, read/write 390/383 MB/s
ID: 2020-06-17 23:04:36 INFO: status: 14% (114010947584/805306368000), sparse 1% (8559185920), duration 269, read/write 1314/456 MB/s
ID: 2020-06-17 23:04:39 INFO: status: 17% (138218831872/805306368000), sparse 4% (32767070208), duration 272, read/write 8069/0 MB/s
ID: 2020-06-17 23:04:42 INFO: status: 20% (162507194368/805306368000), sparse 7% (57055432704), duration 275, read/write 8096/0 MB/s
ID: 2020-06-17 23:04:45 INFO: status: 23% (186794508288/805306368000), sparse 10% (81342746624), duration 278, read/write 8095/0 MB/s
ID: 2020-06-17 23:04:48 INFO: status: 26% (211070812160/805306368000), sparse 13% (105619050496), duration 281, read/write 8092/0 MB/s
ID: 2020-06-17 23:04:51 INFO: status: 29% (235228364800/805306368000), sparse 16% (129776603136), duration 284, read/write 8052/0 MB/s
ID: 2020-06-17 23:04:54 INFO: status: 32% (259593666560/805306368000), sparse 19% (154141904896), duration 287, read/write 8121/0 MB/s
...
ID: 2020-06-17 23:10:30 INFO: status: 51% (410909016064/805306368000), sparse 20% (163010002944), duration 623, read/write 364/364 MB/s
ID: 2020-06-17 23:10:52 INFO: status: 52% (419032727552/805306368000), sparse 20% (163010002944), duration 645, read/write 369/369 MB/s
ID: 2020-06-17 23:11:14 INFO: status: 53% (427040833536/805306368000), sparse 20% (163010002944), duration 667, read/write 364/364 MB/s
ID: 2020-06-17 23:11:37 INFO: status: 54% (435182370816/805306368000), sparse 20% (163010002944), duration 690, read/write 353/353 MB/s
ID: 2020-06-17 23:11:58 INFO: status: 55% (442940784640/805306368000), sparse 20% (163010002944), duration 711, read/write 369/369 MB/s
ID: 2020-06-17 23:12:21 INFO: status: 56% (451305865216/805306368000), sparse 20% (163010002944), duration 734, read/write 363/363 MB/s
ID: 2020-06-17 23:12:43 INFO: status: 57% (459315871744/805306368000), sparse 20% (163010002944), duration 756, read/write 364/364 MB/s
ID: 2020-06-17 23:13:03 INFO: status: 58% (467096698880/805306368000), sparse 20% (163010002944), duration 776, read/write 389/389 MB/s
ID: 2020-06-17 23:13:25 INFO: status: 59% (475276640256/805306368000), sparse 20% (163010002944), duration 798, read/write 371/371 MB/s
ID: 2020-06-17 23:13:47 INFO: status: 60% (483270328320/805306368000), sparse 20% (163010002944), duration 820, read/write 363/363 MB/s
ID: 2020-06-17 23:14:08 INFO: status: 61% (491414093824/805306368000), sparse 20% (163010002944), duration 841, read/write 387/387 MB/s
ID: 2020-06-17 23:14:29 INFO: status: 62% (499394543616/805306368000), sparse 20% (163010002944), duration 862, read/write 380/380 MB/s
ID: 2020-06-17 23:14:50 INFO: status: 63% (507378663424/805306368000), sparse 20% (163010002944), duration 883, read/write 380/380 MB/s
ID: 2020-06-17 23:15:12 INFO: status: 64% (515594125312/805306368000), sparse 20% (163010002944), duration 905, read/write 373/373 MB/s
ID: 2020-06-17 23:15:34 INFO: status: 65% (523615666176/805306368000), sparse 20% (163010002944), duration 927, read/write 364/364 MB/s
ID: 2020-06-17 23:15:54 INFO: status: 66% (531706347520/805306368000), sparse 20% (163010002944), duration 947, read/write 404/404 MB/s
ID: 2020-06-17 23:16:17 INFO: status: 67% (539735490560/805306368000), sparse 20% (163010002944), duration 970, read/write 349/349 MB/s
ID: 2020-06-17 23:16:39 INFO: status: 68% (547758669824/805306368000), sparse 20% (163010002944), duration 992, read/write 364/364 MB/s
ID: 2020-06-17 23:17:02 INFO: status: 69% (555992743936/805306368000), sparse 20% (163010002944), duration 1015, read/write 358/358 MB/s
ID: 2020-06-17 23:17:22 INFO: status: 70% (563796377600/805306368000), sparse 20% (163010002944), duration 1035, read/write 390/390 MB/s
ID: 2020-06-17 23:17:42 INFO: status: 71% (571930312704/805306368000), sparse 20% (163010002944), duration 1055, read/write 406/406 MB/s
ID: 2020-06-17 23:18:03 INFO: status: 72% (580127817728/805306368000), sparse 20% (163035705344), duration 1076, read/write 390/389 MB/s
ID: 2020-06-17 23:18:24 INFO: status: 73% (588020711424/805306368000), sparse 20% (163035705344), duration 1097, read/write 375/375 MB/s
ID: 2020-06-17 23:18:45 INFO: status: 74% (596170440704/805306368000), sparse 20% (163035705344), duration 1118, read/write 388/388 MB/s
ID: 2020-06-17 23:19:06 INFO: status: 75% (604120940544/805306368000), sparse 20% (163035705344), duration 1139, read/write 378/378 MB/s
ID: 2020-06-17 23:19:27 INFO: status: 76% (612072554496/805306368000), sparse 20% (163035705344), duration 1160, read/write 378/378 MB/s
ID: 2020-06-17 23:19:38 INFO: status: 76% (615658422272/805306368000), sparse 20% (163035705344), duration 1171, read/write 325/325 MB/s
ID: 2020-06-17 23:19:38 ERROR: vma_queue_write: write error - Broken pipe
ID: 2020-06-17 23:19:38 INFO: aborting backup job
ID: 2020-06-17 23:19:41 ERROR: Backup of VM ID failed - vma_queue_write: write error - Broken pipe

ID: 2020-06-17 23:19:41 INFO: Starting Backup of VM ID (qemu)
ID: 2020-06-17 23:19:41 INFO: status = stopped
ID: 2020-06-17 23:19:41 INFO: update VM ID: -lock backup
ID: 2020-06-17 23:19:41 INFO: backup mode: stop
ID: 2020-06-17 23:19:41 INFO: ionice priority: 7
ID: 2020-06-17 23:19:41 INFO: VM Name: vm_name
ID: 2020-06-17 23:19:41 INFO: include disk 'virtio0' 'local:ID/vm-ID-disk-0.qcow2' 100G
ID: 2020-06-17 23:19:41 INFO: include disk 'virtio1' 'local:ID/vm-ID-disk-1.qcow2' 50G
ID: 2020-06-17 23:19:41 INFO: creating archive '/mnt/my_storage/dump/vzdump-qemu-ID-2020_06_17-23_19_41.vma.lzo'
ID: 2020-06-17 23:19:41 INFO: starting kvm to execute backup task
ID: 2020-06-17 23:19:42 INFO: started backup task '05b5c8dd-6f2f-4de8-9333-4dcc5cc2e19c'
ID: 2020-06-17 23:19:45 INFO: status: 0% (1356988416/161061273600), sparse 0% (142286848), duration 3, read/write 452/404 MB/s
........
ID: 2020-06-17 23:25:02 INFO: status: 96% (154994933760/161061273600), sparse 3% (5774995456), duration 320, read/write 491/491 MB/s
ID: 2020-06-17 23:25:05 INFO: status: 97% (156422373376/161061273600), sparse 3% (5774995456), duration 323, read/write 475/475 MB/s
ID: 2020-06-17 23:25:09 INFO: status: 98% (158311514112/161061273600), sparse 3% (5774995456), duration 327, read/write 472/472 MB/s
ID: 2020-06-17 23:25:12 INFO: status: 99% (159752126464/161061273600), sparse 3% (5774995456), duration 330, read/write 480/480 MB/s
ID: 2020-06-17 23:25:15 INFO: status: 100% (161061273600/161061273600), sparse 3% (5777084416), duration 333, read/write 436/435 MB/s
ID: 2020-06-17 23:25:15 INFO: transferred 161061 MB in 333 seconds (483 MB/s)
ID: 2020-06-17 23:25:15 INFO: stopping kvm after backup task
ID: 2020-06-17 23:25:16 INFO: archive file size: 121.69GB
ID: 2020-06-17 23:25:16 INFO: delete old backup '/mnt/my_storage/dump/vzdump-qemu-ID-2020_06_16-23_20_13.vma.lzo'
ID: 2020-06-17 23:25:17 INFO: Finished Backup of VM ID (00:05:36)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back