We are currently having issues backing up just one VM on our Proxmox server. We are using the backup function in the web interface. All other backups work as expected.
The following is the output from the task viewer output:
INFO: starting new backup job: vzdump 510 --quiet 1 --mode snapshot --compress lzo --storage nfs_on_171
INFO: Starting Backup of VM 510 (qemu)
INFO: status = running
INFO: update VM 510: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/pve/nfs_on_171/dump/vzdump-qemu-510-2015_09_10-20_00_02.vma.lzo'
INFO: started backup task '504f0f8e-f859-4a48-ac1b-5ef1dd4bf99a'
INFO: status: 0% (324272128/209385947136), sparse 0% (86798336), duration 3, 108/79 MB/s
INFO: status: 1% (2109603840/209385947136), sparse 0% (115286016), duration 27, 74/73 MB/s
INFO: status: 2% (4192993280/209385947136), sparse 0% (135294976), duration 52, 83/82 MB/s
INFO: status: 3% (6336413696/209385947136), sparse 0% (154693632), duration 82, 71/70 MB/s
INFO: status: 4% (8385200128/209385947136), sparse 0% (186875904), duration 101, 107/106 MB/s
INFO: status: 5% (11120934912/209385947136), sparse 1% (2429018112), duration 106, 547/98 MB/s
INFO: status: 6% (13130727424/209385947136), sparse 2% (4438745088), duration 131, 80/0 MB/s
INFO: status: 7% (16092889088/209385947136), sparse 3% (7400841216), duration 134, 987/0 MB/s
INFO: status: 9% (19114164224/209385947136), sparse 4% (10422116352), duration 137, 1007/0 MB/s
INFO: status: 10% (22178562048/209385947136), sparse 6% (13486514176), duration 140, 1021/0 MB/s
INFO: status: 12% (25186009088/209385947136), sparse 7% (16493961216), duration 143, 1002/0 MB/s
INFO: status: 13% (27330936832/209385947136), sparse 8% (17970003968), duration 151, 268/83 MB/s
INFO: status: 14% (29435953152/209385947136), sparse 8% (18004389888), duration 165, 150/147 MB/s
INFO: status: 15% (31566200832/209385947136), sparse 8% (18038218752), duration 179, 152/149 MB/s
INFO: status: 16% (33620623360/209385947136), sparse 8% (18072346624), duration 192, 158/155 MB/s
INFO: status: 17% (35623796736/209385947136), sparse 8% (18091163648), duration 203, 182/180 MB/s
INFO: status: 18% (37710266368/209385947136), sparse 8% (18109784064), duration 215, 173/172 MB/s
INFO: status: 19% (39806631936/209385947136), sparse 8% (18119913472), duration 229, 149/149 MB/s
INFO: status: 20% (42032431104/209385947136), sparse 8% (18136276992), duration 241, 185/184 MB/s
INFO: status: 21% (44054609920/209385947136), sparse 8% (18147467264), duration 287, 43/43 MB/s
INFO: status: 22% (46066499584/209385947136), sparse 8% (18154897408), duration 313, 77/77 MB/s
INFO: status: 23% (48171188224/209385947136), sparse 8% (18188591104), duration 336, 91/90 MB/s
INFO: status: 24% (50265587712/209385947136), sparse 8% (18197491712), duration 356, 104/104 MB/s
INFO: status: 25% (52648869888/209385947136), sparse 8% (18362777600), duration 375, 125/116 MB/s
INFO: status: 26% (54522478592/209385947136), sparse 8% (18370224128), duration 388, 144/143 MB/s
INFO: status: 27% (56587649024/209385947136), sparse 8% (18371485696), duration 404, 129/128 MB/s
INFO: status: 28% (58680213504/209385947136), sparse 8% (18374946816), duration 417, 160/160 MB/s
INFO: status: 29% (60898017280/209385947136), sparse 8% (18386952192), duration 428, 201/200 MB/s
INFO: status: 30% (62823989248/209385947136), sparse 8% (18619187200), duration 448, 96/84 MB/s
INFO: status: 31% (64947814400/209385947136), sparse 9% (19107966976), duration 487, 54/41 MB/s
INFO: status: 32% (67093004288/209385947136), sparse 9% (19477286912), duration 509, 97/80 MB/s
INFO: status: 33% (69196972032/209385947136), sparse 10% (21262032896), duration 526, 123/18 MB/s
INFO: status: 34% (71262797824/209385947136), sparse 10% (21799469056), duration 545, 108/80 MB/s
INFO: status: 35% (73365913600/209385947136), sparse 10% (21815250944), duration 568, 91/90 MB/s
INFO: status: 36% (75550425088/209385947136), sparse 10% (21815255040), duration 581, 168/168 MB/s
INFO: status: 37% (77552877568/209385947136), sparse 10% (21838548992), duration 591, 200/197 MB/s
INFO: status: 38% (79569420288/209385947136), sparse 10% (21841408000), duration 606, 134/134 MB/s
INFO: status: 39% (81734795264/209385947136), sparse 10% (21977001984), duration 670, 33/31 MB/s
INFO: status: 40% (83774078976/209385947136), sparse 10% (22037647360), duration 684, 145/141 MB/s
INFO: status: 41% (85973991424/209385947136), sparse 10% (22111019008), duration 696, 183/177 MB/s
INFO: status: 42% (87987519488/209385947136), sparse 10% (22112206848), duration 721, 80/80 MB/s
INFO: status: 43% (90131398656/209385947136), sparse 10% (22112206848), duration 735, 153/153 MB/s
INFO: status: 44% (92176384000/209385947136), sparse 10% (22237249536), duration 751, 127/119 MB/s
INFO: status: 45% (94327799808/209385947136), sparse 10% (22258151424), duration 775, 89/88 MB/s
INFO: status: 46% (96406405120/209385947136), sparse 10% (22297112576), duration 786, 188/185 MB/s
INFO: status: 47% (98470985728/209385947136), sparse 11% (23216406528), duration 794, 258/143 MB/s
INFO: status: 48% (100546379776/209385947136), sparse 11% (23373479936), duration 845, 40/37 MB/s
INFO: status: 49% (102753566720/209385947136), sparse 11% (23605161984), duration 862, 129/116 MB/s
INFO: status: 50% (105678045184/209385947136), sparse 12% (26052952064), duration 867, 584/95 MB/s
INFO: status: 51% (108137152512/209385947136), sparse 13% (28512059392), duration 870, 819/0 MB/s
INFO: status: 52% (109146603520/209385947136), sparse 14% (29521510400), duration 895, 40/0 MB/s
INFO: status: 53% (112214474752/209385947136), sparse 15% (32589381632), duration 898, 1022/0 MB/s
INFO: status: 54% (113567924224/209385947136), sparse 16% (33738326016), duration 901, 451/68 MB/s
INFO: status: 55% (115330056192/209385947136), sparse 16% (33966702592), duration 916, 117/102 MB/s
INFO: status: 56% (118339076096/209385947136), sparse 17% (36975722496), duration 919, 1003/0 MB/s
INFO: status: 57% (121358254080/209385947136), sparse 19% (39994900480), duration 922, 1006/0 MB/s
INFO: status: 59% (124428681216/209385947136), sparse 20% (43065327616), duration 925, 1023/0 MB/s
INFO: status: 60% (127427018752/209385947136), sparse 21% (46063665152), duration 928, 999/0 MB/s
INFO: status: 62% (130514616320/209385947136), sparse 23% (49151262720), duration 931, 1029/0 MB/s
INFO: status: 63% (132473225216/209385947136), sparse 24% (51109871616), duration 941, 195/0 MB/s
INFO: status: 64% (135456030720/209385947136), sparse 25% (54092677120), duration 944, 994/0 MB/s
INFO: status: 66% (138461642752/209385947136), sparse 27% (57098289152), duration 947, 1001/0 MB/s
INFO: status: 67% (141433176064/209385947136), sparse 28% (60069822464), duration 950, 990/0 MB/s
INFO: status: 68% (144437477376/209385947136), sparse 30% (63074123776), duration 953, 1001/0 MB/s
INFO: status: 70% (147381092352/209385947136), sparse 31% (66017738752), duration 956, 981/0 MB/s
INFO: status: 71% (148672151552/209385947136), sparse 31% (66358009856), duration 964, 161/118 MB/s
INFO: status: 72% (150871539712/209385947136), sparse 31% (66384400384), duration 980, 137/135 MB/s
INFO: status: 73% (153047007232/209385947136), sparse 31% (66787012608), duration 992, 181/147 MB/s
INFO: status: 74% (155027374080/209385947136), sparse 31% (66787012608), duration 1014, 90/90 MB/s
INFO: status: 75% (157190193152/209385947136), sparse 31% (66787012608), duration 1027, 166/166 MB/s
INFO: status: 76% (159204769792/209385947136), sparse 31% (66787012608), duration 1040, 154/154 MB/s
INFO: status: 77% (161348583424/209385947136), sparse 31% (66793660416), duration 1056, 133/133 MB/s
INFO: status: 78% (163348217856/209385947136), sparse 31% (66815799296), duration 1066, 199/197 MB/s
INFO: status: 79% (165583585280/209385947136), sparse 31% (66816610304), duration 1081, 149/148 MB/s
INFO: status: 80% (167711604736/209385947136), sparse 31% (66817032192), duration 1091, 212/212 MB/s
INFO: status: 81% (169635151872/209385947136), sparse 31% (66817032192), duration 1102, 174/174 MB/s
INFO: status: 82% (171720638464/209385947136), sparse 31% (66817032192), duration 1116, 148/148 MB/s
INFO: status: 83% (173793345536/209385947136), sparse 31% (66817032192), duration 1129, 159/159 MB/s
INFO: status: 84% (175899869184/209385947136), sparse 31% (66818637824), duration 1145, 131/131 MB/s
INFO: status: 85% (178095259648/209385947136), sparse 31% (66822422528), duration 1160, 146/146 MB/s
INFO: status: 86% (180182056960/209385947136), sparse 31% (66822950912), duration 1268, 19/19 MB/s
lzop: Input/output error: <stdout>
INFO: status: 86% (180730331136/209385947136), sparse 31% (66823712768), duration 1346, 7/7 MB/s
ERROR: vma_queue_write: write error - Broken pipe
INFO: aborting backup job
ERROR: Backup of VM 510 failed - vma_queue_write: write error - Broken pipe
INFO: Backup job finished with errors
TASK ERROR: job errors
root@proxmox4:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 0 10M 0% /dev
tmpfs 26G 500K 26G 1% /run
/dev/mapper/pve-root 95G 16G 75G 18% /
tmpfs 5.0M 8.0K 5.0M 1% /run/lock
tmpfs 51G 44M 51G 1% /run/shm
/dev/mapper/pve-data 300G 59G 242G 20% /var/lib/vz
/dev/sda2 494M 36M 434M 8% /boot
/dev/sdb1 2.0T 1.8T 104G 95% /raid
/dev/fuse 30M 48K 30M 1% /etc/pve
192.168.1.171:/raid/nfs 4.5T 3.1T 1.2T 73% /mnt/pve/nfs_on_171
192.168.1.10:/zprox/zdata/znfs 3.3T 1.2T 2.2T 34% /mnt/pve/znfs_on_10
/raid/private/512 20G 12G 8.3G 59% /var/lib/vz/root/512
none 2.0G 4.0K 2.0G 1% /var/lib/vz/root/512/dev
none 4.0K 0 4.0K 0% /var/lib/vz/root/512/sys/fs/cgroup
none 410M 1.1M 409M 1% /var/lib/vz/root/512/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/512/run/lock
none 2.0G 0 2.0G 0% /var/lib/vz/root/512/run/shm
none 100M 0 100M 0% /var/lib/vz/root/512/run/user
192.168.1.21:/mnt/volume/backup/images 24T 7.6T 17T 32% /var/lib/vz/root/512/var/www/html/images
192.168.1.21:/mnt/volume/jobs/inspection_pics 19T 2.8T 17T 15% /var/lib/vz/root/512/var/www/html/inspection_pics
Please let me know if any other info is needed to assist with this issue.
Thanks,
Indyimaging
The following is the output from the task viewer output:
INFO: starting new backup job: vzdump 510 --quiet 1 --mode snapshot --compress lzo --storage nfs_on_171
INFO: Starting Backup of VM 510 (qemu)
INFO: status = running
INFO: update VM 510: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/mnt/pve/nfs_on_171/dump/vzdump-qemu-510-2015_09_10-20_00_02.vma.lzo'
INFO: started backup task '504f0f8e-f859-4a48-ac1b-5ef1dd4bf99a'
INFO: status: 0% (324272128/209385947136), sparse 0% (86798336), duration 3, 108/79 MB/s
INFO: status: 1% (2109603840/209385947136), sparse 0% (115286016), duration 27, 74/73 MB/s
INFO: status: 2% (4192993280/209385947136), sparse 0% (135294976), duration 52, 83/82 MB/s
INFO: status: 3% (6336413696/209385947136), sparse 0% (154693632), duration 82, 71/70 MB/s
INFO: status: 4% (8385200128/209385947136), sparse 0% (186875904), duration 101, 107/106 MB/s
INFO: status: 5% (11120934912/209385947136), sparse 1% (2429018112), duration 106, 547/98 MB/s
INFO: status: 6% (13130727424/209385947136), sparse 2% (4438745088), duration 131, 80/0 MB/s
INFO: status: 7% (16092889088/209385947136), sparse 3% (7400841216), duration 134, 987/0 MB/s
INFO: status: 9% (19114164224/209385947136), sparse 4% (10422116352), duration 137, 1007/0 MB/s
INFO: status: 10% (22178562048/209385947136), sparse 6% (13486514176), duration 140, 1021/0 MB/s
INFO: status: 12% (25186009088/209385947136), sparse 7% (16493961216), duration 143, 1002/0 MB/s
INFO: status: 13% (27330936832/209385947136), sparse 8% (17970003968), duration 151, 268/83 MB/s
INFO: status: 14% (29435953152/209385947136), sparse 8% (18004389888), duration 165, 150/147 MB/s
INFO: status: 15% (31566200832/209385947136), sparse 8% (18038218752), duration 179, 152/149 MB/s
INFO: status: 16% (33620623360/209385947136), sparse 8% (18072346624), duration 192, 158/155 MB/s
INFO: status: 17% (35623796736/209385947136), sparse 8% (18091163648), duration 203, 182/180 MB/s
INFO: status: 18% (37710266368/209385947136), sparse 8% (18109784064), duration 215, 173/172 MB/s
INFO: status: 19% (39806631936/209385947136), sparse 8% (18119913472), duration 229, 149/149 MB/s
INFO: status: 20% (42032431104/209385947136), sparse 8% (18136276992), duration 241, 185/184 MB/s
INFO: status: 21% (44054609920/209385947136), sparse 8% (18147467264), duration 287, 43/43 MB/s
INFO: status: 22% (46066499584/209385947136), sparse 8% (18154897408), duration 313, 77/77 MB/s
INFO: status: 23% (48171188224/209385947136), sparse 8% (18188591104), duration 336, 91/90 MB/s
INFO: status: 24% (50265587712/209385947136), sparse 8% (18197491712), duration 356, 104/104 MB/s
INFO: status: 25% (52648869888/209385947136), sparse 8% (18362777600), duration 375, 125/116 MB/s
INFO: status: 26% (54522478592/209385947136), sparse 8% (18370224128), duration 388, 144/143 MB/s
INFO: status: 27% (56587649024/209385947136), sparse 8% (18371485696), duration 404, 129/128 MB/s
INFO: status: 28% (58680213504/209385947136), sparse 8% (18374946816), duration 417, 160/160 MB/s
INFO: status: 29% (60898017280/209385947136), sparse 8% (18386952192), duration 428, 201/200 MB/s
INFO: status: 30% (62823989248/209385947136), sparse 8% (18619187200), duration 448, 96/84 MB/s
INFO: status: 31% (64947814400/209385947136), sparse 9% (19107966976), duration 487, 54/41 MB/s
INFO: status: 32% (67093004288/209385947136), sparse 9% (19477286912), duration 509, 97/80 MB/s
INFO: status: 33% (69196972032/209385947136), sparse 10% (21262032896), duration 526, 123/18 MB/s
INFO: status: 34% (71262797824/209385947136), sparse 10% (21799469056), duration 545, 108/80 MB/s
INFO: status: 35% (73365913600/209385947136), sparse 10% (21815250944), duration 568, 91/90 MB/s
INFO: status: 36% (75550425088/209385947136), sparse 10% (21815255040), duration 581, 168/168 MB/s
INFO: status: 37% (77552877568/209385947136), sparse 10% (21838548992), duration 591, 200/197 MB/s
INFO: status: 38% (79569420288/209385947136), sparse 10% (21841408000), duration 606, 134/134 MB/s
INFO: status: 39% (81734795264/209385947136), sparse 10% (21977001984), duration 670, 33/31 MB/s
INFO: status: 40% (83774078976/209385947136), sparse 10% (22037647360), duration 684, 145/141 MB/s
INFO: status: 41% (85973991424/209385947136), sparse 10% (22111019008), duration 696, 183/177 MB/s
INFO: status: 42% (87987519488/209385947136), sparse 10% (22112206848), duration 721, 80/80 MB/s
INFO: status: 43% (90131398656/209385947136), sparse 10% (22112206848), duration 735, 153/153 MB/s
INFO: status: 44% (92176384000/209385947136), sparse 10% (22237249536), duration 751, 127/119 MB/s
INFO: status: 45% (94327799808/209385947136), sparse 10% (22258151424), duration 775, 89/88 MB/s
INFO: status: 46% (96406405120/209385947136), sparse 10% (22297112576), duration 786, 188/185 MB/s
INFO: status: 47% (98470985728/209385947136), sparse 11% (23216406528), duration 794, 258/143 MB/s
INFO: status: 48% (100546379776/209385947136), sparse 11% (23373479936), duration 845, 40/37 MB/s
INFO: status: 49% (102753566720/209385947136), sparse 11% (23605161984), duration 862, 129/116 MB/s
INFO: status: 50% (105678045184/209385947136), sparse 12% (26052952064), duration 867, 584/95 MB/s
INFO: status: 51% (108137152512/209385947136), sparse 13% (28512059392), duration 870, 819/0 MB/s
INFO: status: 52% (109146603520/209385947136), sparse 14% (29521510400), duration 895, 40/0 MB/s
INFO: status: 53% (112214474752/209385947136), sparse 15% (32589381632), duration 898, 1022/0 MB/s
INFO: status: 54% (113567924224/209385947136), sparse 16% (33738326016), duration 901, 451/68 MB/s
INFO: status: 55% (115330056192/209385947136), sparse 16% (33966702592), duration 916, 117/102 MB/s
INFO: status: 56% (118339076096/209385947136), sparse 17% (36975722496), duration 919, 1003/0 MB/s
INFO: status: 57% (121358254080/209385947136), sparse 19% (39994900480), duration 922, 1006/0 MB/s
INFO: status: 59% (124428681216/209385947136), sparse 20% (43065327616), duration 925, 1023/0 MB/s
INFO: status: 60% (127427018752/209385947136), sparse 21% (46063665152), duration 928, 999/0 MB/s
INFO: status: 62% (130514616320/209385947136), sparse 23% (49151262720), duration 931, 1029/0 MB/s
INFO: status: 63% (132473225216/209385947136), sparse 24% (51109871616), duration 941, 195/0 MB/s
INFO: status: 64% (135456030720/209385947136), sparse 25% (54092677120), duration 944, 994/0 MB/s
INFO: status: 66% (138461642752/209385947136), sparse 27% (57098289152), duration 947, 1001/0 MB/s
INFO: status: 67% (141433176064/209385947136), sparse 28% (60069822464), duration 950, 990/0 MB/s
INFO: status: 68% (144437477376/209385947136), sparse 30% (63074123776), duration 953, 1001/0 MB/s
INFO: status: 70% (147381092352/209385947136), sparse 31% (66017738752), duration 956, 981/0 MB/s
INFO: status: 71% (148672151552/209385947136), sparse 31% (66358009856), duration 964, 161/118 MB/s
INFO: status: 72% (150871539712/209385947136), sparse 31% (66384400384), duration 980, 137/135 MB/s
INFO: status: 73% (153047007232/209385947136), sparse 31% (66787012608), duration 992, 181/147 MB/s
INFO: status: 74% (155027374080/209385947136), sparse 31% (66787012608), duration 1014, 90/90 MB/s
INFO: status: 75% (157190193152/209385947136), sparse 31% (66787012608), duration 1027, 166/166 MB/s
INFO: status: 76% (159204769792/209385947136), sparse 31% (66787012608), duration 1040, 154/154 MB/s
INFO: status: 77% (161348583424/209385947136), sparse 31% (66793660416), duration 1056, 133/133 MB/s
INFO: status: 78% (163348217856/209385947136), sparse 31% (66815799296), duration 1066, 199/197 MB/s
INFO: status: 79% (165583585280/209385947136), sparse 31% (66816610304), duration 1081, 149/148 MB/s
INFO: status: 80% (167711604736/209385947136), sparse 31% (66817032192), duration 1091, 212/212 MB/s
INFO: status: 81% (169635151872/209385947136), sparse 31% (66817032192), duration 1102, 174/174 MB/s
INFO: status: 82% (171720638464/209385947136), sparse 31% (66817032192), duration 1116, 148/148 MB/s
INFO: status: 83% (173793345536/209385947136), sparse 31% (66817032192), duration 1129, 159/159 MB/s
INFO: status: 84% (175899869184/209385947136), sparse 31% (66818637824), duration 1145, 131/131 MB/s
INFO: status: 85% (178095259648/209385947136), sparse 31% (66822422528), duration 1160, 146/146 MB/s
INFO: status: 86% (180182056960/209385947136), sparse 31% (66822950912), duration 1268, 19/19 MB/s
lzop: Input/output error: <stdout>
INFO: status: 86% (180730331136/209385947136), sparse 31% (66823712768), duration 1346, 7/7 MB/s
ERROR: vma_queue_write: write error - Broken pipe
INFO: aborting backup job
ERROR: Backup of VM 510 failed - vma_queue_write: write error - Broken pipe
INFO: Backup job finished with errors
TASK ERROR: job errors
root@proxmox4:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 0 10M 0% /dev
tmpfs 26G 500K 26G 1% /run
/dev/mapper/pve-root 95G 16G 75G 18% /
tmpfs 5.0M 8.0K 5.0M 1% /run/lock
tmpfs 51G 44M 51G 1% /run/shm
/dev/mapper/pve-data 300G 59G 242G 20% /var/lib/vz
/dev/sda2 494M 36M 434M 8% /boot
/dev/sdb1 2.0T 1.8T 104G 95% /raid
/dev/fuse 30M 48K 30M 1% /etc/pve
192.168.1.171:/raid/nfs 4.5T 3.1T 1.2T 73% /mnt/pve/nfs_on_171
192.168.1.10:/zprox/zdata/znfs 3.3T 1.2T 2.2T 34% /mnt/pve/znfs_on_10
/raid/private/512 20G 12G 8.3G 59% /var/lib/vz/root/512
none 2.0G 4.0K 2.0G 1% /var/lib/vz/root/512/dev
none 4.0K 0 4.0K 0% /var/lib/vz/root/512/sys/fs/cgroup
none 410M 1.1M 409M 1% /var/lib/vz/root/512/run
none 5.0M 0 5.0M 0% /var/lib/vz/root/512/run/lock
none 2.0G 0 2.0G 0% /var/lib/vz/root/512/run/shm
none 100M 0 100M 0% /var/lib/vz/root/512/run/user
192.168.1.21:/mnt/volume/backup/images 24T 7.6T 17T 32% /var/lib/vz/root/512/var/www/html/images
192.168.1.21:/mnt/volume/jobs/inspection_pics 19T 2.8T 17T 15% /var/lib/vz/root/512/var/www/html/inspection_pics
Please let me know if any other info is needed to assist with this issue.
Thanks,
Indyimaging