USB hdd for backup very slow with 4.1

R

raj

Renowned Member
Sep 17, 2011
222
4
83
www.businessparksolutions.com
Hi Team,

I was running proxmox 3.4 and was doing backup to a usb drive and it was flying.

I upgraded to proxmox 4.1 and now the backup are taking ages:

You do not have a valid subscription for this server. Please visit www.proxmox.com to get a list of available options.
INFO: starting new backup job: vzdump 389 --storage Offsite --mode snapshot --remove 0 --node master --compress lzo
INFO: Starting Backup of VM 389 (qemu)
INFO: status = stopped
INFO: update VM 389: -lock backup
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: creating archive '/media/usb0/dump/vzdump-qemu-389-2015_12_20-10_02_16.vma.lzo'
INFO: starting kvm to execute backup task
Running as unit 389.scope.
INFO: started backup task '9540870e-91a4-4498-85de-e4f67dd56125'
INFO: status: 0% (26607616/193273528320), sparse 0% (21032960), duration 3, 8/1 MB/s
INFO: status: 1% (1934753792/193273528320), sparse 0% (178012160), duration 1134, 1/1 MB/s
INFO: status: 2% (3865706496/193273528320), sparse 0% (208060416), duration 2399, 1/1 MB/s
INFO: status: 3% (5800460288/193273528320), sparse 0% (253788160), duration 3636, 1/1 MB/s
INFO: status: 4% (7731412992/193273528320), sparse 0% (334479360), duration 4851, 1/1 MB/s
INFO: status: 5% (9677570048/193273528320), sparse 0% (1270812672), duration 5539, 2/1 MB/s
INFO: status: 6% (11597119488/193273528320), sparse 1% (2167197696), duration 6215, 2/1 MB/s
INFO: status: 7% (13531873280/193273528320), sparse 1% (2191941632), duration 7521, 1/1 MB/s
INFO: status: 8% (15462825984/193273528320), sparse 1% (2209087488), duration 8867, 1/1 MB/s
INFO: status: 9% (17397579776/193273528320), sparse 1% (2233479168), duration 10251, 1/1 MB/s
INFO: status: 10% (19328532480/193273528320), sparse 1% (2252705792), duration 11723, 1/1 MB/s
INFO: status: 11% (21263286272/193273528320), sparse 1% (2272198656), duration 13185, 1/1 MB/s
INFO: status: 12% (23194238976/193273528320), sparse 1% (2282528768), duration 14670, 1/1 MB/s
INFO: status: 13% (25128992768/193273528320), sparse 1% (2365353984), duration 16066, 1/1 MB/s
INFO: status: 14% (27059945472/193273528320), sparse 1% (2366701568), duration 17578, 1/1 MB/s
INFO: status: 15% (28994699264/193273528320), sparse 1% (2367868928), duration 18647, 1/1 MB/s
INFO: status: 16% (30925651968/193273528320), sparse 1% (2631606272), duration 19613, 1/1 MB/s



is anyone else having a similar issue or have a fix pls.

Regards,

Raj
 
Hi!

I have similar problem. I upgraded (clean install) from Proxmox 3.1 to Proxmox 4.1
But instead doing backup to a usb drive, I use local disks.
After installing Proxmox 4.1 first few days backup speeds was as usual (05.01.2016. backup log):

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_05-00_01_01.vma.lzo'
INFO: started backup task '5e7c5efe-40ae-44d1-bf1e-bee90b976fef'
INFO: status: 0% (3854958592/751619276800), sparse 0% (3615424512), duration 3, 1284/79 MB/s
INFO: status: 1% (13384024064/751619276800), sparse 1% (13144489984), duration 6, 3176/0 MB/s
INFO: status: 3% (22760128512/751619276800), sparse 2% (22520594432), duration 9, 3125/0 MB/s
INFO: status: 4% (30249058304/751619276800), sparse 3% (28001480704), duration 22, 576/154 MB/s
INFO: status: 5% (37723963392/751619276800), sparse 3% (28236083200), duration 67, 166/160 MB/s
INFO: status: 6% (45255753728/751619276800), sparse 3% (28342931456), duration 125, 129/128 MB/s
INFO: status: 7% (52614660096/751619276800), sparse 3% (28473004032), duration 175, 147/144 MB/s
INFO: status: 8% (60281454592/751619276800), sparse 3% (28552884224), duration 224, 156/154 MB/s
INFO: status: 9% (67852500992/751619276800), sparse 3% (28647710720), duration 273, 154/152 MB/s
INFO: status: 10% (75193122816/751619276800), sparse 3% (28737642496), duration 329, 131/129 MB/s
INFO: status: 11% (82753486848/751619276800), sparse 3% (28831182848), duration 375, 164/162 MB/s
INFO: status: 12% (90355400704/751619276800), sparse 3% (28920606720), duration 420, 168/166 MB/s
INFO: status: 13% (97795112960/751619276800), sparse 3% (29007429632), duration 476, 132/131 MB/s
INFO: status: 14% (105282535424/751619276800), sparse 3% (29084008448), duration 522, 162/161 MB/s
INFO: status: 15% (112823500800/751619276800), sparse 3% (29169295360), duration 571, 153/152 MB/s

INFO: status: 90% (676623351808/751619276800), sparse 4% (36010254336), duration 4449, 143/142 MB/s
INFO: status: 91% (684036194304/751619276800), sparse 4% (36010254336), duration 4498, 151/151 MB/s
INFO: status: 92% (691619364864/751619276800), sparse 4% (36047937536), duration 4552, 140/139 MB/s
INFO: status: 93% (699175927808/751619276800), sparse 4% (36144439296), duration 4600, 157/155 MB/s
INFO: status: 94% (706541584384/751619276800), sparse 4% (36236189696), duration 4648, 153/151 MB/s
INFO: status: 95% (714090020864/751619276800), sparse 4% (36370210816), duration 4703, 137/134 MB/s
INFO: status: 96% (721635049472/751619276800), sparse 4% (36469612544), duration 4752, 153/151 MB/s
INFO: status: 97% (729168609280/751619276800), sparse 4% (36599066624), duration 4803, 147/145 MB/s
INFO: status: 98% (736684867584/751619276800), sparse 4% (36694089728), duration 4855, 144/142 MB/s
INFO: status: 99% (744179695616/751619276800), sparse 4% (36778516480), duration 4913, 129/127 MB/s
INFO: status: 100% (751619276800/751619276800), sparse 4% (36840198144), duration 4960, 158/156 MB/s
INFO: transferred 751619 MB in 4960 seconds (151 MB/s)
INFO: archive file size: 135.87GB
INFO: Finished Backup of VM 100 (01:22:42)

But next day (06.01.2016.) read/write speed was slower than usual:

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_06-00_01_02.vma.lzo'
INFO: started backup task '38301a0e-3a61-462c-98f3-ca8978ed5c64'
INFO: status: 0% (320864256/751619276800), sparse 0% (171814912), duration 3, 106/49 MB/s
INFO: status: 1% (9475588096/751619276800), sparse 1% (9232384000), duration 8, 1830/18 MB/s
INFO: status: 2% (18188599296/751619276800), sparse 2% (17945133056), duration 11, 2904/0 MB/s
INFO: status: 3% (27336245248/751619276800), sparse 3% (27092451328), duration 14, 3049/0 MB/s
INFO: status: 4% (30089478144/751619276800), sparse 3% (28001595392), duration 78, 43/28 MB/s
INFO: status: 5% (37597216768/751619276800), sparse 3% (28236288000), duration 285, 36/35 MB/s
INFO: status: 6% (45125730304/751619276800), sparse 3% (28339077120), duration 503, 34/34 MB/s
INFO: status: 7% (52626980864/751619276800), sparse 3% (28473344000), duration 770, 28/27 MB/s
INFO: status: 8% (60159885312/751619276800), sparse 3% (28553224192), duration 1012, 31/30 MB/s
INFO: status: 9% (67656482816/751619276800), sparse 3% (28647997440), duration 1253, 31/30 MB/s
INFO: status: 10% (75185324032/751619276800), sparse 3% (28737929216), duration 1469, 34/34 MB/s
INFO: status: 11% (82709970944/751619276800), sparse 3% (28831469568), duration 1689, 34/33 MB/s
INFO: status: 12% (90226491392/751619276800), sparse 3% (28920893440), duration 1940, 29/29 MB/s
INFO: status: 13% (97710768128/751619276800), sparse 3% (29007622144), duration 2181, 31/30 MB/s
INFO: status: 14% (105240330240/751619276800), sparse 3% (29084200960), duration 2387, 36/36 MB/s
INFO: status: 15% (112805609472/751619276800), sparse 3% (29173501952), duration 2631, 31/30 MB/s

INFO: status: 90% (676483170304/751619276800), sparse 4% (36011954176), duration 23173, 20/20 MB/s
INFO: status: 91% (683975639040/751619276800), sparse 4% (36011954176), duration 23475, 24/24 MB/s
INFO: status: 92% (691493928960/751619276800), sparse 4% (36044931072), duration 23788, 24/23 MB/s
INFO: status: 93% (699021197312/751619276800), sparse 4% (36141432832), duration 24148, 20/20 MB/s
INFO: status: 94% (706529918976/751619276800), sparse 4% (36233183232), duration 24444, 25/25 MB/s
INFO: status: 95% (714050502656/751619276800), sparse 4% (36367204352), duration 24833, 19/18 MB/s
INFO: status: 96% (721554767872/751619276800), sparse 4% (36466606080), duration 25393, 13/13 MB/s
INFO: status: 97% (729078431744/751619276800), sparse 4% (36596060160), duration 25780, 19/19 MB/s
INFO: status: 98% (736616644608/751619276800), sparse 4% (36691083264), duration 26076, 25/25 MB/s
INFO: status: 99% (744116256768/751619276800), sparse 4% (36775510016), duration 26384, 24/24 MB/s
INFO: status: 100% (751619276800/751619276800), sparse 4% (36837191680), duration 26629, 30/30 MB/s
INFO: transferred 751619 MB in 26629 seconds (28 MB/s)
INFO: archive file size: 135.38GB
INFO: delete old backup '/var/lib/vz/dump/vzdump-qemu-100-2016_01_02-00_01_01.vma.lzo'
INFO: Finished Backup of VM 100 (07:23:59)

Today it didn't even finish in more than 9 hours, read/write speed is terrible:

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_08-00_01_02.vma.lzo'
INFO: started backup task 'fd3f0c72-ae7c-414f-88ca-744a4ba66b24'
INFO: status: 0% (19136512/751619276800), sparse 0% (3063808), duration 3, 6/5 MB/s
INFO: status: 1% (9678880768/751619276800), sparse 1% (9424416768), duration 37, 284/7 MB/s
INFO: status: 2% (17588551680/751619276800), sparse 2% (17333760000), duration 40, 2636/0 MB/s
INFO: status: 3% (25785663488/751619276800), sparse 3% (25530544128), duration 43, 2732/0 MB/s
INFO: status: 4% (30064967680/751619276800), sparse 3% (28001742848), duration 284, 17/7 MB/s
INFO: status: 5% (37583585280/751619276800), sparse 3% (28207935488), duration 1053, 9/9 MB/s
INFO: status: 6% (45107511296/751619276800), sparse 3% (28338958336), duration 2253, 6/6 MB/s
INFO: status: 7% (52616495104/751619276800), sparse 3% (28441833472), duration 3480, 6/6 MB/s
INFO: status: 8% (60130131968/751619276800), sparse 3% (28553019392), duration 4699, 6/6 MB/s
INFO: status: 9% (67648028672/751619276800), sparse 3% (28627738624), duration 5907, 6/6 MB/s
INFO: status: 10% (75185520640/751619276800), sparse 3% (28733992960), duration 7133, 6/6 MB/s
INFO: status: 11% (82681331712/751619276800), sparse 3% (28811878400), duration 8017, 8/8 MB/s
INFO: status: 12% (90198179840/751619276800), sparse 3% (28898779136), duration 9185, 6/6 MB/s
INFO: status: 13% (97713913856/751619276800), sparse 3% (28986978304), duration 10550, 5/5 MB/s
INFO: status: 14% (105229713408/751619276800), sparse 3% (29061308416), duration 11759, 6/6 MB/s
INFO: status: 15% (112743481344/751619276800), sparse 3% (29146664960), duration 13308, 4/4 MB/s
INFO: status: 16% (120263475200/751619276800), sparse 3% (29218447360), duration 15023, 4/4 MB/s
INFO: status: 17% (127778095104/751619276800), sparse 3% (29306118144), duration 16766, 4/4 MB/s
INFO: status: 18% (135293632512/751619276800), sparse 3% (29378572288), duration 18455, 4/4 MB/s
INFO: status: 19% (142808973312/751619276800), sparse 3% (29473452032), duration 20176, 4/4 MB/s
INFO: status: 20% (150324183040/751619276800), sparse 3% (29515571200), duration 21882, 4/4 MB/s
INFO: status: 21% (157844701184/751619276800), sparse 3% (29543768064), duration 23603, 4/4 MB/s
INFO: status: 22% (165358141440/751619276800), sparse 3% (29629804544), duration 24998, 5/5 MB/s
INFO: status: 23% (172877283328/751619276800), sparse 3% (29724479488), duration 26617, 4/4 MB/s
INFO: status: 24% (180391968768/751619276800), sparse 3% (29797064704), duration 28209, 4/4 MB/s
INFO: status: 25% (187907112960/751619276800), sparse 3% (29890260992), duration 29747, 4/4 MB/s
INFO: status: 26% (195433594880/751619276800), sparse 3% (29975351296), duration 30969, 6/6 MB/s
INFO: status: 27% (202940219392/751619276800), sparse 4% (30102855680), duration 32171, 6/6 MB/s
ERROR: interrupted by signal
INFO: aborting backup job
ERROR: Backup of VM 100 failed - interrupted by signal
ERROR: Backup job failed - interrupted by signal
TASK ERROR: interrupted by signal

I add NFS share and try to backup trough network, but problem remained.
Maybe someone can lead me in the right way?
My setup:
2 nodes.
Proxmox 4.1
Both servers have hardware RAID10 (4x1TB 10k disks)
 
You must log in or register to reply here.
Top Bottom
Back