USB hdd for backup very slow with 4.1

R

raj

Renowned Member
Sep 17, 2011
219
4
83
www.businessparksolutions.com
Hi Team,

I was running proxmox 3.4 and was doing backup to a usb drive and it was flying.

I upgraded to proxmox 4.1 and now the backup are taking ages:

You do not have a valid subscription for this server. Please visit www.proxmox.com to get a list of available options.
INFO: starting new backup job: vzdump 389 --storage Offsite --mode snapshot --remove 0 --node master --compress lzo
INFO: Starting Backup of VM 389 (qemu)
INFO: status = stopped
INFO: update VM 389: -lock backup
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: creating archive '/media/usb0/dump/vzdump-qemu-389-2015_12_20-10_02_16.vma.lzo'
INFO: starting kvm to execute backup task
Running as unit 389.scope.
INFO: started backup task '9540870e-91a4-4498-85de-e4f67dd56125'
INFO: status: 0% (26607616/193273528320), sparse 0% (21032960), duration 3, 8/1 MB/s
INFO: status: 1% (1934753792/193273528320), sparse 0% (178012160), duration 1134, 1/1 MB/s
INFO: status: 2% (3865706496/193273528320), sparse 0% (208060416), duration 2399, 1/1 MB/s
INFO: status: 3% (5800460288/193273528320), sparse 0% (253788160), duration 3636, 1/1 MB/s
INFO: status: 4% (7731412992/193273528320), sparse 0% (334479360), duration 4851, 1/1 MB/s
INFO: status: 5% (9677570048/193273528320), sparse 0% (1270812672), duration 5539, 2/1 MB/s
INFO: status: 6% (11597119488/193273528320), sparse 1% (2167197696), duration 6215, 2/1 MB/s
INFO: status: 7% (13531873280/193273528320), sparse 1% (2191941632), duration 7521, 1/1 MB/s
INFO: status: 8% (15462825984/193273528320), sparse 1% (2209087488), duration 8867, 1/1 MB/s
INFO: status: 9% (17397579776/193273528320), sparse 1% (2233479168), duration 10251, 1/1 MB/s
INFO: status: 10% (19328532480/193273528320), sparse 1% (2252705792), duration 11723, 1/1 MB/s
INFO: status: 11% (21263286272/193273528320), sparse 1% (2272198656), duration 13185, 1/1 MB/s
INFO: status: 12% (23194238976/193273528320), sparse 1% (2282528768), duration 14670, 1/1 MB/s
INFO: status: 13% (25128992768/193273528320), sparse 1% (2365353984), duration 16066, 1/1 MB/s
INFO: status: 14% (27059945472/193273528320), sparse 1% (2366701568), duration 17578, 1/1 MB/s
INFO: status: 15% (28994699264/193273528320), sparse 1% (2367868928), duration 18647, 1/1 MB/s
INFO: status: 16% (30925651968/193273528320), sparse 1% (2631606272), duration 19613, 1/1 MB/s



is anyone else having a similar issue or have a fix pls.

Regards,

Raj
 
Hi!

I have similar problem. I upgraded (clean install) from Proxmox 3.1 to Proxmox 4.1
But instead doing backup to a usb drive, I use local disks.
After installing Proxmox 4.1 first few days backup speeds was as usual (05.01.2016. backup log):

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_05-00_01_01.vma.lzo'
INFO: started backup task '5e7c5efe-40ae-44d1-bf1e-bee90b976fef'
INFO: status: 0% (3854958592/751619276800), sparse 0% (3615424512), duration 3, 1284/79 MB/s
INFO: status: 1% (13384024064/751619276800), sparse 1% (13144489984), duration 6, 3176/0 MB/s
INFO: status: 3% (22760128512/751619276800), sparse 2% (22520594432), duration 9, 3125/0 MB/s
INFO: status: 4% (30249058304/751619276800), sparse 3% (28001480704), duration 22, 576/154 MB/s
INFO: status: 5% (37723963392/751619276800), sparse 3% (28236083200), duration 67, 166/160 MB/s
INFO: status: 6% (45255753728/751619276800), sparse 3% (28342931456), duration 125, 129/128 MB/s
INFO: status: 7% (52614660096/751619276800), sparse 3% (28473004032), duration 175, 147/144 MB/s
INFO: status: 8% (60281454592/751619276800), sparse 3% (28552884224), duration 224, 156/154 MB/s
INFO: status: 9% (67852500992/751619276800), sparse 3% (28647710720), duration 273, 154/152 MB/s
INFO: status: 10% (75193122816/751619276800), sparse 3% (28737642496), duration 329, 131/129 MB/s
INFO: status: 11% (82753486848/751619276800), sparse 3% (28831182848), duration 375, 164/162 MB/s
INFO: status: 12% (90355400704/751619276800), sparse 3% (28920606720), duration 420, 168/166 MB/s
INFO: status: 13% (97795112960/751619276800), sparse 3% (29007429632), duration 476, 132/131 MB/s
INFO: status: 14% (105282535424/751619276800), sparse 3% (29084008448), duration 522, 162/161 MB/s
INFO: status: 15% (112823500800/751619276800), sparse 3% (29169295360), duration 571, 153/152 MB/s

INFO: status: 90% (676623351808/751619276800), sparse 4% (36010254336), duration 4449, 143/142 MB/s
INFO: status: 91% (684036194304/751619276800), sparse 4% (36010254336), duration 4498, 151/151 MB/s
INFO: status: 92% (691619364864/751619276800), sparse 4% (36047937536), duration 4552, 140/139 MB/s
INFO: status: 93% (699175927808/751619276800), sparse 4% (36144439296), duration 4600, 157/155 MB/s
INFO: status: 94% (706541584384/751619276800), sparse 4% (36236189696), duration 4648, 153/151 MB/s
INFO: status: 95% (714090020864/751619276800), sparse 4% (36370210816), duration 4703, 137/134 MB/s
INFO: status: 96% (721635049472/751619276800), sparse 4% (36469612544), duration 4752, 153/151 MB/s
INFO: status: 97% (729168609280/751619276800), sparse 4% (36599066624), duration 4803, 147/145 MB/s
INFO: status: 98% (736684867584/751619276800), sparse 4% (36694089728), duration 4855, 144/142 MB/s
INFO: status: 99% (744179695616/751619276800), sparse 4% (36778516480), duration 4913, 129/127 MB/s
INFO: status: 100% (751619276800/751619276800), sparse 4% (36840198144), duration 4960, 158/156 MB/s
INFO: transferred 751619 MB in 4960 seconds (151 MB/s)
INFO: archive file size: 135.87GB
INFO: Finished Backup of VM 100 (01:22:42)

But next day (06.01.2016.) read/write speed was slower than usual:

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_06-00_01_02.vma.lzo'
INFO: started backup task '38301a0e-3a61-462c-98f3-ca8978ed5c64'
INFO: status: 0% (320864256/751619276800), sparse 0% (171814912), duration 3, 106/49 MB/s
INFO: status: 1% (9475588096/751619276800), sparse 1% (9232384000), duration 8, 1830/18 MB/s
INFO: status: 2% (18188599296/751619276800), sparse 2% (17945133056), duration 11, 2904/0 MB/s
INFO: status: 3% (27336245248/751619276800), sparse 3% (27092451328), duration 14, 3049/0 MB/s
INFO: status: 4% (30089478144/751619276800), sparse 3% (28001595392), duration 78, 43/28 MB/s
INFO: status: 5% (37597216768/751619276800), sparse 3% (28236288000), duration 285, 36/35 MB/s
INFO: status: 6% (45125730304/751619276800), sparse 3% (28339077120), duration 503, 34/34 MB/s
INFO: status: 7% (52626980864/751619276800), sparse 3% (28473344000), duration 770, 28/27 MB/s
INFO: status: 8% (60159885312/751619276800), sparse 3% (28553224192), duration 1012, 31/30 MB/s
INFO: status: 9% (67656482816/751619276800), sparse 3% (28647997440), duration 1253, 31/30 MB/s
INFO: status: 10% (75185324032/751619276800), sparse 3% (28737929216), duration 1469, 34/34 MB/s
INFO: status: 11% (82709970944/751619276800), sparse 3% (28831469568), duration 1689, 34/33 MB/s
INFO: status: 12% (90226491392/751619276800), sparse 3% (28920893440), duration 1940, 29/29 MB/s
INFO: status: 13% (97710768128/751619276800), sparse 3% (29007622144), duration 2181, 31/30 MB/s
INFO: status: 14% (105240330240/751619276800), sparse 3% (29084200960), duration 2387, 36/36 MB/s
INFO: status: 15% (112805609472/751619276800), sparse 3% (29173501952), duration 2631, 31/30 MB/s

INFO: status: 90% (676483170304/751619276800), sparse 4% (36011954176), duration 23173, 20/20 MB/s
INFO: status: 91% (683975639040/751619276800), sparse 4% (36011954176), duration 23475, 24/24 MB/s
INFO: status: 92% (691493928960/751619276800), sparse 4% (36044931072), duration 23788, 24/23 MB/s
INFO: status: 93% (699021197312/751619276800), sparse 4% (36141432832), duration 24148, 20/20 MB/s
INFO: status: 94% (706529918976/751619276800), sparse 4% (36233183232), duration 24444, 25/25 MB/s
INFO: status: 95% (714050502656/751619276800), sparse 4% (36367204352), duration 24833, 19/18 MB/s
INFO: status: 96% (721554767872/751619276800), sparse 4% (36466606080), duration 25393, 13/13 MB/s
INFO: status: 97% (729078431744/751619276800), sparse 4% (36596060160), duration 25780, 19/19 MB/s
INFO: status: 98% (736616644608/751619276800), sparse 4% (36691083264), duration 26076, 25/25 MB/s
INFO: status: 99% (744116256768/751619276800), sparse 4% (36775510016), duration 26384, 24/24 MB/s
INFO: status: 100% (751619276800/751619276800), sparse 4% (36837191680), duration 26629, 30/30 MB/s
INFO: transferred 751619 MB in 26629 seconds (28 MB/s)
INFO: archive file size: 135.38GB
INFO: delete old backup '/var/lib/vz/dump/vzdump-qemu-100-2016_01_02-00_01_01.vma.lzo'
INFO: Finished Backup of VM 100 (07:23:59)

Today it didn't even finish in more than 9 hours, read/write speed is terrible:

Code: 
INFO: Starting Backup of VM 100 (qemu)
INFO: status = running
INFO: update VM 100: -lock backup
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating archive '/var/lib/vz/dump/vzdump-qemu-100-2016_01_08-00_01_02.vma.lzo'
INFO: started backup task 'fd3f0c72-ae7c-414f-88ca-744a4ba66b24'
INFO: status: 0% (19136512/751619276800), sparse 0% (3063808), duration 3, 6/5 MB/s
INFO: status: 1% (9678880768/751619276800), sparse 1% (9424416768), duration 37, 284/7 MB/s
INFO: status: 2% (17588551680/751619276800), sparse 2% (17333760000), duration 40, 2636/0 MB/s
INFO: status: 3% (25785663488/751619276800), sparse 3% (25530544128), duration 43, 2732/0 MB/s
INFO: status: 4% (30064967680/751619276800), sparse 3% (28001742848), duration 284, 17/7 MB/s
INFO: status: 5% (37583585280/751619276800), sparse 3% (28207935488), duration 1053, 9/9 MB/s
INFO: status: 6% (45107511296/751619276800), sparse 3% (28338958336), duration 2253, 6/6 MB/s
INFO: status: 7% (52616495104/751619276800), sparse 3% (28441833472), duration 3480, 6/6 MB/s
INFO: status: 8% (60130131968/751619276800), sparse 3% (28553019392), duration 4699, 6/6 MB/s
INFO: status: 9% (67648028672/751619276800), sparse 3% (28627738624), duration 5907, 6/6 MB/s
INFO: status: 10% (75185520640/751619276800), sparse 3% (28733992960), duration 7133, 6/6 MB/s
INFO: status: 11% (82681331712/751619276800), sparse 3% (28811878400), duration 8017, 8/8 MB/s
INFO: status: 12% (90198179840/751619276800), sparse 3% (28898779136), duration 9185, 6/6 MB/s
INFO: status: 13% (97713913856/751619276800), sparse 3% (28986978304), duration 10550, 5/5 MB/s
INFO: status: 14% (105229713408/751619276800), sparse 3% (29061308416), duration 11759, 6/6 MB/s
INFO: status: 15% (112743481344/751619276800), sparse 3% (29146664960), duration 13308, 4/4 MB/s
INFO: status: 16% (120263475200/751619276800), sparse 3% (29218447360), duration 15023, 4/4 MB/s
INFO: status: 17% (127778095104/751619276800), sparse 3% (29306118144), duration 16766, 4/4 MB/s
INFO: status: 18% (135293632512/751619276800), sparse 3% (29378572288), duration 18455, 4/4 MB/s
INFO: status: 19% (142808973312/751619276800), sparse 3% (29473452032), duration 20176, 4/4 MB/s
INFO: status: 20% (150324183040/751619276800), sparse 3% (29515571200), duration 21882, 4/4 MB/s
INFO: status: 21% (157844701184/751619276800), sparse 3% (29543768064), duration 23603, 4/4 MB/s
INFO: status: 22% (165358141440/751619276800), sparse 3% (29629804544), duration 24998, 5/5 MB/s
INFO: status: 23% (172877283328/751619276800), sparse 3% (29724479488), duration 26617, 4/4 MB/s
INFO: status: 24% (180391968768/751619276800), sparse 3% (29797064704), duration 28209, 4/4 MB/s
INFO: status: 25% (187907112960/751619276800), sparse 3% (29890260992), duration 29747, 4/4 MB/s
INFO: status: 26% (195433594880/751619276800), sparse 3% (29975351296), duration 30969, 6/6 MB/s
INFO: status: 27% (202940219392/751619276800), sparse 4% (30102855680), duration 32171, 6/6 MB/s
ERROR: interrupted by signal
INFO: aborting backup job
ERROR: Backup of VM 100 failed - interrupted by signal
ERROR: Backup job failed - interrupted by signal
TASK ERROR: interrupted by signal

I add NFS share and try to backup trough network, but problem remained.
Maybe someone can lead me in the right way?
My setup:
2 nodes.
Proxmox 4.1
Both servers have hardware RAID10 (4x1TB 10k disks)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back