vzdump completion time

M

mygeeknc

Renowned Member
Jan 31, 2013
57
5
73
I have two servers both Lenovo TS130s with 12GB of RAM and Xeon processors. One has an Adaptec RAID controller with mirrored 500GB and the other just has a single hard drive for the OS and VMs. Both machines have a backup hard drive dedicated to backups only.

Server A, with the RAID controller takes around 1 hour to do a vzdump backup. It is also running PVE 3.1.
Server B, without a controller the vzdump takes around 10 hours. Running PVE 2.3.

Besides the RAID controller, the only other difference in the configs are the hard drive on Server B does not have the hard drive cache enabled. They're both backing up a similar amount of data as well.

Why would server B take so long to do it's backups? Also, does the hard drive cache even come into play here? Is there a benefit of using it without a raid controller?

Thanks.
 
Just as an update, here is the latest log. You'll notice a 14 hour difference between 0%-15%

Any ideas?

---

100: Nov 18 21:15:01 INFO: Starting Backup of VM 100 (qemu)
100: Nov 18 21:15:01 INFO: status = running
100: Nov 18 21:15:02 INFO: backup mode: snapshot
100: Nov 18 21:15:02 INFO: ionice priority: 7
100: Nov 18 21:15:02 INFO: creating archive '/backups/dump/vzdump-qemu-100-2013_11_18-21_15_01.vma.lzo'
100: Nov 18 21:15:02 INFO: started backup task 'c5919c40-2044-4f9f-91f8-f02489c5d6e0'
100: Nov 18 21:15:05 INFO: status: 0% (6291456/2000398934016), sparse 0% (1093632), duration 3, 2/1 MB/s
100: Nov 18 21:40:14 INFO: status: 1% (20031799296/2000398934016), sparse 0% (337768448), duration 1512, 13/13 MB/s
100: Nov 18 21:53:11 INFO: status: 2% (40028078080/2000398934016), sparse 0% (4269215744), duration 2289, 25/20 MB/s
100: Nov 18 22:06:54 INFO: status: 3% (60019376128/2000398934016), sparse 0% (5922889728), duration 3112, 24/22 MB/s
100: Nov 18 22:23:39 INFO: status: 4% (80061988864/2000398934016), sparse 0% (6336782336), duration 4117, 19/19 MB/s
100: Nov 18 22:41:07 INFO: status: 5% (100071243776/2000398934016), sparse 0% (7061852160), duration 5165, 19/18 MB/s
100: Nov 18 23:40:57 INFO: status: 6% (120458903552/2000398934016), sparse 0% (11544928256), duration 8755, 5/4 MB/s
100: Nov 19 01:07:41 INFO: status: 7% (140030181376/2000398934016), sparse 0% (11589836800), duration 13959, 3/3 MB/s
100: Nov 19 02:44:44 INFO: status: 8% (160035700736/2000398934016), sparse 0% (11630174208), duration 19782, 3/3 MB/s
100: Nov 19 04:18:08 INFO: status: 9% (180042334208/2000398934016), sparse 0% (11682398208), duration 25386, 3/3 MB/s
100: Nov 19 05:44:43 INFO: status: 10% (200043331584/2000398934016), sparse 0% (11912101888), duration 30581, 3/3 MB/s
100: Nov 19 07:13:21 INFO: status: 11% (220123693056/2000398934016), sparse 0% (11963392000), duration 35899, 3/3 MB/s
100: Nov 19 08:12:04 INFO: status: 12% (240056598528/2000398934016), sparse 0% (12352598016), duration 39422, 5/5 MB/s
100: Nov 19 09:11:12 INFO: status: 13% (260087742464/2000398934016), sparse 0% (12708671488), duration 42970, 5/5 MB/s
100: Nov 19 10:17:06 INFO: status: 14% (280059772928/2000398934016), sparse 0% (12911628288), duration 46924, 5/4 MB/s
100: Nov 19 11:34:40 INFO: status: 15% (300771639296/2000398934016), sparse 0% (17375584256), duration 51578, 4/3 MB/s
100: Nov 19 11:34:45 INFO: status: 16% (320101679104/2000398934016), sparse 1% (36705624064), duration 51583, 3866/0 MB/s
100: Nov 19 11:34:50 INFO: status: 17% (341228388352/2000398934016), sparse 2% (57832333312), duration 51588, 4225/0 MB/s
100: Nov 19 11:34:55 INFO: status: 18% (364657311744/2000398934016), sparse 4% (81261256704), duration 51593, 4685/0 MB/s
100: Nov 19 11:34:59 INFO: status: 19% (383408865280/2000398934016), sparse 4% (100012810240), duration 51597, 4687/0 MB/s
100: Nov 19 11:35:03 INFO: status: 20% (402163171328/2000398934016), sparse 5% (118767116288), duration 51601, 4688/0 MB/s
100: Nov 19 11:35:07 INFO: status: 21% (420917805056/2000398934016), sparse 6% (137521750016), duration 51605, 4688/0 MB/s
100: Nov 19 11:35:12 INFO: status: 22% (444193570816/2000398934016), sparse 8% (160797515776), duration 51610, 4655/0 MB/s
100: Nov 19 11:35:16 INFO: status: 23% (463022129152/2000398934016), sparse 8% (179626074112), duration 51614, 4707/0 MB/s
100: Nov 19 11:35:20 INFO: status: 24% (481800224768/2000398934016), sparse 9% (198404169728), duration 51618, 4694/0 MB/s
100: Nov 19 11:35:24 INFO: status: 25% (500351500288/2000398934016), sparse 10% (216955445248), duration 51622, 4637/0 MB/s
100: Nov 19 11:35:29 INFO: status: 26% (523812339712/2000398934016), sparse 12% (240416284672), duration 51627, 4692/0 MB/s
100: Nov 19 11:35:51 INFO: status: 27% (542236868608/2000398934016), sparse 12% (258741338112), duration 51649, 837/4 MB/s
100: Nov 19 11:35:55 INFO: status: 28% (560965812224/2000398934016), sparse 13% (277470281728), duration 51653, 4682/0 MB/s
100: Nov 19 11:36:00 INFO: status: 29% (583548207104/2000398934016), sparse 14% (300052676608), duration 51658, 4516/0 MB/s
100: Nov 19 11:36:04 INFO: status: 30% (602292486144/2000398934016), sparse 15% (318796955648), duration 51662, 4686/0 MB/s
100: Nov 19 11:36:08 INFO: status: 31% (621029490688/2000398934016), sparse 16% (337533960192), duration 51666, 4684/0 MB/s
100: Nov 19 11:36:13 INFO: status: 32% (644464246784/2000398934016), sparse 18% (360968716288), duration 51671, 4686/0 MB/s
100: Nov 19 11:36:17 INFO: status: 33% (662354919424/2000398934016), sparse 18% (378859388928), duration 51675, 4472/0 MB/s
100: Nov 19 11:36:21 INFO: status: 34% (681105031168/2000398934016), sparse 19% (397609500672), duration 51679, 4687/0 MB/s
100: Nov 19 11:36:26 INFO: status: 35% (704649625600/2000398934016), sparse 21% (421154095104), duration 51684, 4708/0 MB/s
100: Nov 19 11:36:30 INFO: status: 36% (720936632320/2000398934016), sparse 21% (437441101824), duration 51688, 4071/0 MB/s
100: Nov 19 11:36:36 INFO: status: 37% (744358346752/2000398934016), sparse 23% (460862816256), duration 51694, 3903/0 MB/s
100: Nov 19 11:36:40 INFO: status: 38% (763104264192/2000398934016), sparse 23% (479608733696), duration 51698, 4686/0 MB/s
100: Nov 19 11:36:44 INFO: status: 39% (781845987328/2000398934016), sparse 24% (498350456832), duration 51702, 4685/0 MB/s
100: Nov 19 11:36:48 INFO: status: 40% (800595509248/2000398934016), sparse 25% (517099978752), duration 51706, 4687/0 MB/s
100: Nov 19 11:36:53 INFO: status: 41% (824017682432/2000398934016), sparse 27% (540522151936), duration 51711, 4684/0 MB/s
100: Nov 19 11:36:57 INFO: status: 42% (841332883456/2000398934016), sparse 27% (557837352960), duration 51715, 4328/0 MB/s
100: Nov 19 11:37:02 INFO: status: 43% (864726024192/2000398934016), sparse 29% (581230493696), duration 51720, 4678/0 MB/s
100: Nov 19 11:37:06 INFO: status: 44% (883412566016/2000398934016), sparse 29% (599917035520), duration 51724, 4671/0 MB/s
100: Nov 19 11:37:10 INFO: status: 45% (900612358144/2000398934016), sparse 30% (617116827648), duration 51728, 4299/0 MB/s
100: Nov 19 11:37:15 INFO: status: 46% (923960606720/2000398934016), sparse 32% (640465076224), duration 51733, 4669/0 MB/s
100: Nov 19 11:37:19 INFO: status: 47% (942541701120/2000398934016), sparse 32% (659046170624), duration 51737, 4645/0 MB/s
100: Nov 19 11:37:24 INFO: status: 48% (964143611904/2000398934016), sparse 34% (680648081408), duration 51742, 4320/0 MB/s
100: Nov 19 11:37:29 INFO: status: 49% (983177297920/2000398934016), sparse 34% (699681767424), duration 51747, 3806/0 MB/s
100: Nov 19 11:37:33 INFO: status: 50% (1000880930816/2000398934016), sparse 35% (717385400320), duration 51751, 4425/0 MB/s
100: Nov 19 11:37:38 INFO: status: 51% (1023007653888/2000398934016), sparse 36% (739512123392), duration 51756, 4425/0 MB/s
100: Nov 19 11:37:42 INFO: status: 52% (1041281843200/2000398934016), sparse 37% (757786312704), duration 51760, 4568/0 MB/s
100: Nov 19 11:38:39 INFO: status: 53% (1062244843520/2000398934016), sparse 38% (777932218368), duration 51817, 367/14 MB/s
100: Nov 19 11:38:44 INFO: status: 54% (1081377226752/2000398934016), sparse 39% (797064601600), duration 51822, 3826/0 MB/s
100: Nov 19 11:38:49 INFO: status: 55% (1100774178816/2000398934016), sparse 40% (816461553664), duration 51827, 3879/0 MB/s
100: Nov 19 11:38:54 INFO: status: 56% (1122730967040/2000398934016), sparse 41% (838418341888), duration 51832, 4391/0 MB/s
100: Nov 19 11:38:58 INFO: status: 57% (1141574991872/2000398934016), sparse 42% (857262366720), duration 51836, 4711/0 MB/s
100: Nov 19 11:39:02 INFO: status: 58% (1160406564864/2000398934016), sparse 43% (876093939712), duration 51840, 4707/0 MB/s
100: Nov 19 11:39:07 INFO: status: 59% (1183974948864/2000398934016), sparse 44% (899662323712), duration 51845, 4713/0 MB/s
100: Nov 19 11:39:13 INFO: status: 60% (1202155225088/2000398934016), sparse 45% (917842599936), duration 51851, 3030/0 MB/s
100: Nov 19 11:39:20 INFO: status: 61% (1220249780224/2000398934016), sparse 46% (935937155072), duration 51858, 2584/0 MB/s
100: Nov 19 11:39:25 INFO: status: 62% (1240466980864/2000398934016), sparse 47% (956154355712), duration 51863, 4043/0 MB/s
100: Nov 19 11:39:30 INFO: status: 63% (1264000499712/2000398934016), sparse 48% (979687874560), duration 51868, 4706/0 MB/s
100: Nov 19 11:39:34 INFO: status: 64% (1282493120512/2000398934016), sparse 49% (998180495360), duration 51872, 4623/0 MB/s
100: Nov 19 11:39:38 INFO: status: 65% (1301334654976/2000398934016), sparse 50% (1017022029824), duration 51876, 4710/0 MB/s
100: Nov 19 11:39:43 INFO: status: 66% (1324872040448/2000398934016), sparse 52% (1040559415296), duration 51881, 4707/0 MB/s
100: Nov 19 11:39:47 INFO: status: 67% (1343683035136/2000398934016), sparse 52% (1059370409984), duration 51885, 4702/0 MB/s
100: Nov 19 11:39:51 INFO: status: 68% (1362534793216/2000398934016), sparse 53% (1078222168064), duration 51889, 4712/0 MB/s
100: Nov 19 11:39:55 INFO: status: 69% (1381382553600/2000398934016), sparse 54% (1097069928448), duration 51893, 4711/0 MB/s
100: Nov 19 11:40:00 INFO: status: 70% (1404951461888/2000398934016), sparse 56% (1120638836736), duration 51898, 4713/0 MB/s
100: Nov 19 11:40:04 INFO: status: 71% (1423777792000/2000398934016), sparse 56% (1139465166848), duration 51902, 4706/0 MB/s
100: Nov 19 11:40:09 INFO: status: 72% (1443248144384/2000398934016), sparse 57% (1158935519232), duration 51907, 3894/0 MB/s
100: Nov 19 11:40:13 INFO: status: 73% (1462094921728/2000398934016), sparse 58% (1177782296576), duration 51911, 4711/0 MB/s
100: Nov 19 11:40:17 INFO: status: 74% (1480919220224/2000398934016), sparse 59% (1196606595072), duration 51915, 4706/0 MB/s
100: Nov 19 11:40:22 INFO: status: 75% (1504455491584/2000398934016), sparse 60% (1220142866432), duration 51920, 4707/0 MB/s
100: Nov 19 11:40:26 INFO: status: 76% (1522991169536/2000398934016), sparse 61% (1238678544384), duration 51924, 4633/0 MB/s
100: Nov 19 11:40:30 INFO: status: 77% (1541852430336/2000398934016), sparse 62% (1257539805184), duration 51928, 4715/0 MB/s
100: Nov 19 11:40:35 INFO: status: 78% (1562435649536/2000398934016), sparse 63% (1278123024384), duration 51933, 4116/0 MB/s
100: Nov 19 11:41:15 INFO: status: 79% (1581219184640/2000398934016), sparse 64% (1296787951616), duration 51973, 469/2 MB/s
100: Nov 19 11:41:29 INFO: status: 80% (1602593488896/2000398934016), sparse 65% (1318162255872), duration 51987, 1526/0 MB/s
100: Nov 19 11:41:34 INFO: status: 81% (1622247735296/2000398934016), sparse 66% (1337816502272), duration 51992, 3930/0 MB/s
100: Nov 19 11:41:41 INFO: status: 82% (1641027207168/2000398934016), sparse 67% (1356595974144), duration 51999, 2682/0 MB/s
100: Nov 19 11:41:46 INFO: status: 83% (1662099456000/2000398934016), sparse 68% (1377668222976), duration 52004, 4214/0 MB/s
100: Nov 19 11:41:50 INFO: status: 84% (1680938696704/2000398934016), sparse 69% (1396507463680), duration 52008, 4709/0 MB/s
100: Nov 19 11:41:55 INFO: status: 85% (1704496529408/2000398934016), sparse 70% (1420065296384), duration 52013, 4711/0 MB/s
100: Nov 19 11:41:59 INFO: status: 86% (1723338850304/2000398934016), sparse 71% (1438907617280), duration 52017, 4710/0 MB/s
100: Nov 19 11:42:03 INFO: status: 87% (1742174289920/2000398934016), sparse 72% (1457743056896), duration 52021, 4708/0 MB/s
100: Nov 19 11:42:07 INFO: status: 88% (1760998391808/2000398934016), sparse 73% (1476567158784), duration 52025, 4706/0 MB/s
100: Nov 19 11:42:19 INFO: status: 89% (1783648092160/2000398934016), sparse 74% (1499216859136), duration 52037, 1887/0 MB/s
100: Nov 19 11:42:24 INFO: status: 90% (1800780644352/2000398934016), sparse 75% (1516349411328), duration 52042, 3426/0 MB/s
100: Nov 19 11:42:35 INFO: status: 91% (1821101326336/2000398934016), sparse 76% (1536670093312), duration 52053, 1847/0 MB/s
100: Nov 19 11:42:40 INFO: status: 92% (1841725571072/2000398934016), sparse 77% (1557294338048), duration 52058, 4124/0 MB/s
100: Nov 19 11:42:44 INFO: status: 93% (1860485054464/2000398934016), sparse 78% (1576053821440), duration 52062, 4689/0 MB/s
100: Nov 19 11:42:50 INFO: status: 94% (1880390762496/2000398934016), sparse 79% (1595959529472), duration 52068, 3317/0 MB/s
100: Nov 19 11:42:55 INFO: status: 95% (1903159017472/2000398934016), sparse 80% (1618727784448), duration 52073, 4553/0 MB/s
100: Nov 19 11:42:59 INFO: status: 96% (1921978662912/2000398934016), sparse 81% (1637547429888), duration 52077, 4704/0 MB/s
100: Nov 19 11:43:03 INFO: status: 97% (1940514078720/2000398934016), sparse 82% (1656082845696), duration 52081, 4633/0 MB/s
100: Nov 19 11:43:08 INFO: status: 98% (1963749933056/2000398934016), sparse 83% (1679318700032), duration 52086, 4647/0 MB/s
100: Nov 19 11:43:12 INFO: status: 99% (1982604247040/2000398934016), sparse 84% (1698173014016), duration 52090, 4713/0 MB/s
100: Nov 19 11:43:16 INFO: status: 100% (2000398934016/2000398934016), sparse 85% (1715967741952), duration 52094, 4448/0 MB/s
100: Nov 19 11:43:16 INFO: transferred 2000398 MB in 52094 seconds (38 MB/s)
100: Nov 19 11:43:16 INFO: archive file size: 219.74GB
100: Nov 19 11:43:16 INFO: delete old backup '/backups/dump/vzdump-qemu-100-2013_11_08-21_15_01.vma.lzo'
100: Nov 19 11:43:38 INFO: Finished Backup of VM 100 (14:28:37)
 
May I ask why you disable HDD cache? OTOH, I'm observing critically high Windows VM backup times when the OSes are applying the weekly MS patches (wed or thu night, can't recall ATM). Then for other days they're just fine.
 
I don't actually have the physical cache turned off. This particular setup doesn't have a RAID controller so it's running off just a single hard drive, crazy I know, working on it. Anyways, the cache I was talking about is the VM HDD cache which is right now, set to no cache. Playing with it last night, I found that using write back cache on the VHDD created worse performance
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back