Message from discussion
moveChunk taking a very long time?
Received: by 10.224.223.14 with SMTP id ii14mr13228703qab.3.1350555161752;
Thu, 18 Oct 2012 03:12:41 -0700 (PDT)
X-BeenThere: mongodb-user@googlegroups.com
Received: by 10.224.209.3 with SMTP id ge3ls535612qab.9.gmail; Thu, 18 Oct
2012 03:12:28 -0700 (PDT)
Received: by 10.224.39.75 with SMTP id f11mr2577637qae.0.1350555148634;
Thu, 18 Oct 2012 03:12:28 -0700 (PDT)
Received: by 10.224.67.196 with SMTP id s4msqai;
Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
Received: by 10.52.71.38 with SMTP id r6mr3433090vdu.12.1350548942734;
Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
Date: Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
From: Aleksey <alexey.sivo...@muranosoft.com>
To: mongodb-user@googlegroups.com
Message-Id: <cc9212e4-ae5c-444a-81d2-a17b60bc80b9@googlegroups.com>
In-Reply-To: <20590cf7-c4a8-41ce-b4c8-50bc851f68e4@googlegroups.com>
References: <20590cf7-c4a8-41ce-b4c8-50bc851f68e4@googlegroups.com>
Subject: Re: moveChunk taking a very long time?
MIME-Version: 1.0
Content-Type: multipart/mixed;
boundary="----=_Part_262_2557004.1350548942377"
------=_Part_262_2557004.1350548942377
Content-Type: multipart/alternative;
boundary="----=_Part_263_25897489.1350548942378"
------=_Part_263_25897489.1350548942378
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
This moveChunk is finally complete. It took more than 2.5 hours to complete
moveChunk.to, and 6 hours to complete moveChunk.from. Considering that
there was absolutely no load on db from application side, the numbers seems
crazy high. Any ideas would be appreciated.
mongos> c.next()
{
"_id" : "HOST-2012-10-18T01:58:41-4589",
"server" : "HOST_1",
"clientAddr" : "10.100.0.35:54401",
"time" : ISODate("2012-10-18T01:58:41.083Z"),
"what" : "moveChunk.from",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"step1" : 0,
"step2" : 1377,
"step3" : 24082,
"step4" : 9503645,
"step5" : 1419,
"step6" : 12189798
}
}
mongos> c.next()
{
"_id" : "HOST-2012-10-17T22:35:30-4588",
"server" : "HOST_1",
"clientAddr" : "10.100.0.35:54401",
"time" : ISODate("2012-10-17T22:35:30.269Z"),
"what" : "moveChunk.commit",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"from" : "RS_Crawler_2",
"to" : "RS_Crawler"
}
}
mongos> c.next()
{
"_id" : "HOST_0-2012-10-17T22:35:29-4238",
"server" : "HOST_0",
"clientAddr" : "",
"time" : ISODate("2012-10-17T22:35:29.684Z"),
"what" : "moveChunk.to",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"step1" : 561,
"step2" : 170,
"step3" : 9492976,
"step4" : 50,
"step5" : 9898
}
}
------=_Part_263_25897489.1350548942378
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable
<div>This moveChunk is finally complete. It took more than 2.5 hours to com=
plete moveChunk.to, and 6 hours to complete moveChunk.from. Considering tha=
t there was absolutely no load on db from application side, the numbers see=
ms crazy high. Any ideas would be appreciated.</div><div><br></div><div>mon=
gos> c.next()<br>{<br> "_id" : "HOST-2012-10-18T01:58:41-4589",<br> =
"server" : "HOST_1",<br> "clientAddr" : "10.100.0.35:54401",<br> "t=
ime" : ISODate("2012-10-18T01:58:41.083Z"),<br> "what" : "moveChunk.from=
",<br> "ns" : "crawlerDb.items",<br> "details" : {<br> "min" :=
{<br> "itemId" : NumberLong(43206356),<br> "feedId" =
: 1420<br> },<br> "max" : {<br> "itemId" : NumberL=
ong(43427248),<br> "feedId" : 35350<br> },<br> "st=
ep1" : 0,<br> "step2" : 1377,<br> "step3" : 24082,<br> =
"step4" : 9503645,<br> "step5" : 1419,<br> "step6" : 12=
189798<br> }<br>}<br>mongos> c.next()<br>{<br> "_id" : "HOST-2012-=
10-17T22:35:30-4588",<br> "server" : "HOST_1",<br> "clientAddr" : "10=
.100.0.35:54401",<br> "time" : ISODate("2012-10-17T22:35:30.269Z"),<br> =
"what" : "moveChunk.commit",<br> "ns" : "crawlerDb.items",<br> "de=
tails" : {<br> "min" : {<br> "itemId" : NumberLong(432063=
56),<br> "feedId" : 1420<br> },<br> "max" : {<br> =
"itemId" : NumberLong(43427248),<br> "feedId" : 35350=
<br> },<br> "from" : "RS_Crawler_2",<br> "to" : "RS_Cr=
awler"<br> }<br>}<br>mongos> c.next()<br>{<br> "_id" : "HOST_0-201=
2-10-17T22:35:29-4238",<br> "server" : "HOST_0",<br> "clientAddr" : "=
",<br> "time" : ISODate("2012-10-17T22:35:29.684Z"),<br> "what" : "mo=
veChunk.to",<br> "ns" : "crawlerDb.items",<br> "details" : {<br> =
"min" : {<br> "itemId" : NumberLong(43206356),<br> =
"feedId" : 1420<br> },<br> "max" : {<br> "itemId"=
: NumberLong(43427248),<br> "feedId" : 35350<br> },<br> =
"step1" : 561,<br> "step2" : 170,<br> "step3" : 949297=
6,<br> "step4" : 50,<br> "step5" : 9898<br> }<br>}<br><br>=
</div>
------=_Part_263_25897489.1350548942378--
------=_Part_262_2557004.1350548942377--