Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
Message from discussion moveChunk taking a very long time?

Received: by 10.224.223.14 with SMTP id ii14mr13228703qab.3.1350555161752;
        Thu, 18 Oct 2012 03:12:41 -0700 (PDT)
X-BeenThere: mongodb-user@googlegroups.com
Received: by 10.224.209.3 with SMTP id ge3ls535612qab.9.gmail; Thu, 18 Oct
 2012 03:12:28 -0700 (PDT)
Received: by 10.224.39.75 with SMTP id f11mr2577637qae.0.1350555148634;
        Thu, 18 Oct 2012 03:12:28 -0700 (PDT)
Received: by 10.224.67.196 with SMTP id s4msqai;
        Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
Received: by 10.52.71.38 with SMTP id r6mr3433090vdu.12.1350548942734;
        Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
Date: Thu, 18 Oct 2012 01:29:02 -0700 (PDT)
From: Aleksey <alexey.sivo...@muranosoft.com>
To: mongodb-user@googlegroups.com
Message-Id: <cc9212e4-ae5c-444a-81d2-a17b60bc80b9@googlegroups.com>
In-Reply-To: <20590cf7-c4a8-41ce-b4c8-50bc851f68e4@googlegroups.com>
References: <20590cf7-c4a8-41ce-b4c8-50bc851f68e4@googlegroups.com>
Subject: Re: moveChunk taking a very long time?
MIME-Version: 1.0
Content-Type: multipart/mixed; 
	boundary="----=_Part_262_2557004.1350548942377"

------=_Part_262_2557004.1350548942377
Content-Type: multipart/alternative; 
	boundary="----=_Part_263_25897489.1350548942378"

------=_Part_263_25897489.1350548942378
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

This moveChunk is finally complete. It took more than 2.5 hours to complete 
moveChunk.to, and 6 hours to complete moveChunk.from. Considering that 
there was absolutely no load on db from application side, the numbers seems 
crazy high. Any ideas would be appreciated.

mongos> c.next()
{
"_id" : "HOST-2012-10-18T01:58:41-4589",
"server" : "HOST_1",
"clientAddr" : "10.100.0.35:54401",
"time" : ISODate("2012-10-18T01:58:41.083Z"),
"what" : "moveChunk.from",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"step1" : 0,
"step2" : 1377,
"step3" : 24082,
"step4" : 9503645,
"step5" : 1419,
  "step6" : 12189798
}
}
mongos> c.next()
{
"_id" : "HOST-2012-10-17T22:35:30-4588",
"server" : "HOST_1",
"clientAddr" : "10.100.0.35:54401",
"time" : ISODate("2012-10-17T22:35:30.269Z"),
"what" : "moveChunk.commit",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"from" : "RS_Crawler_2",
"to" : "RS_Crawler"
}
}
mongos> c.next()
{
"_id" : "HOST_0-2012-10-17T22:35:29-4238",
"server" : "HOST_0",
"clientAddr" : "",
"time" : ISODate("2012-10-17T22:35:29.684Z"),
"what" : "moveChunk.to",
"ns" : "crawlerDb.items",
"details" : {
"min" : {
"itemId" : NumberLong(43206356),
"feedId" : 1420
},
"max" : {
"itemId" : NumberLong(43427248),
"feedId" : 35350
},
"step1" : 561,
"step2" : 170,
"step3" : 9492976,
"step4" : 50,
"step5" : 9898
}
}


------=_Part_263_25897489.1350548942378
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

<div>This moveChunk is finally complete. It took more than 2.5 hours to com=
plete moveChunk.to, and 6 hours to complete moveChunk.from. Considering tha=
t there was absolutely no load on db from application side, the numbers see=
ms crazy high. Any ideas would be appreciated.</div><div><br></div><div>mon=
gos&gt; c.next()<br>{<br>    "_id" : "HOST-2012-10-18T01:58:41-4589",<br>  =
  "server" : "HOST_1",<br>    "clientAddr" : "10.100.0.35:54401",<br>    "t=
ime" : ISODate("2012-10-18T01:58:41.083Z"),<br>    "what" : "moveChunk.from=
",<br>    "ns" : "crawlerDb.items",<br>    "details" : {<br>        "min" :=
 {<br>            "itemId" : NumberLong(43206356),<br>            "feedId" =
: 1420<br>        },<br>        "max" : {<br>            "itemId" : NumberL=
ong(43427248),<br>            "feedId" : 35350<br>        },<br>        "st=
ep1" : 0,<br>        "step2" : 1377,<br>        "step3" : 24082,<br>       =
 "step4" : 9503645,<br>        "step5" : 1419,<br>&nbsp;       "step6" : 12=
189798<br>    }<br>}<br>mongos&gt; c.next()<br>{<br>    "_id" : "HOST-2012-=
10-17T22:35:30-4588",<br>    "server" : "HOST_1",<br>    "clientAddr" : "10=
.100.0.35:54401",<br>    "time" : ISODate("2012-10-17T22:35:30.269Z"),<br> =
   "what" : "moveChunk.commit",<br>    "ns" : "crawlerDb.items",<br>    "de=
tails" : {<br>        "min" : {<br>            "itemId" : NumberLong(432063=
56),<br>            "feedId" : 1420<br>        },<br>        "max" : {<br> =
           "itemId" : NumberLong(43427248),<br>            "feedId" : 35350=
<br>        },<br>        "from" : "RS_Crawler_2",<br>        "to" : "RS_Cr=
awler"<br>    }<br>}<br>mongos&gt; c.next()<br>{<br>    "_id" : "HOST_0-201=
2-10-17T22:35:29-4238",<br>    "server" : "HOST_0",<br>    "clientAddr" : "=
",<br>    "time" : ISODate("2012-10-17T22:35:29.684Z"),<br>    "what" : "mo=
veChunk.to",<br>    "ns" : "crawlerDb.items",<br>    "details" : {<br>     =
   "min" : {<br>            "itemId" : NumberLong(43206356),<br>           =
 "feedId" : 1420<br>        },<br>        "max" : {<br>            "itemId"=
 : NumberLong(43427248),<br>            "feedId" : 35350<br>        },<br> =
       "step1" : 561,<br>        "step2" : 170,<br>        "step3" : 949297=
6,<br>        "step4" : 50,<br>        "step5" : 9898<br>    }<br>}<br><br>=
</div>
------=_Part_263_25897489.1350548942378--

------=_Part_262_2557004.1350548942377--