80k writes/s via php cli - NoSQL Databases

The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Message from discussion 80k writes/s via php cli
Received-SPF: pass (google.com: domain of the.mindstorm.mailinglist+caf_=nosql-databases=googlegroups....@gmail.com designates 209.85.215.177 as permitted sender) client-ip=209.85.215.177;
Received-SPF: pass (google.com: domain of mongodb-user+bncCLnj76pfEKPtjPsEGgSQkSK7@googlegroups.com designates 10.68.233.33 as permitted sender) client-ip=10.68.233.33;
Received-SPF: pass (google.com: domain of tim.hawk...@mac.com designates 17.172.204.236 as permitted sender) client-ip=17.172.204.236;
MIME-version: 1.0
References: <12802862.551.1331874935151.JavaMail.geo-discussion-forums@ynbq18>
 <AA13299C-3CB6-46BA-80B6-4EEE569F1...@gmail.com>
 <1159704.28.1331901684645.JavaMail.geo-discussion-forums@yncd14>
In-reply-to: <1159704.28.1331901684645.JavaMail.geo-discussion-forums@yncd14>
Message-id: <D3E7F90C-AAE9-43C5-80EF-6377AC389...@mac.com>
Cc: "mongodb-user@googlegroups.com" <mongodb-user@googlegroups.com>
From: Timothy Hawkins <tim.hawk...@mac.com>
Subject: Re: [mongodb-user] 80k writes/s via php cli
Date: Fri, 16 Mar 2012 20:48:29 +0800
To: "mongodb-user@googlegroups.com" <mongodb-user@googlegroups.com>
Reply-To: mongodb-user@googlegroups.com
Precedence: list
Mailing-list: list mongodb-user@googlegroups.com; contact mongodb-user+owners@googlegroups.com
Sender: mongodb-user@googlegroups.com
Content-type: multipart/alternative;
 boundary="Boundary_(ID_Lpw5xtWhzqdst4AomFmDzw)"

--Boundary_(ID_Lpw5xtWhzqdst4AomFmDzw)
Content-type: text/plain; charset=ISO-8859-1
Content-transfer-encoding: quoted-printable

Also, have you checked out

http://php.net/manual/en/mongocollection.batchinsert.php

Sent from my iPad

On 16 Mar 2012, at 20:41, MKN Web Solutions <mich...@mknwebsolutions.com> w=
rote:

> That's what I figured.  Yea, I was running multiple php cli's with the sa=
me script.=20
>=20
> On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote:
> I'm not a mongo guru, but given your lock level around 80%, you still hav=
e room, enough to reach 100kins/s.
>=20
> Did you try paralellizing php cli scripts ?
>=20
>=20
>=20
> Le 16 mars 2012 =E0 06:15, MKN Web Solutions <mich...@mknwebsolutions.com=
> a =E9crit :
>=20
>> I'm able to achieve 80k writes per second via CLI php.  The script is ba=
sic, it simply injects a 10 char string into "x" (in this case it isn't ind=
exed, nor does it need to be since this is a write test only).
>>=20
>> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 72=
00 rpm hd, running ubuntu.
>>=20
>> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli.  =
Mongo running as a single instance, master set on, no repl set nor slaves.
>>=20
>> My question is, what's the next bottleneck.  The HD utilization was also=
 bouncing around 10-35%.  I want to get the max writes possible that the ma=
chine can produce. =20
>>=20
>>=20
>> Thanks for any tips / help.
>>=20
>>=20
>>=20
>>=20
>> --=20
>> You received this message because you are subscribed to the Google Group=
s "mongodb-user" group.
>> To view this discussion on the web visit https://groups.google.com/d/msg=
/mongodb-user/-/QTuYHv-zm3IJ.
>> To post to this group, send email to mongodb-user@googlegroups.com.
>> To unsubscribe from this group, send email to mongodb-user+unsubscribe@g=
ooglegroups.com.
>> For more options, visit this group at http://groups.google.com/group/mon=
godb-user?hl=3Den.
>=20
> --=20
> You received this message because you are subscribed to the Google Groups=
 "mongodb-user" group.
> To view this discussion on the web visit https://groups.google.com/d/msg/=
mongodb-user/-/CHOl72aoJtQJ.
> To post to this group, send email to mongodb-user@googlegroups.com.
> To unsubscribe from this group, send email to mongodb-user+unsubscribe@go=
oglegroups.com.
> For more options, visit this group at http://groups.google.com/group/mong=
odb-user?hl=3Den.

--=20
You received this message because you are subscribed to the Google Groups "=
mongodb-user" group.
To post to this group, send email to mongodb-user@googlegroups.com.
To unsubscribe from this group, send email to mongodb-user+unsubscribe@goog=
legroups.com.
For more options, visit this group at http://groups.google.com/group/mongod=
b-user?hl=3Den.


--Boundary_(ID_Lpw5xtWhzqdst4AomFmDzw)
Content-type: text/html; charset=ISO-8859-1
Content-transfer-encoding: quoted-printable

<html><head></head><body bgcolor=3D"#FFFFFF"><div>Also, have you checked ou=
t</div><div><br></div><div><a href=3D"http://php.net/manual/en/mongocollect=
ion.batchinsert.php">http://php.net/manual/en/mongocollection.batchinsert.p=
hp</a><br><br>Sent from my iPad</div><div><br>On 16 Mar 2012, at 20:41, MKN=
 Web Solutions &lt;<a href=3D"mailto:mich...@mknwebsolutions.com">michael@m=
knwebsolutions.com</a>&gt; wrote:<br><br></div><div></div><blockquote type=
=3D"cite"><div>That's what I figured. &nbsp;Yea, I was running multiple php=
 cli's with the same script.&nbsp;<br><br>On Friday, March 16, 2012 6:50:42=
 AM UTC-4, SCO wrote:<blockquote class=3D"gmail_quote" style=3D"margin: 0;m=
argin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;"><div bgco=
lor=3D"#FFFFFF"><div>I'm not a mongo guru, but given your lock level around=
 80%, you still have room, enough to reach 100kins/s.</div><div><br></div><=
div>Did you try paralellizing php cli scripts ?</div><div><br><br></div><di=
v><br>Le 16 mars 2012 =E0 06:15, MKN Web Solutions &lt;<a href=3D"mailto:mi=
ch...@mknwebsolutions.com" target=3D"_blank">mich...@mknwebsolutions.com</a=
>&gt; a =E9crit&nbsp;:<br><br></div><div></div><blockquote type=3D"cite"><d=
iv>I'm able to achieve 80k writes per second via CLI php. &nbsp;The script =
is basic, it simply injects a 10 char string into "x" (in this case it isn'=
t indexed, nor does it need to be since this is a write test only).<div><br=
></div><div>The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram,=
 250GB 7200 rpm hd, running ubuntu.</div><div><br></div><div>CPU usage spik=
ed around 50-70% usage by MongoDB and 20-30% by php cli. &nbsp;Mongo runnin=
g as a single instance, master set on, no repl set nor slaves.</div><div><b=
r></div><div>My question is, what's the next bottleneck. &nbsp;The HD utili=
zation was also bouncing around 10-35%. &nbsp;I want to get the max writes =
possible that the machine can produce. &nbsp;</div><div><br></div><div><br>=
</div><div>Thanks for any tips / help.</div><div><br></div><p style=3D"text=
-align:center;clear:both"><a href=3D"https://lh3.googleusercontent.com/-JKp=
03qVaVS4/T2LLsmoGwoI/AAAAAAAAAAM/9cgwA3Dsxy4/s1600/Screen+Shot+2012-03-15+a=
t+11.17.03+PM.png" style=3D"margin-left:1em;margin-right:1em" target=3D"_bl=
ank"><img border=3D"0" origsrc=3D"https://lh3.googleusercontent.com/-JKp03q=
VaVS4/T2LLsmoGwoI/AAAAAAAAAAM/9cgwA3Dsxy4/s1600/Screen+Shot+2012-03-15+at+1=
1.17.03+PM.png" src=3D"cid:"></a></p><div><br></div>

<p></p>

-- <br>
You received this message because you are subscribed to the Google Groups "=
mongodb-user" group.<br>
To view this discussion on the web visit <a href=3D"https://groups.google.c=
om/d/msg/mongodb-user/-/QTuYHv-zm3IJ" target=3D"_blank"></a><a href=3D"http=
s://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ" target=3D"_blank">=
https://groups.google.com/d/<wbr>msg/mongodb-user/-/QTuYHv-<wbr>zm3IJ</a>.<=
br>=20
To post to this group, send email to <a href=3D"mailto:mongodb-user@googleg=
roups.com" target=3D"_blank">mongodb-user@googlegroups.com</a>.<br>
To unsubscribe from this group, send email to <a href=3D"mailto:mongodb-use=
r+unsubscribe@googlegroups.com" target=3D"_blank">mongodb-user+unsubscribe@=
<wbr>googlegroups.com</a>.<br>

For more options, visit this group at <a href=3D"http://groups.google.com/g=
roup/mongodb-user?hl=3Den" target=3D"_blank">http://groups.google.com/<wbr>=
group/mongodb-user?hl=3Den</a>.<br>


</div></blockquote></div></blockquote>

<p></p>

-- <br>
You received this message because you are subscribed to the Google Groups "=
mongodb-user" group.<br>
To view this discussion on the web visit <a href=3D"https://groups.google.c=
om/d/msg/mongodb-user/-/CHOl72aoJtQJ">https://groups.google.com/d/msg/mongo=
db-user/-/CHOl72aoJtQJ</a>.<br>=20
To post to this group, send email to <a href=3D"mailto:mongodb-user@googleg=
roups.com">mongodb-user@googlegroups.com</a>.<br>
To unsubscribe from this group, send email to <a href=3D"mailto:mongodb-use=
r+unsubscribe@googlegroups.com">mongodb-user+unsubscribe@googlegroups.com</=
a>.<br>

For more options, visit this group at <a href=3D"http://groups.google.com/g=
roup/mongodb-user?hl=3Den">http://groups.google.com/group/mongodb-user?hl=
=3Den</a>.<br>


</div></blockquote></body></html>

<p></p>

-- <br />
You received this message because you are subscribed to the Google Groups "=
mongodb-user" group.<br />
To post to this group, send email to mongodb-user@googlegroups.com.<br />
To unsubscribe from this group, send email to mongodb-user+unsubscribe@goog=
legroups.com.<br />

For more options, visit this group at http://groups.google.com/group/mongod=
b-user?hl=3Den.<br />



--Boundary_(ID_Lpw5xtWhzqdst4AomFmDzw)--
Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
Account Options
