I'm able to achieve 80k writes per second via CLI php. The script is basic, it simply injects a 10 char string into "x" (in this case it isn't indexed, nor does it need to be since this is a write test only).
The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 rpm hd, running ubuntu.
CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. Mongo running as a single instance, master set on, no repl set nor slaves.
My question is, what's the next bottleneck. The HD utilization was also bouncing around 10-35%. I want to get the max writes possible that the machine can produce.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
I'd check the lock % in mongodb. If you are bottlenecking there you could run multiple mongod's sharded. Others may have more suggestions. On Mar 16, 2012 6:15 AM, "MKN Web Solutions" <mich...@mknwebsolutions.com> wrote:
> I'm able to achieve 80k writes per second via CLI php. The script is > basic, it simply injects a 10 char string into "x" (in this case it isn't > indexed, nor does it need to be since this is a write test only).
> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 > rpm hd, running ubuntu.
> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. > Mongo running as a single instance, master set on, no repl set nor slaves.
> My question is, what's the next bottleneck. The HD utilization was also > bouncing around 10-35%. I want to get the max writes possible that the > machine can produce.
> -- > You received this message because you are subscribed to the Google Groups > "mongodb-user" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ. > To post to this group, send email to mongodb-user@googlegroups.com. > To unsubscribe from this group, send email to > mongodb-user+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
> I'm able to achieve 80k writes per second via CLI php. The script is basic, it simply injects a 10 char string into "x" (in this case it isn't indexed, nor does it need to be since this is a write test only).
> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 rpm hd, running ubuntu.
> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. Mongo running as a single instance, master set on, no repl set nor slaves.
> My question is, what's the next bottleneck. The HD utilization was also bouncing around 10-35%. I want to get the max writes possible that the machine can produce.
> Thanks for any tips / help.
> -- > You received this message because you are subscribed to the Google Groups "mongodb-user" group. > To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ. > To post to this group, send email to mongodb-user@googlegroups.com. > To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote:
> I'm not a mongo guru, but given your lock level around 80%, you still have > room, enough to reach 100kins/s.
> Did you try paralellizing php cli scripts ?
> Le 16 mars 2012 à 06:15, MKN Web Solutions <mich...@mknwebsolutions.com> > a écrit :
> I'm able to achieve 80k writes per second via CLI php. The script is > basic, it simply injects a 10 char string into "x" (in this case it isn't > indexed, nor does it need to be since this is a write test only).
> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 > rpm hd, running ubuntu.
> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. > Mongo running as a single instance, master set on, no repl set nor slaves.
> My question is, what's the next bottleneck. The HD utilization was also > bouncing around 10-35%. I want to get the max writes possible that the > machine can produce.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/CHOl72aoJtQJ. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
> That's what I figured. Yea, I was running multiple php cli's with the same script.
> On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote: > I'm not a mongo guru, but given your lock level around 80%, you still have room, enough to reach 100kins/s.
> Did you try paralellizing php cli scripts ?
> Le 16 mars 2012 à 06:15, MKN Web Solutions <mich...@mknwebsolutions.com> a écrit :
>> I'm able to achieve 80k writes per second via CLI php. The script is basic, it simply injects a 10 char string into "x" (in this case it isn't indexed, nor does it need to be since this is a write test only).
>> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 rpm hd, running ubuntu.
>> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. Mongo running as a single instance, master set on, no repl set nor slaves.
>> My question is, what's the next bottleneck. The HD utilization was also bouncing around 10-35%. I want to get the max writes possible that the machine can produce.
>> Thanks for any tips / help.
>> -- >> You received this message because you are subscribed to the Google Groups "mongodb-user" group. >> To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ. >> To post to this group, send email to mongodb-user@googlegroups.com. >> To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. >> For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
> -- > You received this message because you are subscribed to the Google Groups "mongodb-user" group. > To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/CHOl72aoJtQJ. > To post to this group, send email to mongodb-user@googlegroups.com. > To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
> That's what I figured. Yea, I was running multiple php cli's with the same script.
> On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote: > I'm not a mongo guru, but given your lock level around 80%, you still have room, enough to reach 100kins/s.
> Did you try paralellizing php cli scripts ?
> Le 16 mars 2012 à 06:15, MKN Web Solutions <mich...@mknwebsolutions.com> a écrit :
>> I'm able to achieve 80k writes per second via CLI php. The script is basic, it simply injects a 10 char string into "x" (in this case it isn't indexed, nor does it need to be since this is a write test only).
>> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB 7200 rpm hd, running ubuntu.
>> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. Mongo running as a single instance, master set on, no repl set nor slaves.
>> My question is, what's the next bottleneck. The HD utilization was also bouncing around 10-35%. I want to get the max writes possible that the machine can produce.
>> Thanks for any tips / help.
>> -- >> You received this message because you are subscribed to the Google Groups "mongodb-user" group. >> To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/QTuYHv-zm3IJ. >> To post to this group, send email to mongodb-user@googlegroups.com. >> To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. >> For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
> -- > You received this message because you are subscribed to the Google Groups "mongodb-user" group. > To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/CHOl72aoJtQJ. > To post to this group, send email to mongodb-user@googlegroups.com. > To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
I'm sure the batch insert would work best on this. However I wanted to stress the max # of connections / writes in a potential scenario.
I'm running PHP 5.3 with this test. I do have APC enabled, but remember this is a script that's looping internally and not outside. So the script is already being compiled.
The script is as follows:
<?php $db = new Mongo("mongodb://localhost"); $c = $db->winner;
> On 16 Mar 2012, at 20:41, MKN Web Solutions <mich...@mknwebsolutions.com> > wrote:
> That's what I figured. Yea, I was running multiple php cli's with the > same script.
> On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote:
>> I'm not a mongo guru, but given your lock level around 80%, you still >> have room, enough to reach 100kins/s.
>> Did you try paralellizing php cli scripts ?
>> Le 16 mars 2012 à 06:15, MKN Web Solutions <mich...@mknwebsolutions.com> >> a écrit :
>> I'm able to achieve 80k writes per second via CLI php. The script is >> basic, it simply injects a 10 char string into "x" (in this case it isn't >> indexed, nor does it need to be since this is a write test only).
>> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB >> 7200 rpm hd, running ubuntu.
>> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. >> Mongo running as a single instance, master set on, no repl set nor slaves.
>> My question is, what's the next bottleneck. The HD utilization was also >> bouncing around 10-35%. I want to get the max writes possible that the >> machine can produce.
>> -- > You received this message because you are subscribed to the Google Groups > "mongodb-user" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/mongodb-user/-/CHOl72aoJtQJ. > To post to this group, send email to mongodb-user@googlegroups.com. > To unsubscribe from this group, send email to > mongodb-user+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/HSgaWPXW-VoJ. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
On Friday, March 16, 2012 9:59:26 PM UTC-4, MKN Web Solutions wrote:
> I'm sure the batch insert would work best on this. However I wanted to > stress the max # of connections / writes in a potential scenario.
> I'm running PHP 5.3 with this test. I do have APC enabled, but remember > this is a script that's looping internally and not outside. So the script > is already being compiled.
>> On 16 Mar 2012, at 20:41, MKN Web Solutions <mich...@mknwebsolutions.com> >> wrote:
>> That's what I figured. Yea, I was running multiple php cli's with the >> same script.
>> On Friday, March 16, 2012 6:50:42 AM UTC-4, SCO wrote:
>>> I'm not a mongo guru, but given your lock level around 80%, you still >>> have room, enough to reach 100kins/s.
>>> Did you try paralellizing php cli scripts ?
>>> Le 16 mars 2012 à 06:15, MKN Web Solutions <mich...@mknwebsolutions.com> >>> a écrit :
>>> I'm able to achieve 80k writes per second via CLI php. The script is >>> basic, it simply injects a 10 char string into "x" (in this case it isn't >>> indexed, nor does it need to be since this is a write test only).
>>> The machine specs are amd phenom II x4 2.2ghz @ 64bit, 4GB ram, 250GB >>> 7200 rpm hd, running ubuntu.
>>> CPU usage spiked around 50-70% usage by MongoDB and 20-30% by php cli. >>> Mongo running as a single instance, master set on, no repl set nor slaves.
>>> My question is, what's the next bottleneck. The HD utilization was also >>> bouncing around 10-35%. I want to get the max writes possible that the >>> machine can produce.
>>> -- >> You received this message because you are subscribed to the Google Groups >> "mongodb-user" group. >> To view this discussion on the web visit >> https://groups.google.com/d/msg/mongodb-user/-/CHOl72aoJtQJ. >> To post to this group, send email to mongodb-user@googlegroups.com. >> To unsubscribe from this group, send email to >> mongodb-user+unsubscribe@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/mongodb-user?hl=en.
-- You received this message because you are subscribed to the Google Groups "mongodb-user" group. To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/zL5uLClG86MJ. To post to this group, send email to mongodb-user@googlegroups.com. To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.
