Received: by 10.52.74.103 with SMTP id s7mr23183662vdv.1.1335814991457;
        Mon, 30 Apr 2012 12:43:11 -0700 (PDT)
X-BeenThere: mongodb-user@googlegroups.com
Received: by 10.220.153.198 with SMTP id l6ls1975298vcw.6.gmail; Mon, 30 Apr
 2012 12:43:01 -0700 (PDT)
Received: by 10.52.21.83 with SMTP id t19mr473861vde.18.1335814981644;
        Mon, 30 Apr 2012 12:43:01 -0700 (PDT)
Date: Mon, 30 Apr 2012 12:43:01 -0700 (PDT)
From: Joel Thibault <thiba...@broadinstitute.org>
To: mongodb-user@googlegroups.com
Message-ID: <25914069.1109.1335814981175.JavaMail.geo-discussion-forums@ynej8>
In-Reply-To: <CALKyTE7BBAasOsNbHVYbBf8dygeN+Y5C5svaVO93JSN+zGkb7w@mail.gmail.com>
References: <27247292.1626.1335811902819.JavaMail.geo-discussion-forums@ynff7>
 <CALKyTE7BBAasOsNbHVYbBf8dygeN+Y5C5svaVO93JSN+zGkb7w@mail.gmail.com>
Subject: Re: [mongodb-user] My virtual memory limit (ulimit -v -H) is lower
 than the size of my data. Is there a way for me to use MongoDB using this
 configuration?
MIME-Version: 1.0
Content-Type: multipart/mixed; 
	boundary="----=_Part_1107_27698285.1335814981168"

------=_Part_1107_27698285.1335814981168
Content-Type: multipart/alternative; 
	boundary="----=_Part_1108_28916210.1335814981173"

------=_Part_1108_28916210.1335814981173
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit

I am not familiar with sharding so I will read about that.  Thanks, Sammaye.


On Monday, April 30, 2012 3:29:04 PM UTC-4, Sammaye wrote:
>
> Is sharding out of the question?
>
> On 30 April 2012 19:51, Joel Thibault <thiba...@broadinstitute.org> wrote:
>
>> On the host I want to run my MongoDB instance, I'm limited to 250 GB of 
>> virtual memory.  I have more than 250 GB of data I wish to store.  My 
>> interpretation of what I've read is that MongoDB will need to mmap my whole 
>> DB to the virtual memory space, and therefore I can't run it on this host. 
>>  Is that correct?
>>
>> I have attempted to use this host, but once my DB gets large enough I can 
>> no longer use it.  My log has many errors like the following:
>>
>> Tue Apr 24 08:51:17 [conn33] insert bjorn.samples exception: file 
>> <xxxxxx>/data/bjorn.27 open/c
>> reate failed in createPrivateMap (look in log for more information) 
>> code:13636 12ms
>> Tue Apr 24 08:51:17 [conn33] ERROR: mmap private failed with out of 
>> memory. (64 bit build)
>> Tue Apr 24 08:51:17 [conn33] Assertion: 13636:file <xxxxxx>/data/bjorn.27 
>> open/create failed in
>>  createPrivateMap (look in log for more information)
>>
>> I'm trying to get access to a host without this virtual memory 
>> limitation, but are there other options available to me?
>>
>> Thanks,
>> Joel Thibault
>>
>>
>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "mongodb-user" group.
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msg/mongodb-user/-/9_HtyKoBvHsJ.
>> To post to this group, send email to mongodb-user@googlegroups.com.
>> To unsubscribe from this group, send email to 
>> mongodb-user+unsubscribe@googlegroups.com.
>> For more options, visit this group at 
>> http://groups.google.com/group/mongodb-user?hl=en.
>>
>
>
------=_Part_1108_28916210.1335814981173
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit

I am not familiar with sharding so I will read about that. &nbsp;Thanks, Sammaye.<div><br><br>On Monday, April 30, 2012 3:29:04 PM UTC-4, Sammaye wrote:<blockquote class="gmail_quote" style="margin: 0;margin-left: 0.8ex;border-left: 1px #ccc solid;padding-left: 1ex;">Is sharding out of the question?<br><br><div class="gmail_quote">On 30 April 2012 19:51, Joel Thibault <span dir="ltr">&lt;<a href="mailto:thiba...@broadinstitute.org" target="_blank">thiba...@broadinstitute.org</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On the host I want to run my MongoDB instance, I'm limited to 250 GB of virtual memory. &nbsp;I have more than 250 GB of data I wish to store. &nbsp;My interpretation of what I've read is that MongoDB will need to mmap my whole DB to the virtual memory space, and therefore I can't run it on this host. &nbsp;Is that correct?<div>
<br></div><div>I have attempted to use this host, but once my DB gets large enough I can no longer use it. &nbsp;My log has many errors like the following:</div><div><br></div><div><div>Tue Apr 24 08:51:17 [conn33] insert bjorn.samples exception: file &lt;xxxxxx&gt;/data/bjorn.27 open/c</div>
<div>reate failed in createPrivateMap (look in log for more information) code:13636 12ms</div><div>Tue Apr 24 08:51:17 [conn33] ERROR: mmap private failed with out of memory. (64 bit build)</div><div>Tue Apr 24 08:51:17 [conn33] Assertion: 13636:file&nbsp;&lt;xxxxxx&gt;/data/<wbr>bjorn.27 open/create failed in</div>
<div>&nbsp;createPrivateMap (look in log for more information)</div></div><div><br></div><div>I'm trying to get access to a host without this virtual memory limitation, but are there other options available to me?</div><div>
<br></div><div>Thanks,</div><div>Joel Thibault</div><span><font color="#888888"><div><br></div><div><br></div>

<p></p>

-- <br>
You received this message because you are subscribed to the Google Groups "mongodb-user" group.<br>
To view this discussion on the web visit <a href="https://groups.google.com/d/msg/mongodb-user/-/9_HtyKoBvHsJ" target="_blank">https://groups.google.com/d/<wbr>msg/mongodb-user/-/9_<wbr>HtyKoBvHsJ</a>.<br> 
To post to this group, send email to <a href="mailto:mongodb-user@googlegroups.com" target="_blank">mongodb-user@googlegroups.com</a>.<br>
To unsubscribe from this group, send email to <a href="mailto:mongodb-user%2Bunsubscribe@googlegroups.com" target="_blank">mongodb-user+unsubscribe@<wbr>googlegroups.com</a>.<br>

For more options, visit this group at <a href="http://groups.google.com/group/mongodb-user?hl=en" target="_blank">http://groups.google.com/<wbr>group/mongodb-user?hl=en</a>.<br>


</font></span></blockquote></div><br>
</blockquote></div>
------=_Part_1108_28916210.1335814981173--

------=_Part_1107_27698285.1335814981168--