My virtual memory limit (ulimit -v -H) is lower than the size of my data. Is there a way for me to use MongoDB using this configuration?

159 views
Skip to first unread message

Joel Thibault

unread,
Apr 30, 2012, 2:51:42 PM4/30/12
to mongod...@googlegroups.com
On the host I want to run my MongoDB instance, I'm limited to 250 GB of virtual memory.  I have more than 250 GB of data I wish to store.  My interpretation of what I've read is that MongoDB will need to mmap my whole DB to the virtual memory space, and therefore I can't run it on this host.  Is that correct?

I have attempted to use this host, but once my DB gets large enough I can no longer use it.  My log has many errors like the following:

Tue Apr 24 08:51:17 [conn33] insert bjorn.samples exception: file <xxxxxx>/data/bjorn.27 open/c
reate failed in createPrivateMap (look in log for more information) code:13636 12ms
Tue Apr 24 08:51:17 [conn33] ERROR: mmap private failed with out of memory. (64 bit build)
Tue Apr 24 08:51:17 [conn33] Assertion: 13636:file <xxxxxx>/data/bjorn.27 open/create failed in
 createPrivateMap (look in log for more information)

I'm trying to get access to a host without this virtual memory limitation, but are there other options available to me?

Thanks,
Joel Thibault


Sam Millman

unread,
Apr 30, 2012, 3:29:04 PM4/30/12
to mongod...@googlegroups.com
Is sharding out of the question?



--
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To view this discussion on the web visit https://groups.google.com/d/msg/mongodb-user/-/9_HtyKoBvHsJ.
To post to this group, send email to mongod...@googlegroups.com.
To unsubscribe from this group, send email to mongodb-user...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.

A. Jesse Jiryu Davis

unread,
Apr 30, 2012, 3:34:53 PM4/30/12
to mongod...@googlegroups.com
Joel, that's correct -- Mongo has no set minimum for the amount of physical memory, but it does need to map all its database files, as well as the journal, into virtual memory.
To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.

Joel Thibault

unread,
Apr 30, 2012, 3:43:01 PM4/30/12
to mongod...@googlegroups.com
I am not familiar with sharding so I will read about that.  Thanks, Sammaye.


On Monday, April 30, 2012 3:29:04 PM UTC-4, Sammaye wrote:
To unsubscribe from this group, send email to mongodb-user+unsubscribe@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages