How much memory is needed to load the Google web 1T model?

42 views
Skip to first unread message

qhdj...@gmail.com

unread,
Feb 28, 2015, 2:51:26 AM2/28/15
to berkeleyl...@googlegroups.com
Hi,

   Adam, I just downloaded the pre-built model for google web 1T ngram and made some experiments.
   I want to know how much memory is needed to load the 10G model.

Thanks!

Jason

Adam Pauls

unread,
Mar 1, 2015, 11:40:24 AM3/1/15
to berkeleyl...@googlegroups.com
It should basically be 10GB. I'm sure the JVM has some extra overhead, but probably on he order of megabytes. It's just a Java serialized object, so it can more or less be slurped straight into memory.
--
You received this message because you are subscribed to the Google Groups "berkeleylm-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to berkeleylm-disc...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages