access to aws image?

28 views
Skip to first unread message

comrade

unread,
Apr 27, 2012, 1:55:55 PM4/27/12
to conceptnet-users
Hello,

I would like to initiate the process of getting access to the amazon
disk image of the ~111GB database. We have an amazon instance running
already. Do we just attach a copy of your drive?

Rob

Rob Speer

unread,
Apr 27, 2012, 3:49:31 PM4/27/12
to conceptn...@googlegroups.com
The AWS thing didn't really work out. I don't know how to host a
public image without paying a lot more.

The instructions are about to change as I deploy and document
ConceptNet 5.1, anyway, which should be a lot more sensible to
download and use. There are now reasonably-sized flat versions of the
ConceptNet data, which you can get from:
http://conceptnet5.media.mit.edu/downloads/

-- Rob
> --
> You received this message because you are subscribed to the Google Groups "conceptnet-users" group.
> To post to this group, send email to conceptn...@googlegroups.com.
> To unsubscribe from this group, send email to conceptnet-use...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/conceptnet-users?hl=en.
>

Robert Decker

unread,
May 1, 2012, 10:15:43 AM5/1/12
to conceptn...@googlegroups.com
Hello,

What is different from the ~100GB database from the ~1GB json files?
Is it just indexing/post-processing?

Rob
--
-robert

Rob Speer

unread,
May 2, 2012, 3:06:45 PM5/2/12
to conceptn...@googlegroups.com
MongoDB is rather wanton in its use of disk space.

I'm no longer trying to figure out how to share the MongoDB image,
because not only is it expensive to store, it isn't even that fast at
indexing! Mongo is good for recording lots of data, but when it comes
to actually getting the data back out efficiently, I have been *much*
more successful with Apache Solr. Watch for a new API based on that
within a week.
-- Rob
Reply all
Reply to author
Forward
0 new messages