PostgreSQL database dump snapshot

[barraq]

Hi everyone,

I'm looking for a recent PostgreSQL dump of the conceptnet database.
It seems that only the SQlite version get updated while the PostgreSQL
ones are not. The ones on http://conceptnet.media.mit.edu/dist are
kind of old... i've tried to use those available here
http://conceptnet.media.mit.edu/snapshots/2009-12-06/ and there is
another problem, the dump doesn't contain all the tables.... only the
following are:
- commons_rating_values
- commons_rating
- coprus_activity
- corpus_language
- frame
- pasring_patterns
- parsing_rawpredicate
- patterns
- predicates
- stems

where are the Concept table and all ? Am I missing something ?

Could someone explain me how to get the last PostgreSQL dump working
properly ?

Thanks for any help.

Rémi

[Kenneth Arnold]

PostgreSQL is what we use internally and also used to be the main distribution channel. It proved to be such a pain for people to get set up (search the archives of this group even!) that we threw our weight behind getting sqlite distributed. But now that many fewer people cared about the Postgres dump, we haven't been maintaining the scripts that make the dump after various changes to the database schema.

So you're not missing something. It should be a simple fix on our end, but we have a bajillion things going on so I can't give any guarantee about when we'll actually get to updating it. Out of curiosity, what is your need for Postgres and how time-sensitive is it, vs just developing against the sqlite dump for now?

-Ken

--

You received this message because you are subscribed to the Google Groups "conceptnet-users" group.
To post to this group, send email to conceptn...@googlegroups.com.
To unsubscribe from this group, send email to conceptnet-use...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/conceptnet-users?hl=en.

[James Simmons]

Slightly off topic but will there be an n3 or even tsv dump in the near future. I'd like to play with an updated version of the dataset.

Kenneth Arnold <kenneth...@gmail.com> wrote:

>> conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsu...@googlegroups.com>

[Francisco Dalla Rosa Soares]

James,

I'm actually working on a port of the ConceptNet database to tsv format and
writing some C++ functions and algorithms to work with the database
(What I'm doing was suffering a lot with running time problems and I got that
pretty much solved). So if you want to give me a hand (especially with
suggestions and hints) I'd be glad.

Francisco

> >> conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsubsc
> >>ri...@googlegroups.com> .

> >> For more options, visit this group at
> >> http://groups.google.com/group/conceptnet-users?hl=en.
> >
> >--
> >
> >You received this message because you are subscribed to the Google Groups
> > "conceptnet-users" group. To post to this group, send email to
> > conceptn...@googlegroups.com. To unsubscribe from this group, send
> > email to conceptnet-use...@googlegroups.com. For more options,
> > visit this group at
> > http://groups.google.com/group/conceptnet-users?hl=en.
>
> --
>
> You received this message because you are subscribed to the Google Groups
> "conceptnet-users" group. To post to this group, send email to
> conceptn...@googlegroups.com. To unsubscribe from this group, send
> email to conceptnet-use...@googlegroups.com. For more options,
> visit this group at http://groups.google.com/group/conceptnet-users?hl=en.
>

--
Nara Institute of Science and Technology
Computational Linguistics Laboratory
Francisco Dalla Rosa Soares

[akshay bhat]

you can use any descent sqlite gui and run sql queries against the database to create CSV dumps

Akshay Uday Bhat.
Student, MS in Computer Science, Syracuse University.

Website: http://www.akshaybhat.com

Profile:  http://www.google.com/profiles/akshayubhat.


“One has the ability and privilege to do one’s respective duty, but has no control over the
results. The fruits of work should not be the motive, for they shall follow one’s actions”
Bhagvad Gita, (2.47)

[Kenneth Arnold]

We generally find it faster and more flexible to develop in Python, profile to find what's slow, and optimize that, sometimes by reimplementing it in a lower-level language. Between SWIG, Cython, numpy, scipy.weave, ctypes, PyCUDA, CorePy, etc., Python gives you a ton of ways to make the slow parts of your program and make them fast. Rewriting the whole thing in C++ would be nearly the last resort for us. But if that's what you want to do, we certainly won't keep you from doing it :)

-Ken

On Mon, Dec 7, 2009 at 10:59 PM, Francisco Dalla Rosa Soares <franc...@is.naist.jp> wrote:

[barraq]

Hi Ken,

Thanks for giving a quick reply.
I'm working on a project that is using ConceptNet and i had some
performance issue when using SQlite version. Actually i'm doing a lot
of query to the database and sometime the process gets real slow, also
I had some issues when adding new concepts (locally) to the database
but it seems to be resolved with the ConceptNetrc2. Basically i was
looking for the PostgreSQL database version to get better performance
and to access raw_assertion. Anyway for now SQlite could do the job.

Thanks for all the job your are doing !

Rémi

On Dec 7, 7:12 pm, Kenneth Arnold <kenneth.arn...@gmail.com> wrote:
> PostgreSQL is what we use internally and also used to be the main
> distribution channel. It proved to be such a pain for people to get set up
> (search the archives of this group even!) that we threw our weight behind
> getting sqlite distributed. But now that many fewer people cared about the
> Postgres dump, we haven't been maintaining the scripts that make the dump
> after various changes to the database schema.
>
> So you're not missing something. It should be a simple fix on our end, but
> we have a bajillion things going on so I can't give any guarantee about when
> we'll actually get to updating it. Out of curiosity, what is your need for
> Postgres and how time-sensitive is it, vs just developing against the sqlite
> dump for now?
>
> -Ken
>
> On Mon, Dec 7, 2009 at 12:55 PM, barraq <goo...@barraquand.com> wrote:
> > Hi everyone,
>
> > I'm looking for a recent PostgreSQL dump of the conceptnet database.
> > It seems that only the SQlite version get updated while the PostgreSQL
> > ones are not. The ones onhttp://conceptnet.media.mit.edu/distare
> > kind of old... i've tried to use those available here

> >http://conceptnet.media.mit.edu/snapshots/2009-12-06/and there is

> > another problem, the dump doesn't contain all the tables.... only the
> > following are:
> > - commons_rating_values
> > - commons_rating
> > - coprus_activity
> > - corpus_language
> > - frame
> > - pasring_patterns
> > - parsing_rawpredicate
> > - patterns
> > - predicates
> > - stems
>
> > where are the Concept table and all ? Am I missing something ?
>
> > Could someone explain me how to get the last PostgreSQL dump working
> > properly ?
>
> > Thanks for any help.
>
> > Rémi
>
> > --
>
> > You received this message because you are subscribed to the Google Groups
> > "conceptnet-users" group.
> > To post to this group, send email to conceptn...@googlegroups.com.
> > To unsubscribe from this group, send email to

> > conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsu...@googlegroups.com>
> > .

[Kenneth Arnold]

Well you poked me, and I updated the dump scripts. It's dumping to http://conceptnet.media.mit.edu/snapshots/2009-12-08/ right now; when it's done (i.e., doesn't get bigger for ~5 minutes) you can try it out. As usual (and as documented) for the Postgres dumps, you'll have to create fake users if you want to avoid foreign key errors in certain circumstances.

-Ken

To unsubscribe from this group, send email to conceptnet-use...@googlegroups.com.

[James Simmons]

You're the man!

Kenneth Arnold <kenneth...@gmail.com> wrote:

>> <conceptnet-users%2Bunsu...@googlegroups.com<conceptnet-users%252Buns...@googlegroups.com>

[barraq]

hehe ! really cooool !!
Thank you so much

On Dec 9, 4:02 am, Kenneth Arnold <kenneth.arn...@gmail.com> wrote:
> Well you poked me, and I updated the dump scripts. It's dumping tohttp://conceptnet.media.mit.edu/snapshots/2009-12-08/right now; when it's

> > > >http://conceptnet.media.mit.edu/snapshots/2009-12-06/andthere is

> > <conceptnet-users%2Bunsu...@googlegroups.com<conceptnet-users%252Buns...@googlegroups.com>

[Francisco Dalla Rosa Soares]

Hello,

Yeah, of course ^^ I wouldn't even think of asking for a native port of of the
whole concetpnet api. The point is I'm working using conceptnet's data
together with other knowledge bases and I need very fast operations (I wonder
if divisi could help there though), I also need bits that are not there and
some I just don't need at all. As I'm a c/c++ fan and not the greatest python
programmer I decided to do it this way.

(Actually that email should have been a private message as I thought that
could sound really rude towards you guys, developers of Conceptnet, but my
inability to press "answer to the author" got it sent to the whole list)

Francisco

> > > >>ubsc...@googlegroups.com>

> >
> > <conceptnet-users%2Bunsubsc
> >
> > > >>ri...@googlegroups.com> .
> > > >> For more options, visit this group at
> > > >> http://groups.google.com/group/conceptnet-users?hl=en.
> > > >
> > > >--
> > > >
> > > >You received this message because you are subscribed to the Google
> >
> > Groups
> >
> > > > "conceptnet-users" group. To post to this group, send email to
> > > > conceptn...@googlegroups.com. To unsubscribe from this group,
> >
> > send
> >
> > > > email to

> > > > conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsu
> > > >bsc...@googlegroups.com>.

> >
> > For more options,
> >
> > > > visit this group at
> > > > http://groups.google.com/group/conceptnet-users?hl=en.
> > >
> > > --
> > >
> > > You received this message because you are subscribed to the Google
> > > Groups "conceptnet-users" group. To post to this group, send email to
> > > conceptn...@googlegroups.com. To unsubscribe from this group, send
> > > email to

> > > conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsubs
> > >cr...@googlegroups.com>.

> >
> > For more options,
> >
> > > visit this group at
> >
> > http://groups.google.com/group/conceptnet-users?hl=en.
> >
> >
> > --

> > Nara Institute of Science and Technology
> > Computational Linguistics Laboratory
> > Francisco Dalla Rosa Soares
> >
> > --
> >
> > You received this message because you are subscribed to the Google Groups
> > "conceptnet-users" group.
> > To post to this group, send email to conceptn...@googlegroups.com.
> > To unsubscribe from this group, send email to

> > conceptnet-use...@googlegroups.com<conceptnet-users%2Bunsubscr
> >i...@googlegroups.com> .