stardog 1.2.2 import error

0 views
Skip to first unread message

slusnys....@gmail.com

unread,
Jun 5, 2013, 4:55:49 AM6/5/13
to sta...@clarkparsia.com
Hi,

when I create stardog database:

/etc/stardog-1.2.2/stardog-admin db create -n library

and then try to add data (strict parsing is false in stardog.properties):

$ /etc/stardog-1.2.2/stardog data add library -g http://bnb *.nt

Adding data from file: BNB_201207_nTriples_f10.nt

Adding data from file: BNB_201207_nTriples_f11.nt

Adding data from file: BNB_201207_nTriples_f12.nt

Adding data from file: BNB_201207_nTriples_f13.nt

Adding data from file: BNB_201207_nTriples_f14.nt

Adding data from file: BNB_201207_nTriples_f15.nt

Adding data from file: BNB_201207_nTriples_f16.nt

Adding data from file: BNB_201207_nTriples_f17.nt

Adding data from file: BNB_201207_nTriples_f18.nt

Adding data from file: BNB_201207_nTriples_f19.nt

Adding data from file: BNB_201207_nTriples_f1.nt

Adding data from file: BNB_201207_nTriples_f2.nt

Adding data from file: BNB_201207_nTriples_f3.nt

Adding data from file: BNB_201207_nTriples_f4.nt

Adding data from file: BNB_201207_nTriples_f5.nt

Adding data from file: BNB_201207_nTriples_f6.nt

Adding data from file: BNB_201207_nTriples_f7.nt

Adding data from file: BNB_201207_nTriples_f8.nt

Adding data from file: BNB_201207_nTriples_f9.nt

[SEVERE com.clarkparsia.stardog.snarl.client.ClientHandler.handleError - Jun 5, 2013 10:34:29.942] Unhandled exception caught on client

com.clarkparsia.stardog.snarl.shared.IdAwareException: java.io.IOException: org.openrdf.rio.RDFParseException: '476' is not a valid value for datatype http://www.w3.org/2001/XMLSchema#gYear [line 2951216]

at com.clarkparsia.stardog.snarl.shared.BigPacketEncoder.writeRequested(BigPacketEncoder.java:235)

at org.jboss.netty.channel.Channels.write(Channels.java:712)

at org.jboss.netty.channel.Channels.write(Channels.java:679)

at org.jboss.netty.channel.AbstractChannel.write(AbstractChannel.java:246)

at com.clarkparsia.stardog.snarl.client.ClientHandler.send(ClientHandler.java:80)

at com.clarkparsia.stardog.snarl.client.ClientHandler.send(ClientHandler.java:104)

at com.clarkparsia.stardog.snarl.client.AbstractClient.execute(AbstractClient.java:199)

at com.clarkparsia.stardog.snarl.client.SNARLClientImpl.add(SNARLClientImpl.java:270)

at com.clarkparsia.stardog.snarl.client.SNARLConnection.change(SNARLConnection.java:269)

at com.clarkparsia.stardog.snarl.client.SNARLConnection.applyChanges(SNARLConnection.java:245)

at com.clarkparsia.stardog.api.impl.AbstractConnection.pushOutstanding(AbstractConnection.java:272)

at com.clarkparsia.stardog.api.impl.AbstractConnection.commit(AbstractConnection.java:190)

at com.clarkparsia.stardog.snarl.client.SNARLConnection.commit(SNARLConnection.java:193)

at com.clarkparsia.stardog.cli.impl.Add.execute(Add.java:115)

at com.clarkparsia.stardog.cli.impl.ConnectionCommand.call(ConnectionCommand.java:82)

at com.clarkparsia.stardog.cli.CLIBase.execute(CLIBase.java:53)

at com.clarkparsia.stardog.cli.CLI.main(CLI.java:89)

Caused by: java.io.IOException: org.openrdf.rio.RDFParseException: '476' is not a valid value for datatype http://www.w3.org/2001/XMLSchema#gYear [line 2951216]

at com.clarkparsia.stardog.rdf.io.StreamStatementIteration.computeNext(StreamStatementIteration.java:138)

at com.clarkparsia.stardog.rdf.io.StreamStatementIteration.computeNext(StreamStatementIteration.java:45)

at com.clarkparsia.common.iterations.AbstractIteration.tryToComputeNext(AbstractIteration.java:104)

at com.clarkparsia.common.iterations.AbstractIteration.hasNext(AbstractIteration.java:91)

at com.clarkparsia.common.iterations.MultiIteration.computeNext(MultiIteration.java:59)

at com.clarkparsia.common.iterations.AbstractIteration.tryToComputeNext(AbstractIteration.java:104)

at com.clarkparsia.common.iterations.AbstractIteration.hasNext(AbstractIteration.java:91)

at com.clarkparsia.stardog.snarl.shared.BigPacketEncoder.writeRequested(BigPacketEncoder.java:106)

... 16 more

Caused by: org.openrdf.rio.RDFParseException: '476' is not a valid value for datatype http://www.w3.org/2001/XMLSchema#gYear [line 2951216]

at org.openrdf.rio.helpers.RDFParserBase.reportError(RDFParserBase.java:663)

at org.openrdf.rio.ntriples.NTriplesParser.reportError(NTriplesParser.java:579)

at org.openrdf.rio.helpers.RDFParserBase.createLiteral(RDFParserBase.java:518)

at org.openrdf.rio.ntriples.NTriplesParser.createLiteral(NTriplesParser.java:559)

at org.openrdf.rio.ntriples.NTriplesParser.parseObject(NTriplesParser.java:390)

at org.openrdf.rio.ntriples.NTriplesParser.parseTriple(NTriplesParser.java:282)

at org.openrdf.rio.ntriples.NTriplesParser.parse(NTriplesParser.java:187)

at org.openrdf.rio.ntriples.NTriplesParser.parse(NTriplesParser.java:129)

at com.clarkparsia.stardog.rdf.io.StreamStatementIteration$ParseService.run(StreamStatementIteration.java:205)

at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:52)

at java.lang.Thread.run(Thread.java:662)


The error doesn't come up if I load the same files at creation time into default (no name specified) graph. 

What could be the problem?

Mindaugas






Mike Grove

unread,
Jun 5, 2013, 8:49:40 AM6/5/13
to stardog
On Wed, Jun 5, 2013 at 4:55 AM, <slusnys....@gmail.com> wrote:
Hi,

when I create stardog database:

/etc/stardog-1.2.2/stardog-admin db create -n library

and then try to add data (strict parsing is false in stardog.properties):

The error is thrown from the client, the strict.parsing option only controls the parsing on the server, which is why the bulk load worked fine.  So the behavior is admittedly a little awkward. This is something we're going to address, strict.parsing will be a per-database property rather than a server property, which will make it easier to enforce consistently.

I do suggest avoiding bulk additions like you seem to be trying.  You'll get significantly better load performance if you add the files at creation time.

Cheers,

Mike
 

--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
stardog+u...@clarkparsia.com
For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
 
 

slusnys....@gmail.com

unread,
Jun 6, 2013, 11:52:15 AM6/6/13
to sta...@clarkparsia.com
Thank you for the reply, 
I am trying to add three datasets to one database. Each dataset needs to be in a separate named graph. It is not possible to do that at creation time, or is it?
That's why I tried to create a database and then import each dataset with a separate command.

Mindaugas 

Mike Grove

unread,
Jun 6, 2013, 12:03:10 PM6/6/13
to stardog
On Thu, Jun 6, 2013 at 11:52 AM, <slusnys....@gmail.com> wrote:
Thank you for the reply, 
I am trying to add three datasets to one database. Each dataset needs to be in a separate named graph. It is not possible to do that at creation time, or is it?

It's not easily done at via the command line, though Stardog has that capability.  The easiest thing for you to do is probably just use any of the RDF formats that support named graphs, such as NQuads or TriG.  Otherwise, you could write a simple program that does it via Stardog's admin [1] API [2]

Cheers,

Mike
 
Reply all
Reply to author
Forward
0 new messages