Exception on listener

5 views
Skip to first unread message

s.ar...@geophy.com

unread,
Jan 10, 2017, 11:28:03 AM1/10/17
to Stardog
Hi Evren, the listerner example you sent me did not work for 4.2.2.

https://github.com/stardog-union/stardog-examples/blob/develop/examples/listener/main/src/com/complexible/stardog/examples/listener/ListenerConnectableConnection.java#L165

Could you please verify if anything change in your code base that generates this error.

When I add/remove any data to stardog I get this error:

ERROR 2017-01-10 09:43:28,615 [Stardog.Executor-59] com.complexible.common.protocols.server.rpc.ServerHandler:exceptionCaught(428): exceptionCaughtServerHandler
java.lang.AbstractMethodError: Method com/complexible/stardog/examples/listener/ListenerConnectableConnection.getQueryRewritings()Ljava/util/Set; is abstract
at com.complexible.stardog.examples.listener.ListenerConnectableConnection.getQueryRewritings(ListenerConnectableConnection.java) ~[listener-0.0.3.jar:?]
at com.complexible.stardog.db.ConnectableConnectionCollection.lambda$getQueryRewritings$39(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_91]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_91]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_91]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_91]
at com.complexible.stardog.db.ConnectableConnectionCollection.getQueryRewritings(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseConnectionImpl.getQueryRewritings(DatabaseConnectionImpl.java:198) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DelegatingConnectableConnection.getQueryRewritings(DelegatingConnectableConnection.java:84) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache$PlanCacheContext.<init>(SimplePlanCache.java:164) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache.get(SimplePlanCache.java:54) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.ExecutablePlanFactory.createOptimized(ExecutablePlanFactory.java:101) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.getExecutablePlan(QueryEngine.java:240) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.executeUpdate(QueryEngine.java:162) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:263) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:242) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1571) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1559) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3772) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3759) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.query(SPECServerFunction.java:526) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.handleMessage(SPECServerFunction.java:152) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.http.annex.QueryPanelEndpoint.handleMessage(QueryPanelEndpoint.java:89) ~[stardog-webconsole-annex-4.2.2.jar:?]
at com.complexible.common.protocols.server.rpc.ServerHandler.lambda$handleMessage$1(ServerHandler.java:337) ~[stardog-protocols-api-server-4.2.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_91]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_91]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]
ERROR 2017-01-10 09:43:28,616 [StardogServer.WorkerGroup-1] com.complexible.stardog.protocols.http.server.HttpMessageEncoder:createErrorResponse(293): The result encoder received an error message it could not encode, error was:
java.lang.AbstractMethodError: Method com/complexible/stardog/examples/listener/ListenerConnectableConnection.getQueryRewritings()Ljava/util/Set; is abstract
at com.complexible.stardog.examples.listener.ListenerConnectableConnection.getQueryRewritings(ListenerConnectableConnection.java) ~[listener-0.0.3.jar:?]
at com.complexible.stardog.db.ConnectableConnectionCollection.lambda$getQueryRewritings$39(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_91]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_91]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_91]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_91]
at com.complexible.stardog.db.ConnectableConnectionCollection.getQueryRewritings(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseConnectionImpl.getQueryRewritings(DatabaseConnectionImpl.java:198) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DelegatingConnectableConnection.getQueryRewritings(DelegatingConnectableConnection.java:84) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache$PlanCacheContext.<init>(SimplePlanCache.java:164) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache.get(SimplePlanCache.java:54) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.ExecutablePlanFactory.createOptimized(ExecutablePlanFactory.java:101) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.getExecutablePlan(QueryEngine.java:240) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.executeUpdate(QueryEngine.java:162) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:263) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:242) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1571) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1559) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3772) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3759) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.query(SPECServerFunction.java:526) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.handleMessage(SPECServerFunction.java:152) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.http.annex.QueryPanelEndpoint.handleMessage(QueryPanelEndpoint.java:89) ~[stardog-webconsole-annex-4.2.2.jar:?]
at com.complexible.common.protocols.server.rpc.ServerHandler.lambda$handleMessage$1(ServerHandler.java:337) ~[stardog-protocols-api-server-4.2.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_91]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_91]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]
ERROR 2017-01-10 09:43:50,646 [Stardog.Executor-61] com.complexible.common.protocols.server.rpc.ServerHandler:exceptionCaught(428): exceptionCaughtServerHandler
java.lang.AbstractMethodError: Method com/complexible/stardog/examples/listener/ListenerConnectableConnection.getQueryRewritings()Ljava/util/Set; is abstract
at com.complexible.stardog.examples.listener.ListenerConnectableConnection.getQueryRewritings(ListenerConnectableConnection.java) ~[listener-0.0.3.jar:?]
at com.complexible.stardog.db.ConnectableConnectionCollection.lambda$getQueryRewritings$39(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_91]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_91]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_91]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_91]
at com.complexible.stardog.db.ConnectableConnectionCollection.getQueryRewritings(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseConnectionImpl.getQueryRewritings(DatabaseConnectionImpl.java:198) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DelegatingConnectableConnection.getQueryRewritings(DelegatingConnectableConnection.java:84) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache$PlanCacheContext.<init>(SimplePlanCache.java:164) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache.get(SimplePlanCache.java:54) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.ExecutablePlanFactory.createOptimized(ExecutablePlanFactory.java:101) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.getExecutablePlan(QueryEngine.java:240) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.executeUpdate(QueryEngine.java:162) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:263) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:242) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1571) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1559) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3772) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3759) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.query(SPECServerFunction.java:526) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.handleMessage(SPECServerFunction.java:152) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.http.annex.QueryPanelEndpoint.handleMessage(QueryPanelEndpoint.java:89) ~[stardog-webconsole-annex-4.2.2.jar:?]
at com.complexible.common.protocols.server.rpc.ServerHandler.lambda$handleMessage$1(ServerHandler.java:337) ~[stardog-protocols-api-server-4.2.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_91]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_91]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]
ERROR 2017-01-10 09:43:50,648 [StardogServer.WorkerGroup-1] com.complexible.stardog.protocols.http.server.HttpMessageEncoder:createErrorResponse(293): The result encoder received an error message it could not encode, error was:
java.lang.AbstractMethodError: Method com/complexible/stardog/examples/listener/ListenerConnectableConnection.getQueryRewritings()Ljava/util/Set; is abstract
at com.complexible.stardog.examples.listener.ListenerConnectableConnection.getQueryRewritings(ListenerConnectableConnection.java) ~[listener-0.0.3.jar:?]
at com.complexible.stardog.db.ConnectableConnectionCollection.lambda$getQueryRewritings$39(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:267) ~[?:1.8.0_91]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) ~[?:1.8.0_91]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_91]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_91]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_91]
at com.complexible.stardog.db.ConnectableConnectionCollection.getQueryRewritings(ConnectableConnectionCollection.java:155) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseConnectionImpl.getQueryRewritings(DatabaseConnectionImpl.java:198) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DelegatingConnectableConnection.getQueryRewritings(DelegatingConnectableConnection.java:84) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache$PlanCacheContext.<init>(SimplePlanCache.java:164) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.cache.SimplePlanCache.get(SimplePlanCache.java:54) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.ExecutablePlanFactory.createOptimized(ExecutablePlanFactory.java:101) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.getExecutablePlan(QueryEngine.java:240) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.plan.eval.QueryEngine.executeUpdate(QueryEngine.java:162) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:263) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DefaultQueryFactory$UpdateQueryImpl.execute(DefaultQueryFactory.java:242) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1571) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.db.DatabaseImpl$TimerPauseUpdate.execute(DatabaseImpl.java:1559) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.query.DelegatingUpdateQuery.execute(DelegatingUpdateQuery.java:139) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3772) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.StardogKernel$SecuredUpdateQuery.execute(StardogKernel.java:3759) ~[stardog-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.query(SPECServerFunction.java:526) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.server.SPECServerFunction.handleMessage(SPECServerFunction.java:152) ~[stardog-protocols-spec-server-4.2.2.jar:?]
at com.complexible.stardog.protocols.http.annex.QueryPanelEndpoint.handleMessage(QueryPanelEndpoint.java:89) ~[stardog-webconsole-annex-4.2.2.jar:?]
at com.complexible.common.protocols.server.rpc.ServerHandler.lambda$handleMessage$1(ServerHandler.java:337) ~[stardog-protocols-api-server-4.2.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_91]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_91]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_91]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]

Evren Sirin

unread,
Jan 10, 2017, 2:25:07 PM1/10/17
to Stardog
The example is now updated to 4.2.2. Please pull the latest changes
and give it a try.

Best,
Evren
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> stardog+u...@clarkparsia.com
> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en

Samur Araujo

unread,
Jan 11, 2017, 4:18:15 AM1/11/17
to sta...@clarkparsia.com
Evren, I have this setup in my environment
 
export JENAROOT="/home/samur/tools/apache-jena-3.1.1" 
export STARDOG="/home/samur/tools/stardog-4.2.1"
export STARDOG_HOME="/home/samur/tools/stardog-data"
export PATH="$JENAROOT/bin:$PATH:$HOME/.rvm/bin" # Add RVM to PATH for scripting

The listener only works if remove the STARDOG_HOME. 

Do you know how to make it work with the STARDOG_HOME?

Best,

> stardog+unsubscribe@clarkparsia.com

> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en

--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
stardog+unsubscribe@clarkparsia.com

For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "Stardog" group.
To unsubscribe from this topic, visit https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to stardog+unsubscribe@clarkparsia.com.




--
Senior Data Scientist 
Geophy 

Nieuwe Plantage 54-55
2611XK  Delft
+31 (0)70 7640725 

1 Fore Street
EC2Y 9DT  London
+44 (0)20 37690760

Samur Araujo

unread,
Jan 11, 2017, 4:33:45 AM1/11/17
to sta...@clarkparsia.com
I fixed the issue! 

It works now. 

Thanks!

Samur Araujo

unread,
Jan 12, 2017, 9:36:24 AM1/12/17
to sta...@clarkparsia.com
Hi Evren, one question about the listening system.

I need to migrate data to another machine. Every time triples are added/removed I need to update other system about it. This mechanism do not need to be synchronous. 

Using the listener to implement this has an issue. If stardog crashes during a transaction, I may get inconsistent data in the other end. Even when I wait stardog to complete the transaction, it still may crashes during the time it is sending the data to my queue. This would lead to inconsistent data between stardog and my  queue.  

Is it possible to read the transaction log of stardog after commit, with stardog stopped? Do you keep this log anywhere ? 

In this case, I could read the transaction log any point in time, asynchronously. That would allow us to design a fault tolerant system we need to. 

Any further information on that will be welcome. 

Best,
Samur
--
Head of Data

Zachary Whitley

unread,
Jan 12, 2017, 10:19:10 AM1/12/17
to Stardog
It sounds like what you're looking for is Stardog HA [1] or are you looking for some sort of cross datacenter replication (XDC)?

[1] http://docs.stardog.com/#_high_availability_cluster

You received this message because you are subscribed to the Google Groups "Stardog" group.
To unsubscribe from this group and stop receiving emails from it, send an email to stardog+unsubscribe@clarkparsia.com.

Evren Sirin

unread,
Jan 16, 2017, 9:26:05 PM1/16/17
to Stardog
Zachary is right that this is kind of what HA cluster provides. With
or without the HA cluster you can enable the transaction log but we do
not expose the bits that read from the transaction log and the
transaction log contains other details that are not relevant for your
use case. As an alternative you can change the listener code to create
your own transaction log and process it any way you want. You just
need to change the listener example to write the triples to a file
instead of stdout and specify if it is an addition or deletion.

Best,
Evren
>>>>> > stardog+u...@clarkparsia.com
>>>>> > For more options, visit this group at
>>>>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>>
>>>>> --
>>>>> -- --
>>>>> You received this message because you are subscribed to the C&P
>>>>> "Stardog" group.
>>>>> To post to this group, send email to sta...@clarkparsia.com
>>>>> To unsubscribe from this group, send email to
>>>>> stardog+u...@clarkparsia.com
>>>>> For more options, visit this group at
>>>>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>> ---
>>>>> You received this message because you are subscribed to a topic in the
>>>>> Google Groups "Stardog" group.
>>>>> To unsubscribe from this topic, visit
>>>>> https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
>>>>> To unsubscribe from this group and all its topics, send an email to
>>>>> stardog+u...@clarkparsia.com.
>> stardog+u...@clarkparsia.com
>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Stardog" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to stardog+u...@clarkparsia.com.
>
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> stardog+u...@clarkparsia.com

Samur Araujo

unread,
Jan 17, 2017, 2:04:09 AM1/17/17
to sta...@clarkparsia.com
For large updates, there is a chance that the writing a file to disk breaks before it finishes. In this case, I cannot recover the data that was already committed on stardog. The file may end up with partial data for the last transaction.

This is why I would prefer to access the log of transaction of stardog. That would allow me to be sure I am reading all data that was committed, even if the system crashes and I need to restart and recover at certain point. 

Mysql and postgres expose their binlogs for this purpose. There is any possibility to have access to the stardog transaction log? Or do you have another suggestion ?

Notice I need to do this to copy, in real time, the data from stardog to several other systems, like elasticsearch, mysql, kafka, etc. 

Best,
Samur


>>>>> > For more options, visit this group at
>>>>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>>
>>>>> --
>>>>> -- --
>>>>> You received this message because you are subscribed to the C&P
>>>>> "Stardog" group.
>>>>> To post to this group, send email to sta...@clarkparsia.com
>>>>> To unsubscribe from this group, send email to

>>>>> For more options, visit this group at
>>>>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>>>> ---
>>>>> You received this message because you are subscribed to a topic in the
>>>>> Google Groups "Stardog" group.
>>>>> To unsubscribe from this topic, visit
>>>>> https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
>>>>> To unsubscribe from this group and all its topics, send an email to

>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to the Google Groups
>> "Stardog" group.
>> To unsubscribe from this group and stop receiving emails from it, send an

>
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to

> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en

--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to

For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "Stardog" group.
To unsubscribe from this topic, visit https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to stardog+unsubscribe@clarkparsia.com.

Samur Araujo

unread,
Feb 15, 2017, 8:57:30 AM2/15/17
to sta...@clarkparsia.com
Hi Evren, could you please update the example for 4.2.3. Apparently the previous version is not compatible.

On 10 January 2017 at 20:24, Evren Sirin <ev...@stardog.com> wrote:
> stardog+unsubscribe@clarkparsia.com

> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en

--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to
stardog+unsubscribe@clarkparsia.com

For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "Stardog" group.
To unsubscribe from this topic, visit https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to stardog+unsubscribe@clarkparsia.com.

Evren Sirin

unread,
Feb 18, 2017, 11:45:07 AM2/18/17
to Stardog
Hi Samur,

Are you trying with the latest version from github? There was an
update a month ago to fix some compatibility issues. I just double
checked now and verified that it works with 4.2.3.

Best,
Evren
>> > stardog+u...@clarkparsia.com
>> > For more options, visit this group at
>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>
>> --
>> -- --
>> You received this message because you are subscribed to the C&P "Stardog"
>> group.
>> To post to this group, send email to sta...@clarkparsia.com
>> To unsubscribe from this group, send email to
>> stardog+u...@clarkparsia.com
>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to a topic in the
>> Google Groups "Stardog" group.
>> To unsubscribe from this topic, visit
>> https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to
>> stardog+u...@clarkparsia.com.
>>
>
>
>
> --
> Head of Data
> Geophy
> www.geophy.com
>
> Nieuwe Plantage 54-55
> 2611XK Delft
> +31 (0)70 7640725
>
> 1 Fore Street
> EC2Y 9DT London
> +44 (0)20 37690760
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to
> stardog+u...@clarkparsia.com

Samur Araujo

unread,
Feb 20, 2017, 2:35:02 AM2/20/17
to sta...@clarkparsia.com
Hi Evren, I wasn't sure if would work if new stardog. I got some errors but now i see is due to other reason.

It worth mentioned in the repo that it is compatible to future versions as well.
Thank you. 


>> > For more options, visit this group at
>> > http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>>
>> --
>> -- --
>> You received this message because you are subscribed to the C&P "Stardog"
>> group.
>> To post to this group, send email to sta...@clarkparsia.com
>> To unsubscribe from this group, send email to

>> For more options, visit this group at
>> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
>> ---
>> You received this message because you are subscribed to a topic in the
>> Google Groups "Stardog" group.
>> To unsubscribe from this topic, visit
>> https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
>> To unsubscribe from this group and all its topics, send an email to

>>
>
>
>
> --
> Head of Data
> Geophy
> www.geophy.com
>
> Nieuwe Plantage 54-55
> 2611XK  Delft
> +31 (0)70 7640725
>
> 1 Fore Street
> EC2Y 9DT  London
> +44 (0)20 37690760
>
> --
> -- --
> You received this message because you are subscribed to the C&P "Stardog"
> group.
> To post to this group, send email to sta...@clarkparsia.com
> To unsubscribe from this group, send email to

> For more options, visit this group at
> http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en

--
-- --
You received this message because you are subscribed to the C&P "Stardog" group.
To post to this group, send email to sta...@clarkparsia.com
To unsubscribe from this group, send email to

For more options, visit this group at
http://groups.google.com/a/clarkparsia.com/group/stardog?hl=en
---
You received this message because you are subscribed to a topic in the Google Groups "Stardog" group.
To unsubscribe from this topic, visit https://groups.google.com/a/clarkparsia.com/d/topic/stardog/IHW-l79CVuU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to stardog+unsubscribe@clarkparsia.com.

Reply all
Reply to author
Forward
0 new messages