JanusGraph Management keeps force-closed instances as "open"

38 views
Skip to first unread message

f.gri...@gmail.com

unread,
Aug 12, 2020, 8:32:13 AM8/12/20
to JanusGraph users
Hello there,

in our team, we recently encountered a behavior of the JanusGraph management system, that we didn't expect.

Scenario:
We have some (currently 24) JanusGraph instances running in a Docker swarm. Every now and then, some of these instances are restarted, e.g. for maintenance or when healthchecks fail.

Behavior:
For us, it was expected that
mgmt.getOpenInstances()
should return a list of those 24 instances, that are currently running. This is not the case. Instead, over the course of months or even years, JanusGraph had accumulated tens of thousands of instances, that are seemingly still unclosed.

Why is this relevant?
In our case, we needed to stop all open instances in order to apply a change to a GLOBAL_OFFLINE config. Even though it was possible to close all instances via the management API, this process took about half an hour.

We thought it would be much cleaner if we found a way to automatically remove killed instances from the internal list of open instances. Does anybody know a way to accomplish this? Or does something like this require additional features in JanusGraph to be implemented?

Regards,
Florian

sparshneel chanchlani

unread,
Aug 12, 2020, 8:34:39 AM8/12/20
to janusgra...@googlegroups.com
Did you commit the management transaction ?after u force closed instances

-Sparshneel

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/janusgraph-users/cb749c90-9dcc-4d23-a6b1-8fc791ae008co%40googlegroups.com.

Florian Grieskamp

unread,
Aug 13, 2020, 12:47:45 AM8/13/20
to JanusGraph users
Did you commit the management transaction ?after u force closed instances
Which management transaction do you mean? Just to be clear, I did not force close the instances by the use of
mgmt.forceCloseInstance()

They are just closed by the container orchestrator. The situation should be about the same as if one machine unexpectedly died.

sparshneel chanchlani

unread,
Aug 13, 2020, 12:50:21 AM8/13/20
to janusgra...@googlegroups.com
Florian,
Best way is to manually close those
 You could do it using gremlin console as well. Hope this helps

--
You received this message because you are subscribed to the Google Groups "JanusGraph users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to janusgraph-use...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages