Re: [Neo4j] neo4j Chef automatic deploy

145 views
Skip to first unread message

Wes Freeman

unread,
May 16, 2013, 8:15:58 PM5/16/13
to ne...@googlegroups.com
Does the messages.log say anything more interesting?

On Thu, May 16, 2013 at 11:55 AM, <tga...@gmail.com> wrote:
Dear list members,

I use neo4j for a variety of projects. We also use chef as a automatic deploy tool. At the moment I m trying to create a Chef recipe that automatically downloads a neo4j tarball from the site, unpacks in a folder in a aws instance and runs the binary. This later step is done by defining a neo4j service in the init.d folder.

Things sort of work. The tarball is extracted etc... and Chef is able to initialise the neo4j service, but everytime I hit the webadmin url from my browser seems to send a killsignal to the server. The overall experience is that the server flicks and shuts itself down. To make things more puzzling, when I ssh into the aws instance and execute "service neo4j start" the server is up for good (note that this is the same command that is executed by Chef).

Here is the info that I can find in the cosole logfile in data/log

11:19:29.554 [main] INFO  org.mortbay.log - Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
11:19:29.620 [main] INFO  org.mortbay.log - jetty-6.1.25
11:19:29.791 [main] INFO  org.mortbay.log - NO JSP Support for /webadmin, did not find org.apache.jasper.servlet.JspServlet
11:19:32.889 [main] INFO  org.mortbay.log - Started SelectChann...@0.0.0.0:7474
11:19:34.200 [main] INFO  org.mortbay.log - Started SslSocket...@0.0.0.0:7473
11:19:34.886 [Thread-8] INFO  org.mortbay.log - Stopped SslSocket...@0.0.0.0:7473
11:19:34.887 [Thread-8] INFO  org.mortbay.log - Stopped SelectChann...@0.0.0.0:7474
14:03:27.116 [main] INFO  org.mortbay.log - Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
14:03:27.277 [main] INFO  org.mortbay.log - jetty-6.1.25
14:03:27.562 [main] INFO  org.mortbay.log - NO JSP Support for /webadmin, did not find org.apache.jasper.servlet.JspServlet
14:03:30.576 [main] INFO  org.mortbay.log - Started SelectChann...@0.0.0.0:7474
14:03:31.746 [main] INFO  org.mortbay.log - Started SslSocket...@0.0.0.0:7473
14:03:48.978 [Thread-8] INFO  org.mortbay.log - Stopped SslSocket...@0.0.0.0:7473
14:03:48.979 [Thread-8] INFO  org.mortbay.log - Stopped SelectChann...@0.0.0.0:7474

Any thoughs?

--
You received this message because you are subscribed to the Google Groups "Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email to neo4j+un...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

tga...@gmail.com

unread,
May 17, 2013, 11:07:23 AM5/17/13
to ne...@googlegroups.com
Soory Wes, I think I might have sent an email to you but not to the rest of the list. messages.log doesn't seem to contain much more information. Here' s a snipet.
2013-05-17 13:19:29,983 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v15: 2013-05-15T08:03:10+0000 - 16.00 B
2013-05-17 13:19:29,983 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v31: 2013-05-16T10:40:36+0000 - 16.00 B
2013-05-17 13:19:29,983 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v21: 2013-05-15T08:57:13+0000 - 16.00 B
2013-05-17 13:19:29,984 DEBUG [neo4j.diagnostics]:   neostore.propertystore.db.strings: 2013-05-17T13:19:28+0000 - 3.10 MB
2013-05-17 13:19:29,985 DEBUG [neo4j.diagnostics]:   neostore.propertystore.db.index: 2013-05-17T13:19:29+0000 - 512.00 kB
2013-05-17 13:19:29,985 DEBUG [neo4j.diagnostics]:   messages.log: 2013-05-17T13:19:29+0000 - 1.89 MB
2013-05-17 13:19:29,986 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v28: 2013-05-15T13:28:36+0000 - 16.00 B
2013-05-17 13:19:29,986 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v42: 2013-05-17T11:43:29+0000 - 16.00 B
2013-05-17 13:19:29,987 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v35: 2013-05-16T11:16:41+0000 - 16.00 B
2013-05-17 13:19:29,987 DEBUG [neo4j.diagnostics]:   active_tx_log: 2013-05-14T14:10:21+0000 - 11.00 B
2013-05-17 13:19:29,987 DEBUG [neo4j.diagnostics]:   neostore.relationshiptypestore.db.names: 2013-05-17T13:19:28+0000 - 1.15 kB
2013-05-17 13:19:29,988 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v33: 2013-05-16T10:57:16+0000 - 16.00 B
2013-05-17 13:19:29,988 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v4: 2013-05-09T14:24:51+0000 - 25.00 MB
2013-05-17 13:19:29,989 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v24: 2013-05-15T12:54:07+0000 - 16.00 B
2013-05-17 13:19:29,989 DEBUG [neo4j.diagnostics]:   neostore.nodestore.db.id: 2013-05-17T13:19:28+0000 - 9.00 B
2013-05-17 13:19:29,990 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v45: 2013-05-17T13:15:38+0000 - 16.00 B
2013-05-17 13:19:29,990 DEBUG [neo4j.diagnostics]:   neostore.relationshipstore.db: 2013-05-17T13:19:28+0000 - 17.05 MB
2013-05-17 13:19:29,990 DEBUG [neo4j.diagnostics]:   neostore.propertystore.db: 2013-05-17T13:19:28+0000 - 23.92 MB
2013-05-17 13:19:29,991 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v26: 2013-05-15T13:03:55+0000 - 16.00 B
2013-05-17 13:19:29,991 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v46: 2013-05-17T13:16:59+0000 - 16.00 B
2013-05-17 13:19:29,992 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v10: 2013-05-14T14:40:14+0000 - 3.48 kB
2013-05-17 13:19:29,992 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v32: 2013-05-16T10:46:08+0000 - 16.00 B
2013-05-17 13:19:29,993 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v12: 2013-05-14T15:05:16+0000 - 16.00 B
2013-05-17 13:19:29,993 DEBUG [neo4j.diagnostics]:   neostore.nodestore.db: 2013-05-17T13:19:28+0000 - 1.49 MB
2013-05-17 13:19:29,993 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v37: 2013-05-16T11:18:53+0000 - 16.00 B
2013-05-17 13:19:29,994 DEBUG [neo4j.diagnostics]:   lock: 2013-05-17T13:19:28+0000 - 0.00 B
2013-05-17 13:19:29,994 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.1: 2013-05-17T13:19:28+0000 - 16.00 B
2013-05-17 13:19:29,995 DEBUG [neo4j.diagnostics]:   neostore: 2013-05-17T13:19:28+0000 - 54.00 B
2013-05-17 13:19:29,995 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v6: 2013-05-10T15:41:31+0000 - 25.00 MB
2013-05-17 13:19:29,995 DEBUG [neo4j.diagnostics]:   nioneo_logical.log.v27: 2013-05-15T13:07:15+0000 - 16.00 B
2013-05-17 13:19:29,996 DEBUG [neo4j.diagnostics]: --- STARTUP diagnostics for KernelDiagnostics:StoreFiles END ---
2013-05-17 13:19:29,997 INFO  [neo4j]: Started - database is now available
2013-05-17 13:19:30,002 INFO  [neo4j]: GC Monitor started.
2013-05-17 13:19:30,709 DEBUG [neo4j.diagnostics]: --- SERVER STARTUP START ---
2013-05-17 13:19:30,710 DEBUG [neo4j.diagnostics]: --- STARTUP diagnostics for org.neo4j.server.configuration.Configurator START ---
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: Server configuration:
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.database.location = /mnt/idio/graph/data/graph.db
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.address = 0.0.0.0
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.http.enabled = true
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.port = 7474
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.https.enabled = true
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.https.port = 7473
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.https.cert.location = conf/ssl/snakeoil.cert
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.https.key.location = conf/ssl/snakeoil.key
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webserver.https.keystore.location = system/keystore
2013-05-17 13:19:30,713 DEBUG [neo4j.diagnostics]: org.neo4j.server.webadmin.rrdb.location = /mnt/idio/graph/data/rrd
2013-05-17 13:19:30,714 DEBUG [neo4j.diagnostics]: org.neo4j.server.db.tuning.properties = /mnt/idio/graph/neo4j-community-1.8.2/conf/neo4j.properties
2013-05-17 13:19:30,714 DEBUG [neo4j.diagnostics]: org.neo4j.server.webadmin.management.uri = /db/manage/
2013-05-17 13:19:30,714 DEBUG [neo4j.diagnostics]: org.neo4j.server.webadmin.data.uri = /db/data/
2013-05-17 13:19:30,714 DEBUG [neo4j.diagnostics]: --- STARTUP diagnostics for org.neo4j.server.configuration.Configurator END ---
2013-05-17 13:19:30,735 DEBUG [neo4j.diagnostics]: Mounted discovery module (org.neo4j.server.rest.discovery) at: /
2013-05-17 13:19:30,803 DEBUG [neo4j.diagnostics]: Loaded server plugin "CypherPlugin" (org.neo4j.server.plugin.cypher.CypherPlugin)
2013-05-17 13:19:30,805 DEBUG [neo4j.diagnostics]:   GraphDatabaseService.execute_query: execute a query
2013-05-17 13:19:30,813 DEBUG [neo4j.diagnostics]: Loaded server plugin "GremlinPlugin" (org.neo4j.server.plugin.gremlin.GremlinPlugin)
2013-05-17 13:19:30,813 DEBUG [neo4j.diagnostics]:   GraphDatabaseService.execute_script: execute a Gremlin script with 'g' set to the Neo4jGraph and 'results' containing the results. Only results of one object type is supported.
2013-05-17 13:19:30,814 DEBUG [neo4j.diagnostics]: Mounted REST API at: /db/data/
2013-05-17 13:19:30,815 DEBUG [neo4j.diagnostics]: Mounted management API at: /db/manage/
2013-05-17 13:19:30,913 DEBUG [neo4j.diagnostics]: Mounted webadmin at: /webadmin
2013-05-17 13:19:35,481 DEBUG [neo4j.diagnostics]: Server started on: http://0.0.0.0:7474/
2013-05-17 13:19:35,482 DEBUG [neo4j.diagnostics]: --- SERVER STARTUP END ---


Furthermore, I forgot to mention that we test the deploy first in vagrant vms that mimick our servers. In the vagrant deploy everything goes fine, but when we deploy live the neo4j server displays this ' flicking' behaviour.
All the best,

Peter Neubauer

unread,
May 19, 2013, 1:12:08 PM5/19/13
to Neo4j User
Thiago,
do you have an instance where this occurs available? To me this sounds
like some form of non-neo4j problem, like file permissions or so.
Maybe the server is not able to log or something along these lines?

/peter

Cheers,

/peter neubauer

G: neubauer.peter
S: peter.neubauer
P: +46 704 106975
L: http://www.linkedin.com/in/neubauer
T: @peterneubauer

The authoritative book on graph databases - http://graphdatabases.com
Neo4j questions? Please use SO - http://stackoverflow.com/search?q=neo4j

Michael Hunger

unread,
May 19, 2013, 5:21:57 PM5/19/13
to ne...@googlegroups.com
There is also a ready made chef recipe by Pat Mulder, see: http://neo4j.org/install/linux (scroll down to the bottom)

Michael

Zsolt Pocsaji

unread,
May 20, 2013, 12:45:15 PM5/20/13
to ne...@googlegroups.com
Hi all,

I am having startup issues as well with neo4j, here's the stacktrace

Logger not configured, logging to std out instead: [INFO] Loaded neo4j tuning properties from /mnt/idio/graph/neo4j-community-1.8.2/conf/neo4j.properties
16:41:10.655 [main] INFO  neo4j.datasource - Creating new db @ /mnt/idio/graph/data/graph.db/neostore
16:41:10.761 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.nodestore.db] brickCount=0 brickSize=0b mappedMem=256b (storeSize=0b)
16:41:10.824 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.nodestore.db hit=0 miss=1 switches=0 ooe=0
16:41:10.857 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
16:41:10.861 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b)
16:41:10.862 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names hit=0 miss=0 switches=0 ooe=0
16:41:10.863 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db hit=0 miss=0 switches=0 ooe=0
16:41:10.890 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
16:41:10.891 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b)
16:41:10.892 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings] brickCount=0 brickSize=536832b mappedMem=536870912b (storeSize=128b)
16:41:10.892 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys] brickCount=0 brickSize=536864b mappedMem=536870912b (storeSize=38b)
16:41:10.894 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index] brickCount=0 brickSize=5368707b mappedMem=536870912b (storeSize=0b)
16:41:10.896 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays] brickCount=0 brickSize=536832b mappedMem=536870912b (storeSize=128b)
16:41:10.899 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db] brickCount=0 brickSize=10737408b mappedMem=1073741824b (storeSize=0b)
16:41:10.902 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshipstore.db] brickCount=0 brickSize=5368704b mappedMem=536870912b (storeSize=0b)
5/20/13 4:41:10 PM org.neo4j.server.database.Database SEVERE: Failed to start database.
5/20/13 4:41:10 PM org.neo4j.server.CommunityBootstrapper SEVERE: 
java.lang.ArithmeticException: / by zero
at org.neo4j.kernel.impl.nioneo.store.PersistenceWindowPool.setupBricks(PersistenceWindowPool.java:362)
at org.neo4j.kernel.impl.nioneo.store.PersistenceWindowPool.<init>(PersistenceWindowPool.java:107)
at org.neo4j.kernel.impl.nioneo.store.DefaultWindowPoolFactory.create(DefaultWindowPoolFactory.java:41)
at org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.loadStorage(CommonAbstractStore.java:228)
at org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.<init>(CommonAbstractStore.java:121)
at org.neo4j.kernel.impl.nioneo.store.AbstractStore.<init>(AbstractStore.java:80)
at org.neo4j.kernel.impl.nioneo.store.NodeStore.<init>(NodeStore.java:50)
at org.neo4j.kernel.impl.nioneo.store.StoreFactory.newNodeStore(StoreFactory.java:152)
at org.neo4j.kernel.impl.nioneo.store.StoreFactory.attemptNewNeoStore(StoreFactory.java:93)
at org.neo4j.kernel.impl.nioneo.store.StoreFactory.newNeoStore(StoreFactory.java:82)
at org.neo4j.kernel.impl.nioneo.store.StoreFactory.createNeoStore(StoreFactory.java:176)
at org.neo4j.kernel.impl.nioneo.store.StoreFactory.createNeoStore(StoreFactory.java:157)
at org.neo4j.kernel.impl.nioneo.xa.NeoStoreXaDataSource.<init>(NeoStoreXaDataSource.java:219)
at org.neo4j.kernel.InternalAbstractGraphDatabase.create(InternalAbstractGraphDatabase.java:457)
at org.neo4j.kernel.InternalAbstractGraphDatabase.run(InternalAbstractGraphDatabase.java:227)
at org.neo4j.kernel.EmbeddedGraphDatabase.<init>(EmbeddedGraphDatabase.java:79)
at org.neo4j.graphdb.factory.GraphDatabaseFactory$1.newDatabase(GraphDatabaseFactory.java:70)
at org.neo4j.graphdb.factory.GraphDatabaseBuilder.newGraphDatabase(GraphDatabaseBuilder.java:205)
at org.neo4j.server.database.CommunityDatabase.start(CommunityDatabase.java:55)
at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:124)
at org.neo4j.server.Bootstrapper.start(Bootstrapper.java:85)
at org.neo4j.server.Bootstrapper.main(Bootstrapper.java:49)
5/20/13 4:41:10 PM org.neo4j.server.CommunityBootstrapper SEVERE: Failed to start Neo Server on port [7474]

Zsolt Pocsaji

unread,
May 20, 2013, 12:48:10 PM5/20/13
to ne...@googlegroups.com
getting the same for sudo ./neo4j console in bin

Zsolt Pocsaji

unread,
May 20, 2013, 1:01:35 PM5/20/13
to ne...@googlegroups.com
the properties file

# Default values for the low-level graph engine
neostore.nodestore.db.mapped_memory=256
neostore.relationshipstore.db.mapped_memory=512M
neostore.propertystore.db.mapped_memory=1024M
neostore.propertystore.db.strings.mapped_memory=512M
neostore.propertystore.db.arrays.mapped_memory=512M
neostore.propertystore.db.index.keys.mapped_memory=512M
neostore.propertystore.db.index.mapped_memory=512M

# Enable this to be able to upgrade a store from 1.4 -> 1.5 or 1.4 -> 1.6
#allow_store_upgrade=true

# Enable this to specify a parser other than the default one. 1.5, 1.6, 1.7 are available
#cypher_parser_version=1.6

# Keep logical logs, helps debugging but uses more disk space, enabled for legacy reasons
# To limit space needed to store historical logs use values such as: "7 days" or "100M size"
# instead of "true"
keep_logical_logs=true

# Autoindexing

# Enable auto-indexing for nodes, default is false
node_auto_indexing=true

# The node property keys to be auto-indexed, if enabled
node_keys_indexable=id, mid

# Enable auto-indexing for relationships, default is false
# relationship_auto_indexing=true

# The relationship property keys to be auto-indexed, if enabled
# relationship_keys_indexable=uri

Zsolt Pocsaji

unread,
May 20, 2013, 1:03:54 PM5/20/13
to ne...@googlegroups.com
sorry, there was an M missing, noticed right after I pasted, here's the current error

Logger not configured, logging to std out instead: [INFO] Loaded neo4j tuning properties from /mnt/idio/graph/neo4j-community-1.8.2/conf/neo4j.properties
17:02:56.915 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names non clean shutdown detected
17:02:56.957 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
17:02:56.961 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db non clean shutdown detected
17:02:56.961 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b)
17:02:56.962 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings non clean shutdown detected
17:02:56.962 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings] brickCount=0 brickSize=536832b mappedMem=536870912b (storeSize=128b)
17:02:56.963 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys non clean shutdown detected
17:02:56.963 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys] brickCount=0 brickSize=536864b mappedMem=536870912b (storeSize=38b)
17:02:56.999 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index non clean shutdown detected
17:02:56.999 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index] brickCount=0 brickSize=5368707b mappedMem=536870912b (storeSize=0b)
17:02:57.001 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays non clean shutdown detected
17:02:57.001 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays] brickCount=0 brickSize=536832b mappedMem=536870912b (storeSize=128b)
17:02:57.010 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db non clean shutdown detected
17:02:57.010 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db] brickCount=0 brickSize=10737408b mappedMem=1073741824b (storeSize=0b)
17:02:57.037 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshipstore.db non clean shutdown detected
17:02:57.037 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshipstore.db] brickCount=0 brickSize=5368704b mappedMem=536870912b (storeSize=0b)
17:02:57.039 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.nodestore.db non clean shutdown detected
17:02:57.039 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.nodestore.db] brickCount=0 brickSize=268434b mappedMem=268435456b (storeSize=9b)
17:02:57.041 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b)
17:02:57.093 [main] INFO  neo4j.xafactory - Opened logical log [/mnt/idio/graph/data/graph.db/nioneo_logical.log.1] version=0, lastTxId=0 (clean)
17:02:57.107 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names rebuild id generator, highId=1 defragged count=0
17:02:57.113 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys rebuild id generator, highId=1 defragged count=0
17:02:57.115 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index rebuild id generator, highId=1 defragged count=0
17:02:57.118 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings rebuild id generator, highId=1 defragged count=0
17:02:57.121 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays rebuild id generator, highId=1 defragged count=0
17:02:57.124 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db rebuild id generator, highId=1 defragged count=0
17:02:57.127 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshipstore.db rebuild id generator, highId=1 defragged count=0
17:02:57.129 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.nodestore.db rebuild id generator, highId=1 defragged count=0
5/20/13 5:02:59 PM org.neo4j.server.database.Database SEVERE: Failed to start database.
5/20/13 5:02:59 PM org.neo4j.server.CommunityBootstrapper SEVERE: 
org.neo4j.kernel.lifecycle.LifecycleException: Failed to transition org.neo4j.kernel.InternalAbstractGraphDatabase$StuffToDoAfterRecovery@1f315415 from STOPPED to STARTED
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:408)
at org.neo4j.kernel.lifecycle.LifeSupport.start(LifeSupport.java:125)
at org.neo4j.kernel.InternalAbstractGraphDatabase.run(InternalAbstractGraphDatabase.java:231)
at org.neo4j.kernel.EmbeddedGraphDatabase.<init>(EmbeddedGraphDatabase.java:79)
at org.neo4j.graphdb.factory.GraphDatabaseFactory$1.newDatabase(GraphDatabaseFactory.java:70)
at org.neo4j.graphdb.factory.GraphDatabaseBuilder.newGraphDatabase(GraphDatabaseBuilder.java:205)
at org.neo4j.server.database.CommunityDatabase.start(CommunityDatabase.java:55)
at org.neo4j.server.AbstractNeoServer.start(AbstractNeoServer.java:124)
at org.neo4j.server.Bootstrapper.start(Bootstrapper.java:85)
at org.neo4j.server.Bootstrapper.main(Bootstrapper.java:49)
Caused by: org.neo4j.kernel.impl.nioneo.store.InvalidRecordException: Position[1] requested for high id[0], store is ok[true] recovery[false]
at org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.acquireWindow(CommonAbstractStore.java:453)
at org.neo4j.kernel.impl.nioneo.store.NeoStore.getRecord(NeoStore.java:460)
at org.neo4j.kernel.impl.nioneo.store.NeoStore.getRandomNumber(NeoStore.java:384)
at org.neo4j.kernel.impl.nioneo.store.NeoStore.getStoreId(NeoStore.java:368)
at org.neo4j.kernel.impl.nioneo.xa.NeoStoreXaDataSource.getStoreId(NeoStoreXaDataSource.java:327)
at org.neo4j.kernel.InternalAbstractGraphDatabase$StuffToDoAfterRecovery.start(InternalAbstractGraphDatabase.java:1404)
at org.neo4j.kernel.lifecycle.LifeSupport$LifecycleInstance.start(LifeSupport.java:402)
... 9 more
5/20/13 5:02:59 PM org.neo4j.server.CommunityBootstrapper SEVERE: Failed to start Neo Server on port [7474]

Michael Hunger

unread,
May 20, 2013, 2:32:40 PM5/20/13
to ne...@googlegroups.com
We would like to investigate your issue.

Would it be possible for your to share your graph.db/messages.log and the logical log files?

Or even better the whole graph.db directory zipped on dropbox or so?

Could you send me a link personally?

Thanks a lot

Michael

Zsolt Pocsaji

unread,
May 20, 2013, 6:15:07 PM5/20/13
to ne...@googlegroups.com
Hi Michael,

I wiped the contents of graph.db contents after the above error as my 'last' option (working on setting up db / adding data to it, so that starting from scratch was not an issue for now)

I'll try to replicate the error tomorrow and will send you the compressed graph.db contents.

Thanks,

Zsolt

Michael Hunger

unread,
May 20, 2013, 6:22:57 PM5/20/13
to ne...@googlegroups.com
Thanks !!

tga...@gmail.com

unread,
May 21, 2013, 11:35:47 AM5/21/13
to ne...@googlegroups.com
Hi Michel, I don't know if this helps but in my case, we extract the tarball at /mnt/app_name/neo4j-1.8.2-community but we set the database folder one level up the hierarchy, (e.g. /mnt/app_name/data). For some reason, I couldn ' t configure the logger to log things inside this new location and as a result we ended with two data folders (the other one at /mnt/app_name/neo4j-1.8.2-community/data , where some of the log files can be found). Do you think this could have any impact on the issue?
Best;
Thiago

Zsolt Pocsaji

unread,
Jun 19, 2013, 12:11:16 PM6/19/13
to ne...@googlegroups.com
Hi,

forwarding for the list to get coverage as well

restarted the box and gave a 

neo4j-community-1.8.2/bin/neo4j start-no-wait

now in messages.log

2013-06-19 16:02:46,505 INFO  [neo4j.txmanager]: TM opening log: /mnt/idio/graph/data/graph.db/tm_tx_log.1
2013-06-19 16:02:46,575 INFO  [neo4j.xafactory]: Non clean shutdown detected on log [/mnt/idio/graph/data/graph.db/index/lucene.log.2]. Recovery started ...
2013-06-19 16:02:46,576 INFO  [neo4j.xafactory]: [/mnt/idio/graph/data/graph.db/index/lucene.log.2] logVersion=5 with committed tx=614435

service neo4j start gives 'Neo4j Server already running with pid 17584'

but the web interface is not reachable on the box

if I just issue a service neo4j restart, it takes forever, eventually times out after 120s

I'll add more logs as I go through this

Zsolt

ps server running on 3.7gigs, that's the core of the issue. Just looking for a way to handle low memory a bit better + have a way to recover after a halt.


On 19 June 2013 16:41, Zsolt Pocsaji <zsolt....@idioplatform.com> wrote:
Hi Julian,

funnily enough, I encountered some startup errors today. The box ran out of memory, caused neo / java to die, and now I can't restart it, even with appropriate amount of memory.

The only useful log I've found was when I started with neo4j console in /bin

Starting Neo4j Server console-mode...
Logger not configured, logging to std out instead: [INFO] Loaded neo4j tuning properties from /mnt/idio/graph/neo4j-community-1.8.2/conf/neo4j.properties
15:39:19.236 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names non clean shutdown detected
15:39:19.246 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=456b)
15:39:19.256 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db non clean shutdown detected
15:39:19.261 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=55b)
15:39:19.262 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings non clean shutdown detected
15:39:19.262 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.strings] brickCount=207 brickSize=104832b mappedMem=104857600b (storeSize=21700224b)
15:39:19.263 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys non clean shutdown detected
15:39:19.263 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index.keys] brickCount=11 brickSize=26182b mappedMem=26214400b (storeSize=288002b)
15:39:19.265 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.index non clean shutdown detected
15:39:19.269 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.index] brickCount=3 brickSize=26208b mappedMem=26214400b (storeSize=78624b)
15:39:19.270 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays non clean shutdown detected
15:39:19.271 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db.arrays] brickCount=0 brickSize=52352b mappedMem=52428800b (storeSize=128b)
15:39:19.289 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.propertystore.db non clean shutdown detected
15:39:19.289 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.propertystore.db] brickCount=166 brickSize=104837b mappedMem=104857600b (storeSize=17402942b)
15:39:19.292 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.relationshipstore.db non clean shutdown detected
15:39:19.292 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.relationshipstore.db] brickCount=16 brickSize=297792b mappedMem=297795584b (storeSize=4764672b)
15:39:19.294 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore.nodestore.db non clean shutdown detected
15:39:19.299 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore.nodestore.db] brickCount=63 brickSize=15723b mappedMem=15728640b (storeSize=990549b)
15:39:19.302 [main] INFO  neo4j.neostore - /mnt/idio/graph/data/graph.db/neostore non clean shutdown detected
15:39:19.302 [main] INFO  neo4j.neostore - [/mnt/idio/graph/data/graph.db/neostore] brickCount=0 brickSize=0b mappedMem=0b (storeSize=54b)
15:39:19.320 [main] INFO  neo4j.xafactory - Non clean shutdown detected on log [/mnt/idio/graph/data/graph.db/nioneo_logical.log.2]. Recovery started ...
15:39:19.323 [main] INFO  neo4j.xafactory - [/mnt/idio/graph/data/graph.db/nioneo_logical.log.2] logVersion=5 with committed tx=260374
15:39:28.583 [main] INFO  neo4j.xafactory - [/mnt/idio/graph/data/graph.db/nioneo_logical.log.2] entries found=268892 lastEntryPos=13880880
15:39:28.584 [main] INFO  neo4j.xafactory - Opened logical log [/mnt/idio/graph/data/graph.db/nioneo_logical.log.2] version=5, lastTxId=295182 (recovered)
15:39:28.586 [main] INFO  neo4j.xafactory - XaResourceManager[/mnt/idio/graph/data/graph.db/nioneo_logical.log] sorting 2 xids
15:39:28.591 [main] INFO  neo4j.xafactory - Recovery on log [/mnt/idio/graph/data/graph.db/nioneo_logical.log.2] completed with [228254=Start[228254,xid=GlobalId[NEOKERNL|6193507203495979039|656962], BranchId[ 52 49 52 49 52 49 ],master=-1,me=-1,time=2013-06-19 15:08:51.307+0000/1371654531307], 228255=Start[228255,xid=GlobalId[NEOKERNL|-6955510643760919329|656966], BranchId[ 52 49 52 49 52 49 ],master=-1,me=-1,time=2013-06-19 15:08:54.372+0000/1371654534372]] prepared transactions found.

Zsolt


On 19 June 2013 08:57, Zsolt Pocsaji <zsolt....@idioplatform.com> wrote:
Hi Julian,

sure, sorry, I didn't follow up with the results. The aforementioned errors didn't come up later on.

The startup issues are solved now, I didn't set the file limits properly: only the soft nofile part was set, the hard nofile was missing.

Thanks,

Zsolt


On 19 June 2013 05:56, Julian Simpson <julian....@neotechnology.com> wrote:
Hi Zsolt,

How's it going with this?

I was just looking at an issue with the start scripts, that seems related to your first issue (Neo4j dying with HUP signals).  Then I realised that later in the email chain, you described an issue with your store, but never saw any logs or datastore.  If this issue is ancient history, do you mind letting me know?

Thanks,

Julian.
Julian Simpson 
Software Engineer | Neo Technology
+64221579103 | @builddoctor

Join us at GraphConnect! graphconnect.com
As a friend of Neo4j, use discount code *NEO4GC* for 25% off registration



Michael Hunger

unread,
Jun 19, 2013, 12:45:44 PM6/19/13
to ne...@googlegroups.com
Make sure that first there is no neo4j service running anymore.

E.g. by kill 17584

you can do jps (if you have the JDK installed) and check for "Bootstrapper"
and then do 

bin/neo4j console

and check that the recovery completes.

HTH

Mcihael
Cheers,

Michael

(neo4j.org) <-[:WORKS_ON]- (@mesirii) -[:TAKES_CARE_OF]-> (you) -[:WORKS_WITH]->(@Neo4j)






Reply all
Reply to author
Forward
0 new messages