OrientDB Community 2.0.3 - Losing connection to a remote database

706 views

Skip to first unread message

Ivan Jovanovic

unread,

Mar 2, 2015, 9:50:40 AM3/2/15

to orient-...@googlegroups.com

Hello everyone,

I am using a OrientDB Community 2.0.3 in my application in order to store PDF documents with some additional attached properties. Every user will have its own Vertex (class Client), each document will be represented as a Vertex (class Document), its thumbnail as well (class Thumbnail), and there will exist an "Owns" edge between between Client and Document, and "Rendition" edge between Document and Thumbnail;

When I start the application try to process a number of files (let's say 50 or 100) one by one, the application, after some time during writing the files (which appears to be random) loses connection to the database with the following error:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

The connection never recovers! This is the only message that I see, the log is empty, and the try/catch block which surrounds the code does not catch any exceptions.

I am posting the relevant code below:

private OrientGraphFactory factory;

public void initialize() {

try {

StringBuilder builder = new StringBuilder();

builder.append(SERVER_URL);

builder.append('/');

builder.append(DB_NAME);

OServerAdmin serverAdmin = new OServerAdmin(builder.toString()).connect(USERNAME, PASSWORD);

if(!serverAdmin.existsDatabase("plocal")) {

serverAdmin.createDatabase("graph", "plocal");

OrientGraphFactory factory = new OrientGraphFactory(builder.toString(), USERNAME, PASSWORD);

OrientGraphNoTx graph = factory.getNoTx();

OrientVertexType clientVertex = graph.createVertexType(CLIENT_CLASS);

OrientVertexProperty guidProperty = clientVertex.createProperty(GUID_PARAMETER, OType.STRING);

guidProperty.setMandatory(true);

guidProperty.setNotNull(true);

OrientVertexType documentVertex = graph.createVertexType(DOCUMENT_CLASS);

OrientVertexProperty documentGuidProperty = documentVertex.createProperty(GUID_PARAMETER, OType.STRING);

documentGuidProperty.setMandatory(true);

documentGuidProperty.setNotNull(false);

OrientVertexProperty filenameProperty = documentVertex.createProperty(FILENAME_PARAMETER, OType.STRING);

filenameProperty.setMandatory(true);

filenameProperty.setNotNull(true);

OrientVertexProperty creationDateProperty = documentVertex.createProperty(CREATION_DATE_PARAMETER, OType.DATETIME);

creationDateProperty.setMandatory(true);

creationDateProperty.setNotNull(true);

OrientVertexProperty descriptionProperty = documentVertex.createProperty(DESCRIPTION_PARAMETER, OType.STRING);

descriptionProperty.setMandatory(false);

descriptionProperty.setNotNull(false);

OrientVertexProperty numPagesProperty = documentVertex.createProperty(NUM_PAGES_PARAMETER, OType.INTEGER);

numPagesProperty.setMandatory(true);

numPagesProperty.setNotNull(true);

OrientVertexProperty fiscalYearProperty = documentVertex.createProperty(FISCAL_YEAR_PARAMETER, OType.STRING);

fiscalYearProperty.setMandatory(true);

fiscalYearProperty.setNotNull(true);

OrientVertexProperty categoryParameter = documentVertex.createProperty(CATEGORY_PARAMETER, OType.STRING);

categoryParameter.setMandatory(false);

categoryParameter.setNotNull(false);

OrientVertexProperty codeParameter = documentVertex.createProperty(CODE_PARAMETER, OType.STRING);

codeParameter.setMandatory(false);

codeParameter.setNotNull(false);

OrientVertexProperty clientCopyParameter = documentVertex.createProperty(CLIENT_COPY_PARAMETER, OType.BOOLEAN);

clientCopyParameter.setMandatory(true);

OrientVertexProperty taxAdministratorCopyParameter = documentVertex.createProperty(TAX_ADMINISTRATOR_COPY_PARAMETER, OType.BOOLEAN);

taxAdministratorCopyParameter.setMandatory(true);

OrientVertexProperty archiveCopyParameter = documentVertex.createProperty(ARCHIVE_COPY_PARAMETER, OType.BOOLEAN);

archiveCopyParameter.setMandatory(true);

OrientVertexProperty processedParameter = documentVertex.createProperty(PROCESSED_PARAMETER, OType.BOOLEAN);

processedParameter.setMandatory(true);

OrientVertexProperty contentParameter = documentVertex.createProperty(CONTENT_PARAMETER, OType.LINK);

contentParameter.setMandatory(true);

contentParameter.setNotNull(true);

OrientVertexType thumbnailVertex = graph.createVertexType(THUMBNAIL_CLASS);

OrientVertexProperty thumbnailContentParameter = thumbnailVertex.createProperty(CONTENT_PARAMETER, OType.LINK);

thumbnailContentParameter.setMandatory(true);

thumbnailContentParameter.setNotNull(true);

graph.createEdgeType(OWNS_EDGE);

graph.createEdgeType(RENDITION_EDGE);

graph.shutdown();

}

catch(Exception e) {

e.printStackTrace();

}

factory = new OrientGraphFactory(builder.toString(), USERNAME, PASSWORD);

ODatabaseRecordThreadLocal.INSTANCE.set(factory.getDatabase());

}

private Vertex getClientVertex(OrientGraph graph, String guid) {

Vertex clientVertex = null;

Iterable<Vertex> vertices = graph.query().has(GUID_PARAMETER, guid).vertices();

if(vertices.iterator().hasNext()) {

clientVertex = vertices.iterator().next();

}

else {

clientVertex = graph.addVertex("class:Client");

clientVertex.setProperty(GUID_PARAMETER, guid);

graph.commit();

}

return clientVertex;

}

public void writeDocument(String filename, Date dateCreated, String category, String guid, byte[] contents, int pageCount, String description, String code, String fiscalYear, boolean

taxAdministratorsCopy, boolean clientsCopy, boolean archivesCopy, boolean processed) {

OrientGraph graph = factory.getTx();

try {
Vertex clientVertex = getClientVertex(graph, guid);

OrientVertex documentVertex = graph.addVertex("class:Document");
documentVertex.setProperty(FILENAME_PARAMETER, filename);
documentVertex.setProperty(GUID_PARAMETER, guid);
documentVertex.setProperty(CREATION_DATE_PARAMETER, dateCreated);

if(description != null) {
documentVertex.setProperty(DESCRIPTION_PARAMETER, description);
}

documentVertex.setProperty(NUM_PAGES_PARAMETER, pageCount);
documentVertex.setProperty(FISCAL_YEAR_PARAMETER, fiscalYear);

if(category != null) {
documentVertex.setProperty(CATEGORY_PARAMETER, category);
}

if(code != null) {
documentVertex.setProperty(CODE_PARAMETER, code);
}

documentVertex.setProperty(TAX_ADMINISTRATOR_COPY_PARAMETER, taxAdministratorsCopy);
documentVertex.setProperty(CLIENT_COPY_PARAMETER, clientsCopy);
documentVertex.setProperty(ARCHIVE_COPY_PARAMETER, archivesCopy);
documentVertex.setProperty(PROCESSED_PARAMETER, processed);

ORecordBytes record = new ORecordBytes(contents);
record.save();
documentVertex.setProperty(CONTENT_PARAMETER, record.getIdentity());

Object id = documentVertex.getId();
documentVertex = graph.getVertex(id);

graph.addEdge("class:E", clientVertex, documentVertex, OWNS_EDGE);

// Thumbnail generation code...

OrientVertex thumbnailVertex = graph.addVertex("class:Thumbnail");
ORecordBytes thumbnailRecord = new ORecordBytes(thumbnail);
thumbnailRecord.save();
thumbnailVertex.setProperty(CONTENT_PARAMETER, thumbnailRecord.getIdentity());

Object thumbnailId = thumbnailVertex.getId();
thumbnailVertex = graph.getVertex(thumbnailId);

graph.addEdge("class:E", documentVertex, thumbnailVertex, RENDITION_EDGE);
}
catch(Exception e) {
e.printStackTrace();
}

graph.shutdown();
}

What am I doing wrong here?

Many thanks for your help, it is much appreciated.

Ivan

Emanuel

unread,

Mar 2, 2015, 10:30:52 AM3/2/15

to orient-...@googlegroups.com

Hi,

Do you see anything on the server log ?
Your session may be killed if something wrong happen server side.

bye
Emanuel

--

---
You received this message because you are subscribed to the Google Groups "OrientDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to orient-databa...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Ivan Jovanovic

unread,

Mar 2, 2015, 11:02:58 AM3/2/15

to orient-...@googlegroups.com

Hi Emanuel,

Thanks for your reply. Unfortunately not, the server log contains nothing useful that I could use to determine what the problem is:

2015-03-02 08:35:44:202 INFO OrientDB auto-config DISKCACHE=5,582MB (heap=455MB os=8,086MB disk=861,714MB) [orientechnologies]

2015-03-02 08:35:44:204 INFO Loading configuration from: D:/OrientDB/config/orientdb-server-config.xml... [OServerConfigurationLoaderXml]

2015-03-02 08:35:44:308 INFO OrientDB Server v2.0.3 (build UNKNOWN@r${buildNumber}; 2015-02-19 23:40:05+0000) is starting up... [OServer]

2015-03-02 08:35:44:319 INFO Databases directory: D:\OrientDB\databases [OServer]

2015-03-02 08:35:44:341 INFO Listening binary connections on 0.0.0.0:2424 (protocol v.28, socket=default) [OServerNetworkListener]

2015-03-02 08:35:44:341 INFO Listening http connections on 0.0.0.0:2480 (protocol v.10, socket=default) [OServerNetworkListener]

2015-03-02 08:35:44:349 INFO Installing dynamic plugin 'orientdb-lucene-2.0.3-dist.jar'... [OServerPluginManager]

2015-03-02 08:35:44:400 INFO Lucene index plugin installed and active. Lucene version: LUCENE_47 [OLuceneIndexPlugin]

2015-03-02 08:35:44:401 INFO Installing dynamic plugin 'studio-2.0.zip'... [OServerPluginManager]

2015-03-02 08:35:44:414 INFO Installing GREMLIN language v.2.6.0 - graph.pool.max=50 [OGraphServerHandler]

2015-03-02 08:35:44:414 INFO [OVariableParser.resolveVariables] Error on resolving property: distributed [orientechnologies]

2015-03-02 08:35:44:415 INFO Installing Script interpreter. WARN: authenticated clients can execute any kind of code into the server by using the following allowed languages: [sql] [OServerSideScriptInterpreter]

2015-03-02 08:35:44:416 INFO OrientDB Server v2.0.3 is active. [OServer]

2015-03-02 09:05:18:612 SEVERE Internal server error:

com.orientechnologies.orient.core.exception.OQueryParsingException: Error on parsing query at position #8: Error on parsing query

Query: _studio where type = 'Bookmark' order by name

-------------^

--> com.orientechnologies.orient.core.exception.OCommandExecutionException: Class '_STUDIO' was not found in current database [ONetworkProtocolHttpDb]

2015-03-02 09:49:25:083 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 09:51:26:071 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 09:53:29:329 SEVERE Internal server error:

com.orientechnologies.orient.core.exception.OQueryParsingException: Error on parsing query at position #8: Error on parsing query

Query: _studio where type = 'Bookmark' order by name

-------------^

--> com.orientechnologies.orient.core.exception.OCommandExecutionException: Class '_STUDIO' was not found in current database [ONetworkProtocolHttpDb]

2015-03-02 09:54:28:703 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 10:00:28:352 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 10:03:21:366 SEVERE Internal server error:

com.orientechnologies.orient.core.exception.OQueryParsingException: Error on parsing query at position #8: Error on parsing query

Query: _studio where type = 'Bookmark' order by name

-------------^

--> com.orientechnologies.orient.core.exception.OCommandExecutionException: Class '_STUDIO' was not found in current database [ONetworkProtocolHttpDb]

2015-03-02 10:06:53:048 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 10:28:40:195 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 10:51:24:907 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:01:08:657 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:11:09:096 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:23:23:730 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:32:06:644 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:41:49:432 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 11:59:45:980 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 12:37:45:229 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 12:48:11:563 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 14:23:27:520 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 14:23:27:521 INFO {db=attachments} Created database 'attachments' of type 'plocal' [ONetworkProtocolBinary]

2015-03-02 14:23:42:955 INFO Received signal: SIGINT [OSignalHandler]

2015-03-02 14:23:42:955 INFO OrientDB Server is shutting down... [OServer]

Those multiple creations of database 'attachments' is me dropping the database and starting from the scratch.

Cheers,

Ivan

Ivan Jovanovic

unread,

Mar 4, 2015, 3:09:25 AM3/4/15

to orient-...@googlegroups.com

By trying to dissect the problem and see what is causing it I was trying different things.

My application, after each writing of a document, it reads from the database to extract the document information and their counts. If I turn off this reading the document information everything works just like fine.

The relevant code:

private DocumentCounts extractDocumentCounts(String guid, String taxYear, String[] categories) {

int allDocuments = 0;

Map<String, Integer> categoryDocuments = new HashMap<String, Integer>();

try {

for(int i = 0; i < categories.length; i++) {

StringBuilder builder = new StringBuilder();

builder.append("SELECT COUNT(*) FROM ");

builder.append(DOCUMENT_CLASS);

builder.append(" WHERE guid='");

builder.append(guid);

builder.append("' AND fiscalyear='");

builder.append(taxYear);

builder.append("' AND category LIKE '%");

builder.append(categories[i]);

builder.append("%'");

List<ODocument> resultList = factory.getDatabase().command(new OCommandSQL(builder.toString())).execute();

Long result = resultList.get(0).field("COUNT");

categoryDocuments.put(categories[i], result.intValue());

}

StringBuilder builder = new StringBuilder();

builder.append("SELECT COUNT(*) FROM ");

builder.append(DOCUMENT_CLASS);

builder.append(" WHERE guid='");

builder.append(guid);

builder.append("' AND fiscalyear='");

builder.append(taxYear);

builder.append("'");

List<ODocument> resultList = factory.getDatabase().command(new OCommandSQL(builder.toString())).execute();

Long result = resultList.get(0).field("COUNT");

allDocuments = result.intValue();

}

catch(Exception e) {

e.printStackTrace();

}

return new DocumentCounts(allDocuments, categoryDocuments);

}

So, somehow, this reading from a database right after something has been written somehow causes this problem (that I am unable to solve).

Anybody has any idea how can I solve this?

Thanks,

Ivan

Ivan Jovanovic

unread,

Mar 5, 2015, 4:44:16 AM3/5/15

to orient-...@googlegroups.com

I have updated to OrientDB 2.0.4 Community Edition and the problem that I am experiencing is still there.

I also did some application profiling to see what is happening. When the application gets stuck, i.e. remote connection to database has been lost, the stack trace from the OrientDB Async Client looks like this:

OrientDB <- Asynch Client (/127.0.0.1:2424) [RUNNABLE, IN_NATIVE] [DAEMON]

java.io.DataInputStream.readByte()

com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte() OChannelBinary.java:73

com.orientechnologies.orient.enterprise.channel.binary.OChannelBinaryAsynchClient.beginResponse(int, long, boolean) OChannelBinaryAsynchClient.java:200

com.orientechnologies.orient.enterprise.channel.binary.OAsynchChannelServiceThread.execute() OAsynchChannelServiceThread.java:50

com.orientechnologies.common.thread.OSoftThread.run() OSoftThread.java:69

Does anyone have any idea how can I overcome this?

Please and thank you,

Ivan

Ivan Jovanovic

unread,

Mar 16, 2015, 4:15:47 AM3/16/15

to orient-...@googlegroups.com

Updated to OrientDB Community Edition 2.0.5, I am still having the same issue.

Any ideas what is up?

Thanks,

Ivan

Colin

unread,

Mar 16, 2015, 11:05:15 AM3/16/15

to orient-...@googlegroups.com

Hi Ivan,

Sorry to see you're still having issues with this.

When you get that "trying to reconnect" warning has the client connection been idle at all during that time? I believe you said that this happens randomly during a write, correct?

How long does each call to writeDocument typically take to complete?

Also, try adding a call to graph.commit() in writeDocument(). I'm curious if that makes any difference or throws a different exception.

I'm assuming your reconnect warning appears when graph.shutdown() is called. However, it would be helpful if you could isolate what's being called in writeDocument() when this occurs.

Thanks,

-Colin

Orient Technologies

The Company behind OrientDB

Ivan Jovanovic

unread,

Mar 16, 2015, 12:23:21 PM3/16/15

to orient-...@googlegroups.com

Hi Colin,

Thank you for your reply!

When I get this message (Caught I/O errors, trying to reconnect), the connection idles, to be more precise, it does never reconnect. As I was able to determine from testing the code many times, the application loses connection mostly on read operations after write operation have completed.

To complete writeDocument call application takes, on average, 400ms.

I have tried adding graph.commit() now to writeDocument; (I have read on somewhere that if autoStartTx is true, the graph will automatically commit before shutdown, that's why I have left it out in the first place). After I added commit() I performed a couple of tests and I get different exceptions on different runs. Before, when commit(), connection was usually lost without any exception at all.

I have tested the code 7 times, each time trying to write 50 documents.

1. run: Connection lost while executing this block, with just a message (WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)):

StringBuilder builder = new StringBuilder();

builder.append("SELECT COUNT(*) FROM ");

builder.append(DOCUMENT_CLASS);

builder.append(" WHERE guid='");

builder.append(guid);

builder.append("' AND fiscalyear='");

builder.append(taxYear);

builder.append("'");

List<ODocument> resultList = factory.getDatabase().command(new OCommandSQL(builder.toString())).execute();

2. run: Connection lost while executing this block, wit an exception:

StringBuilder builder = new StringBuilder();

builder.append("SELECT COUNT(*) FROM ");

builder.append(DOCUMENT_CLASS);

builder.append(" WHERE guid='");

builder.append(guid);

builder.append("' AND fiscalyear='");

builder.append(taxYear);

builder.append("' AND category LIKE '%");

builder.append(categories[i]);

builder.append("%'");

List<ODocument> resultList = factory.getDatabase().command(new OCommandSQL(builder.toString())).execute();

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a

connection to remote server: 127.0.0.1:2424/attachments)

com.google.common.util.concurrent.UncheckedExecutionException: com.orientechnologies.orient.core.exception.OStorageException:

Cannot create a connection to remote server because url list is empty

Caused by: com.orientechnologies.orient.core.exception.OStorageException: Cannot create a connection to remote server because

url list is empty

at com.orientechnologies.orient.client.remote.OStorageRemote.getCurrentServerURL(OStorageRemote.java:1826)

at com.orientechnologies.orient.client.remote.OStorageRemote.openRemoteDatabase(OStorageRemote.java:1592)

at com.orientechnologies.orient.client.remote.OStorageRemote.open(OStorageRemote.java:211)

at com.orientechnologies.orient.client.remote.OStorageRemoteThread.open(OStorageRemoteThread.java:87)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.open(ODatabaseDocumentTx.java:243)

at com.tinkerpop.blueprints.impls.orient.OrientGraphFactory.getDatabase(OrientGraphFactory.java:132)

at com.tinkerpop.blueprints.impls.orient.OrientGraphFactory.getDatabase(OrientGraphFactory.java:111)

at com.tinkerpop.blueprints.impls.orient.OrientGraphFactory.getTx(OrientGraphFactory.java:71)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$2.load

(OrientDBDocumentManager.java:228)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$2.load(OrientDBDocumentManager.java:1)

at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3527)

at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2319)

at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2282)

at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2197)

3. run: Connection lost on graph.shutdown() with an exception:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

com.orientechnologies.orient.core.exception.ODatabaseException: Error on retrieving record #3:5 (cluster: default)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1605)

at com.orientechnologies.orient.core.tx.OTransactionOptimistic.loadRecord(OTransactionOptimistic.java:226)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:1424)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:117)

at com.orientechnologies.orient.core.record.impl.ODocument.field(ODocument.java:858)

at com.tinkerpop.blueprints.impls.orient.OrientElement.getProperty(OrientElement.java:251)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.getThumbnail(OrientDBDocumentManager.java:1370)

at ch.ringler.attachment.mgm.mediator.internal.DocumentManagerMediatorImpl.getThumbnail(DocumentManagerMediatorImpl.java:112)

at ch.ringler.attachment.mgm.module.window.swing.ModuleWindow$ThumbnailLoaderWorker.doInBackground(ModuleWindow.java:919)

at ch.ringler.attachment.mgm.module.window.swing.ModuleWindow$ThumbnailLoaderWorker.doInBackground(ModuleWindow.java:1)

at javax.swing.SwingWorker$1.call(Unknown Source)

at java.util.concurrent.FutureTask.run(Unknown Source)

at javax.swing.SwingWorker.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

Caused by: com.orientechnologies.orient.core.exception.OStorageException: Error on read record #3:5

at com.orientechnologies.orient.client.remote.OStorageRemote.handleException(OStorageRemote.java:1506)

at com.orientechnologies.orient.client.remote.OStorageRemote.readRecord(OStorageRemote.java:522)

at com.orientechnologies.orient.client.remote.OStorageRemoteThread.readRecord(OStorageRemoteThread.java:253)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1572)

... 15 more

Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 1

at java.util.ArrayList.rangeCheck(Unknown Source)

at java.util.ArrayList.get(Unknown Source)

at com.orientechnologies.orient.client.remote.OStorageRemote.getCurrentServerURL(OStorageRemote.java:1829)

at com.orientechnologies.orient.client.remote.OStorageRemote.beginRequest(OStorageRemote.java:1811)

at com.orientechnologies.orient.client.remote.OStorageRemote.readRecord(OStorageRemote.java:478)

... 17 more

4. run: Connection lost on the same block as with the 2. run, this time without any message nor exception

5. run: Competed successfully, without losing connection and exceptions!

6. run: Identical to 4. run, connection lost without any information

7. run: Connection lost on graph.shutdown(), with exception:

SCHWERWIEGEND: Exception during commit of active transaction.

com.orientechnologies.orient.core.exception.OStorageException: Error on commit

at com.orientechnologies.orient.client.remote.OStorageRemote.handleException(OStorageRemote.java:1506)

at com.orientechnologies.orient.client.remote.OStorageRemote.commit(OStorageRemote.java:1176)

at com.orientechnologies.orient.client.remote.OStorageRemoteThread.commit(OStorageRemoteThread.java:445)

at com.orientechnologies.orient.core.tx.OTransactionOptimistic.doCommit(OTransactionOptimistic.java:470)

at com.orientechnologies.orient.core.tx.OTransactionOptimistic.commit(OTransactionOptimistic.java:147)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.commit(ODatabaseDocumentTx.java:2376)

at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.close(ODatabaseDocumentTx.java:1062)

at com.tinkerpop.blueprints.impls.orient.OrientBaseGraph.shutdown(OrientBaseGraph.java:1152)

at com.tinkerpop.blueprints.impls.orient.OrientBaseGraph.shutdown(OrientBaseGraph.java:1124)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.getThumbnail(OrientDBDocumentManager.java:1378)

at ch.ringler.attachment.mgm.mediator.internal.DocumentManagerMediatorImpl.getThumbnail(DocumentManagerMediatorImpl.java:112)

at ch.ringler.attachment.mgm.module.window.swing.ModuleWindow$ThumbnailLoaderWorker.doInBackground(ModuleWindow.java:919)

at ch.ringler.attachment.mgm.module.window.swing.ModuleWindow$ThumbnailLoaderWorker.doInBackground(ModuleWindow.java:1)

at javax.swing.SwingWorker$1.call(Unknown Source)

at java.util.concurrent.FutureTask.run(Unknown Source)

at javax.swing.SwingWorker.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 1

at java.util.ArrayList.rangeCheck(Unknown Source)

at java.util.ArrayList.get(Unknown Source)

at com.orientechnologies.orient.client.remote.OStorageRemote.getCurrentServerURL(OStorageRemote.java:1829)

at com.orientechnologies.orient.client.remote.OStorageRemote.beginRequest(OStorageRemote.java:1811)

at com.orientechnologies.orient.client.remote.OStorageRemote.commit(OStorageRemote.java:1087)

... 17 more

What else can I try?

In the stack traces of these exceptions there are methods that I have not mentioned before here, they usually just read from vertices in a graph. If it is needed, I can post that code as well.

Thanks again,

Ivan

Colin

unread,

Mar 16, 2015, 5:23:09 PM3/16/15

to orient-...@googlegroups.com

Hi Ivan,

Thanks for the very thorough test.

You stated "I was able to determine from testing the code many times, the application loses connection mostly on read operations after write operation have completed.", yet in your tests it seems to happen from within the writeDocument() method. Am I misunderstanding this?

(You are correct that on the call to graph.shutdown() it will call commit(). I had you call it explicitly so that we could capture any exception when it actually attempted to write to the database.)

When this error occurs, do you have to restart the server in order to get the application to work, or do you just re-start the application?

When this error occurs, would you mind trying to connect remotely using the console and see if it communicates successfully? (I'm assuming it will.)

Thanks,

-Colin

Orient Technologies

The Company behind OrientDB

Ivan Jovanovic

unread,

Mar 17, 2015, 4:28:31 AM3/17/15

to orient-...@googlegroups.com

Hello Colin,

Thanks again for your reply, and for the clarification about the graph.commit() method.

By examining stack traces of these exceptions that I got I can tell that all of them come from reading operations after a write:

- In the 1. run connection is lost when the application is obtaining the total number of documents.

- In the 2. run exception is thrown when the application is refreshing a document list after a write and loading the first document (ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$2.load(OrientDBDocumentManager.java:1)).

- In the 3. run exception is thrown when the application is refreshing a document list after a write and loading document thumbnails (ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.getThumbnail(OrientDBDocumentManager.java:1370))

- In the 4. run no information is available

- 5. run completed successdully

- In the 6. run no information is available

- In the 7. run exception is thrown when the application is refreshing a document list after a write and loading document thumbnails (ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.getThumbnail(OrientDBDocumentManager.java:1378))

My opinion, that this happens only while performing reading after writing, is backed up by the fact that everything will work like charm if I temporary disable refreshing a document list, loading of thumbnails and extracting the document counts, and leave just the writing part. I was able, from the application, to upload 500 documents in one go, without any problems...

When this error occurs, there are no related information available in the server logs and I do not need to restart the server, only the application.

And yes, indeed, I was able to connect to a database from a console after a connection has been lost from the application.

Cheers and thanks,

Ivan

Colin

unread,

Mar 17, 2015, 3:09:16 PM3/17/15

to orient-...@googlegroups.com

Hi Ivan,

Thanks, again, for the very precise and detailed reply.

Let's try an experiment for the writing and the reading, would you mind replacing the factory calls to factory.getTx()with the non-factory version:

new OrientGraph(url, user, password)

Please let me know if that changes anything.

Thanks for your patience.

-Colin

Orient Technologies

The Company behind OrientDB

Ivan Jovanovic

unread,

Mar 18, 2015, 10:10:59 AM3/18/15

to orient-...@googlegroups.com

Hi Colin,

That's the least I can do. Thank you for your replies, and for your help and for your time!

I have tried replacing factory.getTx() with directly instantiating an OrientGraph every time that I need it and repeating experiments from yesterday (7 runs, each time uploading 50 documents). Each of these 7 runs completed successfully, without losing connection, which is a move in the right direction. Before, I was able to achieve to upload 50 documents in one go, once or twice in a month period.

For this to work I had, also, to change a call List<ODocument> resultList = factory.getDatabase().command(new OCommandSQL(builder.toString())).execute(); with a call: List<ODocument> resultList = graph.getRawGraph().command(new OCommandSQL(builder.toString())).execute();

However, I tried up-scaling my tests to 500 documents in one go (a test that worked like charm when I turn off reading after writing) and I got different results. The number of documents that I was able to upload in one go has vastly improved when I instantiate a graph instead of getting one from factory, but still I was not able to complete the task. For example, on average, before, the connection was lost after uploading 25-30 documents.

First, I tried without graph.commit(); that we have added yesterday, and below I present to you the result of these tests:

1. run (successfully uploaded 295 documents): Connection lost, without an exception:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

2. run (successfully uploaded 295 documents): Connection lost, with an exception:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

com.orientechnologies.orient.core.exception.OStorageException: Error on executing command: sql.SELECT COUNT(*) FROM Document

WHERE guid='drtax-820a02fc-b450-4ce8-8218-36368f1baec9' AND fiscalyear='2014'

at com.orientechnologies.orient.client.remote.OStorageRemote.handleException(OStorageRemote.java:1580)

at com.orientechnologies.orient.client.remote.OStorageRemote.command(OStorageRemote.java:1064)

at com.orientechnologies.orient.client.remote.OStorageRemoteThread.command(OStorageRemoteThread.java:436)

at com.orientechnologies.orient.core.command.OCommandRequestTextAbstract.execute(OCommandRequestTextAbstract.java:63)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.extractDocumentCounts

(OrientDBDocumentManager.java:1248)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.access$15

(OrientDBDocumentManager.java:1212)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$11.call

(OrientDBDocumentManager.java:1280)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$11.call

(OrientDBDocumentManager.java:1)

at java.util.concurrent.FutureTask.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

3. run (successfully uploaded 330 documents): Connection lost with an exception:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

com.orientechnologies.orient.core.exception.OStorageException: Error on executing command: sql.SELECT COUNT(*) FROM Document WHERE guid='drtax-820a02fc-b450-4ce8-8218-36368f1baec9' AND fiscalyear='2014'

at com.orientechnologies.orient.client.remote.OStorageRemote.handleException(OStorageRemote.java:1580)

at com.orientechnologies.orient.client.remote.OStorageRemote.command(OStorageRemote.java:1064)

at com.orientechnologies.orient.client.remote.OStorageRemoteThread.command(OStorageRemoteThread.java:436)

at com.orientechnologies.orient.core.command.OCommandRequestTextAbstract.execute(OCommandRequestTextAbstract.java:63)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.extractDocumentCounts

(OrientDBDocumentManager.java:1248)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager.access$15

(OrientDBDocumentManager.java:1212)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$11.call

(OrientDBDocumentManager.java:1280)

at ch.ringler.attachment.mgm.document.manager.internal.OrientDBDocumentManager$11.call

(OrientDBDocumentManager.java:1)

at java.util.concurrent.FutureTask.run(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)

at java.lang.Thread.run(Unknown Source)

4. run (successfully uploaded 75 documents): Connection lost with an error:

WARNUNG: Caught I/O errors, trying to reconnect (error: com.orientechnologies.common.io.OIOException: Cannot open a connection to remote server: 127.0.0.1:2424/attachments)

Mär 18, 2015 12:39:23 PM com.orientechnologies.common.log.OLogManager log