Issue:
At some unpredictable point in time, my application suddenly start consuming a lot of memory, leading to memory issues.
It's so strange. My application in general terms turns an XML into a graph. There are several files that represent a particular version, for each one I read the nodes and save as vertices. Hierarchy and explicitly defined relationships are stored as edges. It starts ok, with a reasonable processing time. Let's say that it takes from 5 to 15 minutes to process a file.
Then the problem appears without no apparent reason. I file takes 1,5 hours to process and the next throws Out of Memory after 3 or 4 hours. Right now I have one which is running for more than two hours(why?).
I made almost every tuning described at the site, apart from defining the vertex classes before hand. I don't want to control the schema, so I didn't go through this point.
I can share my application if you want, but it's not open so I can't post in the group. If you have a Bitbucket it would be easier to share.
OrientDB version: 2.0.5
Enviromnent: Amazon EC2, m3 large, with Amazon AMI
Software configuration: tried plocal and remote, both throws Out of Memory. Apart from the server script, I have increased the socket timeout.
Server config:
LOG_FILE=$ORIENTDB_HOME/config/orientdb-server-log.properties
WWW_PATH=$ORIENTDB_HOME/www
ORIENTDB_SETTINGS="-Dprofiler.enabled=true"
JAVA_OPTS_SCRIPT="-Djna.nosys=true -XX:+UseConcMarkSweepGC -Djava.awt.headless=true -Dfile.encoding=UTF8 -Drhino.opt.level=9"
# ORIENTDB MAXIMUM HEAP. USE SYNTAX -Xmx<memory>, WHERE <memory> HAS THE TOTAL MEMORY AND SIZE UNIT. EXAMPLE: -Xmx512m
MAXHEAP=-Xmx4096m
# ORIENTDB MAXIMUM DISKCACHE IN MB, EXAMPLE, ENTER -Dstorage.diskCache.bufferSize=8192 FOR 8GB
MAXDISKCACHE=-Dstorage.diskCache.bufferSize=8192
exec "$JAVA" $JAVA_OPTS $MAXHEAP $JAVA_OPTS_SCRIPT $ORIENTDB_SETTINGS $MAXDISKCACHE -Djava.util.logging.config.file="$LOG_FILE" -Dorientdb.config.file="$CONFIG_FILE" -Dorientdb.www.path="$WWW_PATH" -Dorientdb.build.number="UNKNOWN@r${buildNumber}; 2015-03-12 22:59:10+0000" -cp "$ORIENTDB_HOME/lib/orientdb-server-2.0.5.jar:$ORIENTDB_HOME/lib/*" $* com.orientechnologies.orient.server.OServerMain