Datasource configuration JBoss and Oracle

2,112 views

Skip to first unread message

l.rie...@gmail.com

unread,

Aug 11, 2014, 7:22:25 AM8/11/14

to camunda-...@googlegroups.com

Hi all,

i am experiencing an issue with the database connection.

It's probably not a camunda but a datasource configuration issue.

When the JBoss server is up for some days, the following error regularly occurs.
After that camunda can't acquire a connection.
I am using camunda 7.1.0-Final's preconfigured jboss distribution.

06:05:02,170 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac186078:-550ddfb2:53e3a0b6:5f594 in state RUN
06:05:02,172 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012095: Abort of action id 0:ffffac186078:-550ddfb2:53e3a0b6:5f594 invoked while multiple threads active within it.
06:05:02,173 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012108: CheckedAction::check - atomic action 0:ffffac186078:-550ddfb2:53e3a0b6:5f594 aborting with 1 threads active!
06:05:02,208 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffffac186078:-550ddfb2:53e3a0b6:5f594
06:05:25,898 WARN [com.arjuna.ats.arjuna] (job-executor-tp-threads - 37) ARJUNA012077: Abort called on already aborted atomic action 0:ffffac186078:-550ddfb2:53e3a0b6:5f594
06:05:25,899 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 37) Exception while executing job with id a360ee54-1f79-11e4-aebf-b8ba20524153: org.camunda.bpm.engine.OptimisticLockingException: MessageEntity[a360ee54-1f79-11e4-aebf-b8ba20524153] was updated by another transaction concurrently
at org.camunda.bpm.engine.impl.db.DbSqlSession$DeletePersistentObjectOperation.execute(DbSqlSession.java:254) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.flushDeletes(DbSqlSession.java:723) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.flush(DbSqlSession.java:490) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContext.flushSessions(CommandContext.java:196) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:126) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:99) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]

06:05:25,955 WARN [com.arjuna.ats.jta] (job-executor-tp-threads - 37) ARJUNA016061: TransactionImple.enlistResource - XAResource.start returned: XAException.XAER_PROTO for < formatId=131077, gtrid_length=29, bqual_length=36, tx_uid=0:ffffac186078:-550ddfb2:53e3a0b6:5f751, node_name=1, branch_uid=0:ffffac186078:-550ddfb2:53e3a0b6:5f753, subordinatenodename=null, eis_name=java:jboss/datasources/ProcessEngine >: oracle.jdbc.xa.OracleXAException
at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1110)
at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:240)
at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)
at org.jboss.jca.core.tx.jbossts.XAResourceWrapperImpl.start(XAResourceWrapperImpl.java:191)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:636)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:397)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:587)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:264)
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)
at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)
at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:59)
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectOne(DbSqlSession.java:323) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findJobById(JobManager.java:102) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.cmd.ExecuteJobsCmd.execute(ExecuteJobsCmd.java:54) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]

06:05:25,996 ERROR [stderr] (job-executor-tp-threads - 37) oracle.jdbc.xa.OracleXAException

06:05:25,997 ERROR [stderr] (job-executor-tp-threads - 37) at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1110)

06:05:25,998 ERROR [stderr] (job-executor-tp-threads - 37) at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:240)

06:05:25,998 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)

06:05:25,999 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.tx.jbossts.XAResourceWrapperImpl.start(XAResourceWrapperImpl.java:191)

06:05:26,000 ERROR [stderr] (job-executor-tp-threads - 37) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:636)

06:05:26,001 ERROR [stderr] (job-executor-tp-threads - 37) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:397)

06:05:26,002 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:587)

06:05:26,003 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:264)

06:05:26,003 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)

06:05:26,003 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)

06:05:26,004 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)

06:05:26,004 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)

06:05:26,005 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)

06:05:26,005 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)

06:05:26,006 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)

06:05:26,010 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)

06:05:26,011 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)

06:05:26,011 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)

06:05:26,011 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)

06:05:26,012 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)

06:05:26,012 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)

06:05:26,013 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)

06:05:26,014 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)

06:05:26,014 ERROR [stderr] (job-executor-tp-threads - 37) at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:59)

06:05:26,015 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.db.DbSqlSession.selectOne(DbSqlSession.java:323)

06:05:26,016 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findJobById(JobManager.java:102)

06:05:26,016 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.cmd.ExecuteJobsCmd.execute(ExecuteJobsCmd.java:54)

06:05:26,017 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24)

06:05:26,018 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90)

06:05:26,018 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59)

06:05:26,019 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32)

06:05:26,019 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79)

06:05:26,020 ERROR [stderr] (job-executor-tp-threads - 37) at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67)

06:05:26,021 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33)

06:05:26,021 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806)

06:05:26,022 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45)

06:05:26,023 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847)

06:05:26,024 ERROR [stderr] (job-executor-tp-threads - 37) at java.lang.Thread.run(Thread.java:745)

06:05:26,024 ERROR [stderr] (job-executor-tp-threads - 37) at org.jboss.threads.JBossThread.run(JBossThread.java:122)

06:05:26,070 SEVERE [org.camunda.bpm.engine.impl.interceptor.CommandContext] (job-executor-tp-threads - 37) Error while closing command context: org.apache.ibatis.exceptions.PersistenceException:
### Error querying database. Cause: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
### The error may exist in org/camunda/bpm/engine/impl/mapping/entity/Job.xml
### The error may involve org.camunda.bpm.engine.impl.persistence.entity.JobEntity.selectJob
### The error occurred while executing a query
### Cause: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:23)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:104)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:59)
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectOne(DbSqlSession.java:323) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findJobById(JobManager.java:102) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.cmd.ExecuteJobsCmd.execute(ExecuteJobsCmd.java:54) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:147)
at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)
at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)
... 17 more
Caused by: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:604)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)
... 27 more
Caused by: javax.resource.ResourceException: IJ000461: Could not enlist in transaction on entering meta-aware object
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:474)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)
... 29 more
Caused by: javax.transaction.SystemException: IJ000356: Failed to enlist: java.lang.Throwable: Unabled to enlist resource, see the previous warnings. tx=TransactionImple < ac, BasicAction: 0:ffffac186078:-550ddfb2:53e3a0b6:5f751 status: ActionStatus.ABORT_ONLY >
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.checkEnlisted(TxConnectionListener.java:552)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:282)
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)
... 30 more

06:05:26,107 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 37) Exception while executing job with id 3d8a43dd-1f7a-11e4-aebf-b8ba20524153: org.camunda.bpm.engine.ProcessEngineException: Process engine persistence exception
at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:170) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:99) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
Caused by: org.apache.ibatis.exceptions.PersistenceException:
### Error querying database. Cause: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
### The error may exist in org/camunda/bpm/engine/impl/mapping/entity/Job.xml
### The error may involve org.camunda.bpm.engine.impl.persistence.entity.JobEntity.selectJob
### The error occurred while executing a query
### Cause: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:23)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:104)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:59)
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectOne(DbSqlSession.java:323) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findJobById(JobManager.java:102) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.cmd.ExecuteJobsCmd.execute(ExecuteJobsCmd.java:54) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
... 10 more
Caused by: java.sql.SQLException: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:147)
at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)
at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)
... 17 more
Caused by: javax.resource.ResourceException: IJ000457: Unchecked throwable in managedConnectionReconnected() cl=org.jboss.jca.core.connectionmanager.listener.TxConnectionListener@3dd7e196[state=NORMAL managed connection=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 connection handles=0 lastUse=1407557126053 trackByTx=false pool=org.jboss.jca.core.connectionmanager.pool.strategy.OnePool@65e0d777 pool internal context=SemaphoreArrayListManagedConnectionPool@62ae51e0[pool=ProcessEngine] xaResource=XAResourceWrapperImpl@c61f9e2[xaResource=org.jboss.jca.adapters.jdbc.xa.XAManagedConnection@281b5e92 pad=false overrideRmValue=false productName=Oracle productVersion=Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options jndiName=java:jboss/datasources/ProcessEngine] txSync=null]
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:604)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)
... 27 more
Caused by: javax.resource.ResourceException: IJ000461: Could not enlist in transaction on entering meta-aware object
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:474)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)
... 29 more
Caused by: javax.transaction.SystemException: IJ000356: Failed to enlist: java.lang.Throwable: Unabled to enlist resource, see the previous warnings. tx=TransactionImple < ac, BasicAction: 0:ffffac186078:-550ddfb2:53e3a0b6:5f751 status: ActionStatus.ABORT_ONLY >
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.checkEnlisted(TxConnectionListener.java:552)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:282)
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)
... 30 more

06:05:26,269 WARN [com.arjuna.ats.jta] (job-executor-tp-threads - 1) ARJUNA016061: TransactionImple.enlistResource - XAResource.start returned: XAException.XAER_PROTO for < formatId=131077, gtrid_length=29, bqual_length=36, tx_uid=0:ffffac186078:-550ddfb2:53e3a0b6:5f756, node_name=1, branch_uid=0:ffffac186078:-550ddfb2:53e3a0b6:5f758, subordinatenodename=null, eis_name=java:jboss/datasources/ProcessEngine >: oracle.jdbc.xa.OracleXAException
at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1110)
at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:240)
at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)
at org.jboss.jca.core.tx.jbossts.XAResourceWrapperImpl.start(XAResourceWrapperImpl.java:191)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:636)
at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:397)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:587)
at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:264)
at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)
at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)
at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)
at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)
at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)
at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)
at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)
at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)
at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)
at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)
at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectListWithRawParameter(DbSqlSession.java:317) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:308) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:303) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:290) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findNextJobsToExecute(JobManager.java:117) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.cmd.AcquireJobsCmd.execute(AcquireJobsCmd.java:50) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.cmd.AcquireJobsCmd.execute(AcquireJobsCmd.java:33) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:65) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:826) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]

06:05:26,304 ERROR [stderr] (job-executor-tp-threads - 1) oracle.jdbc.xa.OracleXAException

06:05:26,304 ERROR [stderr] (job-executor-tp-threads - 1) at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1110)

06:05:26,306 ERROR [stderr] (job-executor-tp-threads - 1) at oracle.jdbc.xa.client.OracleXAResource.start(OracleXAResource.java:240)

06:05:26,307 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.adapters.jdbc.xa.XAManagedConnection.start(XAManagedConnection.java:259)

06:05:26,307 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.tx.jbossts.XAResourceWrapperImpl.start(XAResourceWrapperImpl.java:191)

06:05:26,309 ERROR [stderr] (job-executor-tp-threads - 1) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:636)

06:05:26,310 ERROR [stderr] (job-executor-tp-threads - 1) at com.arjuna.ats.internal.jta.transaction.arjunacore.TransactionImple.enlistResource(TransactionImple.java:397)

06:05:26,310 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener$TransactionSynchronization.enlist(TxConnectionListener.java:587)

06:05:26,311 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.connectionmanager.listener.TxConnectionListener.enlist(TxConnectionListener.java:264)

06:05:26,312 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.managedConnectionReconnected(TxConnectionManagerImpl.java:467)

06:05:26,313 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.reconnectManagedConnection(AbstractConnectionManager.java:599)

06:05:26,314 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:467)

06:05:26,315 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:139)

06:05:26,315 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.transaction.managed.ManagedTransaction.openConnection(ManagedTransaction.java:84)

06:05:26,316 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.transaction.managed.ManagedTransaction.getConnection(ManagedTransaction.java:58)

06:05:26,318 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.BaseExecutor.getConnection(BaseExecutor.java:279)

06:05:26,318 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.SimpleExecutor.prepareStatement(SimpleExecutor.java:69)

06:05:26,319 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.SimpleExecutor.doQuery(SimpleExecutor.java:56)

06:05:26,322 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.BaseExecutor.queryFromDatabase(BaseExecutor.java:267)

06:05:26,324 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.BaseExecutor.query(BaseExecutor.java:141)

06:05:26,324 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:105)

06:05:26,325 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.executor.CachingExecutor.query(CachingExecutor.java:81)

06:05:26,326 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:101)

06:05:26,327 ERROR [stderr] (job-executor-tp-threads - 1) at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:95)

06:05:26,328 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.db.DbSqlSession.selectListWithRawParameter(DbSqlSession.java:317)

06:05:26,329 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:308)

06:05:26,330 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:303)

06:05:26,331 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.db.DbSqlSession.selectList(DbSqlSession.java:290)

06:05:26,331 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.persistence.entity.JobManager.findNextJobsToExecute(JobManager.java:117)

06:05:26,332 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.cmd.AcquireJobsCmd.execute(AcquireJobsCmd.java:50)

06:05:26,332 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.cmd.AcquireJobsCmd.execute(AcquireJobsCmd.java:33)

06:05:26,333 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.interceptor.CommandExecutorImpl.execute(CommandExecutorImpl.java:24)

06:05:26,333 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:90)

06:05:26,334 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59)

06:05:26,335 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32)

06:05:26,335 ERROR [stderr] (job-executor-tp-threads - 1) at org.camunda.bpm.engine.impl.jobexecutor.SequentialJobAcquisitionRunnable.run(SequentialJobAcquisitionRunnable.java:65)

06:05:26,336 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33)

06:05:26,337 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806)

06:05:26,338 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45)

06:05:26,338 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:826)

06:05:26,338 ERROR [stderr] (job-executor-tp-threads - 1) at java.lang.Thread.run(Thread.java:745)

06:05:26,341 ERROR [stderr] (job-executor-tp-threads - 1) at org.jboss.threads.JBossThread.run(JBossThread.java:122)

I guess it's because all connections in the connection pool are for some reason marked as invalid.

Maybe it's because I made mistakes in the definition of the data source.
Here is the current data source definition:

<xa-datasource jta="true" jndi-name="java:jboss/datasources/ProcessEngine" pool-name="ProcessEngine" enabled="true" use-java-context="true" use-ccm="true">
<xa-datasource-property name="URL">
jdbc:oracle:thin:@theserver:1521:THEINSTANCE
</xa-datasource-property>
<driver>oracle</driver>
<xa-pool>
<min-pool-size>5</min-pool-size>
<max-pool-size>17</max-pool-size>
<is-same-rm-override>false</is-same-rm-override>
<no-tx-separate-pools>true</no-tx-separate-pools>
</xa-pool>
<security>
<user-name>the_user</user-name>
<password>the_pwd</password>
</security>
<validation>
<valid-connection-checker class-name="org.jboss.jca.adapters.jdbc.vendor.OracleValidConnectionChecker"/>
<check-valid-connection-sql>select 1 from dual</check-valid-connection-sql>
<stale-connection-checker class-name="org.jboss.jca.adapters.jdbc.vendor.OracleStaleConnectionChecker"/>
<exception-sorter class-name="org.jboss.jca.adapters.jdbc.extensions.oracle.OracleExceptionSorter"/>
</validation>
</xa-datasource>

Here is the camunda configuration:

<subsystem xmlns="urn:org.camunda.bpm.jboss:1.1">
<process-engines>
<process-engine name="default" default="true">
<datasource>
java:jboss/datasources/ProcessEngine
</datasource>
<history-level>
full
</history-level>
<configuration>
org.camunda.bpm.container.impl.jboss.config.ManagedJtaProcessEngineConfiguration
</configuration>
<properties>
<property name="jobExecutorAcquisitionName">
default
</property>
<property name="isAutoSchemaUpdate">
false
</property>
<property name="authorizationEnabled">
false
</property>
<property name="jobExecutorDeploymentAware">
true
</property>
</properties>
<plugins>
<plugin>
<class>
org.camunda.bpm.application.impl.event.ProcessApplicationEventListenerPlugin
</class>
</plugin>
<plugin>
<class>
org.theorg.bpm.identity.plugin.TheOrgIdentityProviderPlugin
</class>
</plugin>
</plugins>
</process-engine>
</process-engines>
<job-executor>
<thread-pool-name>
job-executor-tp
</thread-pool-name>
<job-acquisitions>
<job-acquisition name="default">
<acquisition-strategy>
SEQUENTIAL
</acquisition-strategy>
<properties>
<property name="lockTimeInMillis">
600000
</property>
<property name="waitTimeInMillis">
5000
</property>
<property name="maxJobsPerAcquisition">
1
</property>
</properties>
</job-acquisition>
</job-acquisitions>
</job-executor>
</subsystem>

Can anybody identify a misconfiguration?

Daniel Meyer

unread,

Aug 12, 2014, 3:53:13 AM8/12/14

to camunda-...@googlegroups.com, l.rie...@gmail.com

Hi l.riebandt,

The first exception is normal:

> 06:05:25,899 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 37) Exception while executing job with id a360ee54-1f79-11e4-aebf-b8ba20524153: org.camunda.bpm.engine.OptimisticLockingException: MessageEntity[a360ee54-1f79-11e4-aebf-b8ba20524153] was updated by another transaction concurrently

This happens if two threads perform conflicting changes to a process instance concurrently. The Jobexecutor should perform retries and the error should consolidate.

Does the error persist or does it go away after a certain time?

Cheers,

Daniel

l.rie...@gmail.com

unread,

Aug 12, 2014, 5:46:05 AM8/12/14

to camunda-...@googlegroups.com, l.rie...@gmail.com

Hi Daniel,
thank you for your reply!

The OptimisticLockingException only occurred once.

The
"SEVERE [org.camunda.bpm.engine.impl.interceptor.CommandContext] (job-executor-tp-threads - 1) Error while closing command context: org.apache.ibatis.exceptions.PersistenceException:"
occured 88 times.
The exceptions are all thrown at oracle.jdbc.xa.OracleXAResource.checkError(OracleXAResource.java:1110) (see above log)

A process that is scheduled with a timer-started-event to run once a day ran 20 times.

Thanks!
Lenny

l.rie...@gmail.com

unread,

Aug 18, 2014, 4:05:36 AM8/18/14

to camunda-...@googlegroups.com, l.rie...@gmail.com

Hi all,
I have an update of my issue.

As I mentioned above, I have a process which is scheduled to run once a day.
The process is responsible to send a open task reminder email.
It has a timer-start-event with cycle '0 0 6 * * ?'.
It has only one service-task with a expression delegate. The service-task is set to be asynchronous with a repeat retry time cyle of 'R0/'.
The JavaDelegate uses the TaskService, RuntimeService and IdentityService to query Tasks, Variables, Users and Groups. The delegate execution itself takes about one minute.

Some how this service-task is sometimes executed not once, but many times.
E.g. this saturday the service-task was executed 56 times.

Here is an extract from the log file.
The retries continue until the job is suspended.
Do you have any idea what the reason for this error could be?

Thanks!
Lenny

06:01:10,028 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 72) Email with subject 'Open task reminder' sent to '[xxx...@zzz.com]'
.
.
.
06:01:10,153 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 72) Email with subject 'Open task reminder' sent to '[aaa...@ccc.com]'
06:05:01,058 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac186078:-494c3186:53edc9af:306fc in state RUN
06:05:01,058 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012095: Abort of action id 0:ffffac186078:-494c3186:53edc9af:306fc invoked while multiple threads active within it.
06:05:01,058 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012108: CheckedAction::check - atomic action 0:ffffac186078:-494c3186:53edc9af:306fc aborting with 1 threads active!
06:05:01,058 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffffac186078:-494c3186:53edc9af:306fc

06:06:05,149 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 62) Email with subject 'Open task reminder' sent to '[yyy...@zzz.com]'
.
.
.
06:06:05,259 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 62) Email with subject 'Open task reminder' sent to '[aaa...@ccc.com]'
06:07:25,886 WARN [com.arjuna.ats.arjuna] (job-executor-tp-threads - 72) ARJUNA012077: Abort called on already aborted atomic action 0:ffffac186078:-494c3186:53edc9af:306fc
06:07:25,886 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 72) Exception while executing job with id cba3e581-24f9-11e4-8900-94a720524153: org.camunda.bpm.engine.OptimisticLockingException: MessageEntity[cba3e581-24f9-11e4-8900-94a720524153] was updated by another transaction concurrently

at org.camunda.bpm.engine.impl.db.DbSqlSession$DeletePersistentObjectOperation.execute(DbSqlSession.java:254) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.flushDeletes(DbSqlSession.java:723) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.flush(DbSqlSession.java:490) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContext.flushSessions(CommandContext.java:196) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:126) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:99) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]

06:10:05,316 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac186078:-494c3186:53edc9af:3080a in state RUN
06:10:05,316 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012095: Abort of action id 0:ffffac186078:-494c3186:53edc9af:3080a invoked while multiple threads active within it.
06:10:05,316 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012108: CheckedAction::check - atomic action 0:ffffac186078:-494c3186:53edc9af:3080a aborting with 1 threads active!
06:10:05,316 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffffac186078:-494c3186:53edc9af:3080a

06:10:58,849 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 72) Email with subject 'Open task reminder' sent to '[yyy...@zzz.com]'
.
.
.
06:10:58,959 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 72) Email with subject 'Open task reminder' sent to '[aaa...@ccc.com]'
06:12:31,440 WARN [com.arjuna.ats.arjuna] (job-executor-tp-threads - 62) ARJUNA012077: Abort called on already aborted atomic action 0:ffffac186078:-494c3186:53edc9af:3080a
06:12:31,440 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 62) Exception while executing job with id cba3e581-24f9-11e4-8900-94a720524153: org.camunda.bpm.engine.OptimisticLockingException: TaskEntity[be381ad6-23b8-11e4-b9d3-94a720524153] was updated by another transaction concurrently
at org.camunda.bpm.engine.impl.db.DbSqlSession.flushUpdates(DbSqlSession.java:692) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.db.DbSqlSession.flush(DbSqlSession.java:488) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]

at org.camunda.bpm.engine.impl.interceptor.CommandContext.flushSessions(CommandContext.java:196) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContext.close(CommandContext.java:126) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.CommandContextInterceptor.execute(CommandContextInterceptor.java:99) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.JtaTransactionInterceptor.execute(JtaTransactionInterceptor.java:59) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.interceptor.LogInterceptor.execute(LogInterceptor.java:32) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.executeJob(ExecuteJobsRunnable.java:79) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable.run(ExecuteJobsRunnable.java:67) [camunda-engine-7.1.0-Final.jar:7.1.0-Final]
at org.jboss.threads.SimpleDirectExecutor.execute(SimpleDirectExecutor.java:33) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.runTask(QueueExecutor.java:806) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor.access$100(QueueExecutor.java:45) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at org.jboss.threads.QueueExecutor$Worker.run(QueueExecutor.java:847) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_55]
at org.jboss.threads.JBossThread.run(JBossThread.java:122) [jboss-threads-2.1.0.Final.jar:2.1.0.Final]

06:16:07,017 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 62) Email with subject 'Open task reminder' sent to '[yyy...@zzz.com]'
.
.
.
06:16:07,111 INFO [at.drei.bpm.service.OsirisSendEmailServiceImpl] (job-executor-tp-threads - 62) Email with subject 'Open task reminder' sent to '[aaa...@ccc.com]'
06:17:10,100 WARN [com.arjuna.ats.arjuna] (job-executor-tp-threads - 72) ARJUNA012077: Abort called on already aborted atomic action 0:ffffac186078:-494c3186:53edc9af:30900
06:17:10,100 WARNING [org.camunda.bpm.engine.impl.jobexecutor.ExecuteJobsRunnable] (job-executor-tp-threads - 72) Exception while executing job with id cba3e581-24f9-11e4-8900-94a720524153: org.camunda.bpm.engine.OptimisticLockingException: MessageEntity[cba3e581-24f9-11e4-8900-94a720524153] was updated by another transaction concurrently

06:20:07,218 WARN [com.arjuna.ats.arjuna] (Transaction Reaper) ARJUNA012117: TransactionReaper::check timeout for TX 0:ffffac186078:-494c3186:53edc9af:309ff in state RUN
06:20:07,218 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012095: Abort of action id 0:ffffac186078:-494c3186:53edc9af:309ff invoked while multiple threads active within it.
06:20:07,218 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012108: CheckedAction::check - atomic action 0:ffffac186078:-494c3186:53edc9af:309ff aborting with 1 threads active!
06:20:07,218 WARN [com.arjuna.ats.arjuna] (Transaction Reaper Worker 0) ARJUNA012121: TransactionReaper::doCancellations worker Thread[Transaction Reaper Worker 0,5,main] successfully canceled TX 0:ffffac186078:-494c3186:53edc9af:309ff

Lennard R.

unread,

Sep 5, 2014, 12:45:08 PM9/5/14

to camunda-...@googlegroups.com, l.rie...@gmail.com

Hi all,

I finally found a solution for the described problem (especially for my first post).

It was not a JBoss Datasource configuration issue but a JBoss AS performance issue.

After running a few days the server's performance decreased tremendously.

The connection to the Datasource was affected too.

The solution for my problem was to run the server without JVM argument -XX:+TieredCompilation.

The JBoss AS is now running without performance issues for 8 days.

See also this post in JBoss forum: https://developer.jboss.org/message/821651#821651