JDBC Errors after 1508.3 upgrade (Oracle)

129 views
Skip to first unread message

Ronald Gouldner

unread,
Aug 17, 2015, 4:54:45 PM8/17/15
to kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org)

Selecting “All my proposals” is now throwing exceptions after 1508.3 upgrade.   This exception is repeated for every proposal returned by this query.

 

Anyone else seeing this ?

 

Ron

 

2015-08-17 10:46:25,444 [http-apr-8080-exec-2] u:gouldner/d: WARN  org.kuali.rice.kim.impl.role.RoleServiceImpl - Caught exception during a principalHasRole check

org.springframework.orm.jpa.JpaSystemException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))

                bind => [3 parameters bound]

Query: ReadAllQuery(referenceClass=RoleMemberBo sql="SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))"); nested exception is javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))

                bind => [3 parameters bound]

Query: ReadAllQuery(referenceClass=RoleMemberBo sql="SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))")

                at org.springframework.orm.jpa.EntityManagerFactoryUtils.convertJpaAccessExceptionIfPossible(EntityManagerFactoryUtils.java:321)

                at org.springframework.orm.jpa.DefaultJpaDialect.translateExceptionIfPossible(DefaultJpaDialect.java:120)

                at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:403)

                at org.kuali.rice.krad.data.jpa.KradEntityManagerFactoryBean.translateExceptionIfPossible(KradEntityManagerFactoryBean.java:546)

                at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:58)

                at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:213)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.doWithExceptionTranslation(JpaPersistenceProvider.java:555)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.findMatching(JpaPersistenceProvider.java:258)

                at sun.reflect.GeneratedMethodAccessor466.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

                at com.sun.proxy.$Proxy44.findMatching(Unknown Source)

                at org.kuali.rice.krad.data.provider.impl.ProviderBasedDataObjectService.findMatching(ProviderBasedDataObjectService.java:96)

                at org.kuali.rice.kim.impl.role.RoleServiceBase.getRoleMembershipsForPredicates(RoleServiceBase.java:318)

                at org.kuali.rice.kim.impl.role.RoleServiceBase.getRoleMembersForPrincipalId(RoleServiceBase.java:160)

                at org.kuali.rice.kim.impl.role.RoleServiceBase.getRoleMembersForPrincipalId(RoleServiceBase.java:135)

                at org.kuali.rice.kim.impl.role.RoleServiceImpl.checkForMatchOnQualifications(RoleServiceImpl.java:1311)

                at org.kuali.rice.kim.impl.role.RoleServiceImpl.principalHasRole(RoleServiceImpl.java:1212)

                at org.kuali.rice.kim.impl.role.RoleServiceImpl.principalHasRole(RoleServiceImpl.java:1100)

                at sun.reflect.GeneratedMethodAccessor565.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy143.principalHasRole(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor565.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy144.principalHasRole(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor565.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

                at com.sun.proxy.$Proxy144.principalHasRole(Unknown Source)

                at org.kuali.rice.kim.impl.role.RoleServiceImpl.principalHasRole(RoleServiceImpl.java:607)

                at sun.reflect.GeneratedMethodAccessor564.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy143.principalHasRole(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor564.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy144.principalHasRole(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor564.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)1

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

                at com.sun.proxy.$Proxy144.principalHasRole(Unknown Source)

                at org.kuali.rice.kim.impl.permission.PermissionServiceImpl.isAuthorized(PermissionServiceImpl.java:143)

                at sun.reflect.GeneratedMethodAccessor680.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy150.isAuthorized(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor680.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:198)

                at com.sun.proxy.$Proxy151.isAuthorized(Unknown Source)

                at sun.reflect.GeneratedMethodAccessor680.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

                at com.sun.proxy.$Proxy151.isAuthorized(Unknown Source)

                at org.kuali.coeus.common.impl.auth.UnitAuthorizationServiceImpl.hasPermission(UnitAuthorizationServiceImpl.java:90)

                at org.kuali.coeus.common.impl.auth.perm.KcAuthorizationServiceImpl.hasPermission(KcAuthorizationServiceImpl.java:166)

                at org.kuali.coeus.common.impl.auth.perm.KcAuthorizationServiceImpl.hasPermission(KcAuthorizationServiceImpl.java:151)

                at org.kuali.coeus.propdev.impl.core.PropDevLookupableHelperServiceImpl.filterPermissions(PropDevLookupableHelperServiceImpl.java:205)

                at org.kuali.coeus.propdev.impl.core.PropDevLookupableHelperServiceImpl.executeSearch(PropDevLookupableHelperServiceImpl.java:198)

                at org.kuali.rice.krad.lookup.LookupableImpl.getSearchResults(LookupableImpl.java:628)

                at org.kuali.rice.krad.lookup.LookupableImpl.performSearch(LookupableImpl.java:125)

                at org.kuali.rice.krad.lookup.LookupControllerServiceImpl.search(LookupControllerServiceImpl.java:137)

                at org.kuali.rice.krad.lookup.LookupController.search(LookupController.java:53)

                at org.kuali.rice.krad.lookup.LookupController$$FastClassBySpringCGLIB$$c4222517.invoke(<generated>)

                at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)

                at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:700)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:633)

                at org.kuali.rice.krad.lookup.LookupController$$EnhancerBySpringCGLIB$$c533df6f.search(<generated>)

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)

                at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)

                at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)

                at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:743)

                at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:672)

                at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:82)

                at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:919)

                at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:851)

                at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:953)

                at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:844)

                at javax.servlet.http.HttpServlet.service(HttpServlet.java:620)

                at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:829)

                at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.rice.kew.web.UserPreferencesFilter.doFilter(UserPreferencesFilter.java:78)

                at org.kuali.rice.kew.web.UserPreferencesFilter.doFilter(UserPreferencesFilter.java:62)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.rice.krad.web.filter.UserLoginFilter.doFilter(UserLoginFilter.java:89)

                at org.kuali.rice.krad.web.filter.UserLoginFilter.doFilter(UserLoginFilter.java:77)

                at edu.hawaii.rice.kew.web.UhKcUserLoginFilter.doFilter(UhKcUserLoginFilter.java:151)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.rice.krad.web.filter.BootstrapFilterChain.doFilter(BootstrapFilter.java:327)

                at org.jasig.cas.client.util.HttpServletRequestWrapperFilter.doFilter(HttpServletRequestWrapperFilter.java:70)

                at org.kuali.rice.krad.web.filter.BootstrapFilterChain.doFilter(BootstrapFilter.java:320)

                at org.jasig.cas.client.validation.AbstractTicketValidationFilter.doFilter(AbstractTicketValidationFilter.java:238)

                at org.kuali.rice.krad.web.filter.BootstrapFilterChain.doFilter(BootstrapFilter.java:320)

                at org.jasig.cas.client.authentication.AuthenticationFilter.doFilter(AuthenticationFilter.java:152)

                at org.kuali.rice.krad.web.filter.BootstrapFilterChain.doFilter(BootstrapFilter.java:320)

                at org.jasig.cas.client.session.SingleSignOutFilter.doFilter(SingleSignOutFilter.java:100)

                at org.kuali.rice.krad.web.filter.BootstrapFilterChain.doFilter(BootstrapFilter.java:320)

                at org.kuali.rice.krad.web.filter.BootstrapFilter.doFilter(BootstrapFilter.java:199)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:160)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.coeus.sys.framework.controller.interceptor.PerformanceLoggingFilter.doFilter(PerformanceLoggingFilter.java:82)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.coeus.sys.framework.controller.interceptor.SessionExpiredFilter.doFilter(SessionExpiredFilter.java:46)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.kuali.rice.krad.web.filter.HideWebInfFilter.doFilter(HideWebInfFilter.java:68)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.springframework.web.filter.AbstractRequestLoggingFilter.doFilterInternal(AbstractRequestLoggingFilter.java:223)

                at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)

                at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:106)

                at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)

                at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)

                at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)

                at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)

                at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170)

                at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98)

                at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)

                at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)

                at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)

                at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1040)

                at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)

                at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.doRun(AprEndpoint.java:2441)

                at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.run(AprEndpoint.java:2430)

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

                at java.lang.Thread.run(Thread.java:745)

Caused by: javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))

                bind => [3 parameters bound]

Query: ReadAllQuery(referenceClass=RoleMemberBo sql="SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))")

                at org.eclipse.persistence.internal.jpa.QueryImpl.getDetailedException(QueryImpl.java:382)

                at org.eclipse.persistence.internal.jpa.QueryImpl.executeReadQuery(QueryImpl.java:260)

                at org.eclipse.persistence.internal.jpa.QueryImpl.getResultList(QueryImpl.java:473)

                at sun.reflect.GeneratedMethodAccessor263.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at net.bull.javamelody.JpaWrapper.doInvoke(JpaWrapper.java:70)

                at net.bull.javamelody.JpaWrapper$QueryHandler.invoke(JpaWrapper.java:203)

                at net.bull.javamelody.JdbcWrapper$DelegatingInvocationHandler.invoke(JdbcWrapper.java:285)

                at com.sun.proxy.$Proxy299.getResultList(Unknown Source)

                at org.kuali.rice.krad.data.jpa.JpaCriteriaQuery.getResults(JpaCriteriaQuery.java:58)

                at org.kuali.rice.krad.data.jpa.JpaCriteriaQuery.getResults(JpaCriteriaQuery.java:28)

                at org.kuali.rice.krad.data.jpa.DataObjectCriteriaQueryBase.forRowResults(DataObjectCriteriaQueryBase.java:154)

                at org.kuali.rice.krad.data.jpa.DataObjectCriteriaQueryBase.lookup(DataObjectCriteriaQueryBase.java:131)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider$3.call(JpaPersistenceProvider.java:261)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider$3.call(JpaPersistenceProvider.java:258)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.doWithExceptionTranslation(JpaPersistenceProvider.java:552)

                ... 192 more

Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))

                bind => [3 parameters bound]

Query: ReadAllQuery(referenceClass=RoleMemberBo sql="SELECT ROLE_MBR_ID, ACTV_FRM_DT, ACTV_TO_DT, MBR_ID, OBJ_ID, ROLE_ID, MBR_TYP_CD, VER_NBR FROM KRIM_ROLE_MBR_T WHERE (((ROLE_ID = ?) AND (MBR_TYP_CD = ?)) AND (MBR_ID = ?))")

                at org.eclipse.persistence.exceptions.DatabaseException.sqlException(DatabaseException.java:340)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.processExceptionForCommError(DatabaseAccessor.java:1620)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:676)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.executeCall(DatabaseAccessor.java:560)

                at org.eclipse.persistence.internal.sessions.AbstractSession.basicExecuteCall(AbstractSession.java:2055)

                at org.eclipse.persistence.sessions.server.ServerSession.executeCall(ServerSession.java:570)

                at org.eclipse.persistence.sessions.server.ClientSession.executeCall(ClientSession.java:258)

                at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:242)

                at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeCall(DatasourceCallQueryMechanism.java:228)

                at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.executeSelectCall(DatasourceCallQueryMechanism.java:299)

                at org.eclipse.persistence.internal.queries.DatasourceCallQueryMechanism.selectAllRows(DatasourceCallQueryMechanism.java:694)

                at org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRowsFromTable(ExpressionQueryMechanism.java:2740)

                at org.eclipse.persistence.internal.queries.ExpressionQueryMechanism.selectAllRows(ExpressionQueryMechanism.java:2693)

                at org.eclipse.persistence.queries.ReadAllQuery.executeObjectLevelReadQuery(ReadAllQuery.java:541)

                at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeDatabaseQuery(ObjectLevelReadQuery.java:1173)

                at org.eclipse.persistence.queries.DatabaseQuery.execute(DatabaseQuery.java:904)

                at org.eclipse.persistence.queries.ObjectLevelReadQuery.execute(ObjectLevelReadQuery.java:1132)

                at org.eclipse.persistence.queries.ReadAllQuery.execute(ReadAllQuery.java:442)

                at org.eclipse.persistence.queries.ObjectLevelReadQuery.executeInUnitOfWork(ObjectLevelReadQuery.java:1220)

                at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.internalExecuteQuery(UnitOfWorkImpl.java:2896)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1857)

                at org.eclipse.persistence.internal.sessions.AbstractSession.retryQuery(AbstractSession.java:1927)

                at org.eclipse.persistence.sessions.server.ClientSession.retryQuery(ClientSession.java:694)

                at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.retryQuery(UnitOfWorkImpl.java:5536)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1893)

                at org.eclipse.persistence.internal.sessions.AbstractSession.retryQuery(AbstractSession.java:1927)

                at org.eclipse.persistence.sessions.server.ClientSession.retryQuery(ClientSession.java:694)

                at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.retryQuery(UnitOfWorkImpl.java:5536)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1893)

                at org.eclipse.persistence.internal.sessions.AbstractSession.retryQuery(AbstractSession.java:1927)

                at org.eclipse.persistence.sessions.server.ClientSession.retryQuery(ClientSession.java:694)

                at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.retryQuery(UnitOfWorkImpl.java:5536)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1893)

                at org.eclipse.persistence.internal.sessions.AbstractSession.retryQuery(AbstractSession.java:1927)

                at org.eclipse.persistence.sessions.server.ClientSession.retryQuery(ClientSession.java:694)

                at org.eclipse.persistence.internal.sessions.UnitOfWorkImpl.retryQuery(UnitOfWorkImpl.java:5536)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1893)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1839)

                at org.eclipse.persistence.internal.sessions.AbstractSession.executeQuery(AbstractSession.java:1804)

                at org.eclipse.persistence.internal.jpa.QueryImpl.executeReadQuery(QueryImpl.java:258)

                ... 207 more

Caused by: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.enlistResource(JdbcConnectionHandle.java:87)

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.prepareStatement(JdbcConnectionHandle.java:242)

                at sun.reflect.GeneratedMethodAccessor231.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at bitronix.tm.resource.jdbc.BaseProxyHandlerClass.invoke(BaseProxyHandlerClass.java:64)

                at com.sun.proxy.$Proxy15.prepareStatement(Unknown Source)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1565)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1514)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseCall.prepareStatement(DatabaseCall.java:778)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:621)

                ... 244 more

Caused by: bitronix.tm.internal.BitronixSystemException: transaction timed out

                at bitronix.tm.resource.common.TransactionContextHelper.enlistInCurrentTransaction(TransactionContextHelper.java:63)

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.enlistResource(JdbcConnectionHandle.java:85)

                ... 254 more

[EL Info]: 2015-08-17 10:46:25.469--UnitOfWork(5757540)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT DOC_HDR_ID, APP_DOC_ID, APP_DOC_STAT, APP_DOC_STAT_MDFN_DT, APRV_DT, CRTE_DT, STAT_MDFN_DT, RTE_LVL, DOC_HDR_STAT_CD, TTL, DOC_VER_NBR, DOC_TYP_ID, FNL_DT, INITR_PRNCPL_ID, OBJ_ID, RTE_STAT_MDFN_DT, RTE_PRNCPL_ID, VER_NBR FROM KREW_DOC_HDR_T WHERE (DOC_HDR_ID = ?)

                bind => [1 parameter bound]

Query: ReadObjectQuery(name="readDocumentRouteHeaderValue" referenceClass=DocumentRouteHeaderValue sql="SELECT DOC_HDR_ID, APP_DOC_ID, APP_DOC_STAT, APP_DOC_STAT_MDFN_DT, APRV_DT, CRTE_DT, STAT_MDFN_DT, RTE_LVL, DOC_HDR_STAT_CD, TTL, DOC_VER_NBR, DOC_TYP_ID, FNL_DT, INITR_PRNCPL_ID, OBJ_ID, RTE_STAT_MDFN_DT, RTE_PRNCPL_ID, VER_NBR FROM KREW_DOC_HDR_T WHERE (DOC_HDR_ID = ?)").

[EL Info]: 2015-08-17 10:46:25.47--UnitOfWork(5757540)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource htNueA1aIX6XB4F9pfYN_KC_RICE in state ACCESSIBLE with usage count 2 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@666e9f77 on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state STARTED

Error Code: 0

Call: SELECT DOC_HDR_ID, APP_DOC_ID, APP_DOC_STAT, APP_DOC_STAT_MDFN_DT, APRV_DT, CRTE_DT, STAT_MDFN_DT, RTE_LVL, DOC_HDR_STAT_CD, TTL, DOC_VER_NBR, DOC_TYP_ID, FNL_DT, INITR_PRNCPL_ID, OBJ_ID, RTE_STAT_MDFN_DT, RTE_PRNCPL_ID, VER_NBR FROM KREW_DOC_HDR_T WHERE (DOC_HDR_ID = ?)

                bind => [1 parameter bound]

Ronald Gouldner

unread,
Aug 17, 2015, 6:28:38 PM8/17/15
to Ronald Gouldner, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Terry Durkin, Travis Schneeberger

Terry/Travis,

 

                This seems to be happening because of connection pool issues.

 

                While looking for the pool settings in my config I found that 1506 had a different connection.pool.impl

 

               

 

 

                1508.3 is using Bitronix while 1506 used XAPool

 

 

 

 

                Can you shed some light on why this was done and what it might affect ?   I think it isn’t working well in Oracle.  Perhaps the settings are just different ?

 

                There was not JIRA number applied to this commit so nothing I can look at to see why this was done.

 

 

Thanks,

Ron

To unsubscribe from this group and stop receiving emails from it, send an email to kc.technical.co...@kuali.org.

Terry Durkin

unread,
Aug 18, 2015, 9:22:24 AM8/18/15
to Ronald Gouldner, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger
Ron -

We changed to Bitronix for several reasons:
1 - Moving to the new Nexus shed light on the fact that the version of XAPool that we were using was customized quite some time ago and hadn’t been pushed to Maven central. 
2 - XAPool didn’t support all of the JDBC APIs we needed it to
3 - Rice is already using it
4 - Bitronix is the only active, open source, xa capable transaction manager/pool library

We always run our integration test suite for Oracle prior to doing a public release.  However, it may be there are some configuration settings that need to be updated in your environment.  In the KC DataSourceSpringBeans.xml (and corresponding Rice spring bean files).  The full list of properties, including defaults, that can used in bitronix is documented here: https://github.com/bitronix/btm/wiki/Transaction-manager-configuration#The_properties_configuration_file.

Terry

On Aug 17, 2015, at 6:28 PM, Ronald Gouldner <goul...@hawaii.edu> wrote:

Terry/Travis,
 
                This seems to be happening because of connection pool issues.
 
                While looking for the pool settings in my config I found that 1506 had a different connection.pool.impl
 
                <image001.png>
 
 
                1508.3 is using Bitronix while 1506 used XAPool
 
<image002.png>
 
 
 
                Can you shed some light on why this was done and what it might affect ?   I think it isn’t working well in Oracle.  Perhaps the settings are just different ?
 
                There was not JIRA number applied to this commit so nothing I can look at to see why this was done.
 
<image003.png>

Ronald Gouldner

unread,
Aug 18, 2015, 8:09:54 PM8/18/15
to Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

I have not found any setting that fixes this issue.  I tried increasing the maxPool from 10 to 50.

 

This error only happens in “All my proposals” for a user with over 200 proposals.   Of course this worked with XAPool so I don’t understand what is different.   Actually all my proposals code was heavily modified for 1508.3 so this could be a new bug with those changes as well.

 

I also notice the following warning when I start the server which is interesting

2015-08-18 14:05:10,033 [RMI TCP Connection(3)-127.0.0.1] D: U: []  WARN  bitronix.tm.journal.DiskJournal :: active log file is unclean, did you call BitronixTransactionManager.shutdown() at the end of the last run?

 

Ron

Doug Pace

unread,
Aug 18, 2015, 10:28:25 PM8/18/15
to Ronald Gouldner, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger
Ron - I'd recommend setting the defaultTransactionTimeout to something fairly high. Proposal search is awful slow and while we have worked to improve it over the last month, its still slow. You can do this by putting the following in a bitronix-default-config.properties in the root of the classpath. We also have plans to move this to a config parameter but didn't get that finished yet.

bitronix.tm.timer.defaultTransactionTimeout=120000

--

Douglas Pace

Grant and Research Administration Product Development Lead

Mobile: 520-344-0228

KualiCo.png

3300 N Ashton Boulevard, Suite 300

Lehi, UT 84043

KualiCo delivers open source administrative software using modern SaaS technologies that are built specifically for higher education. Our beautifully designed products streamline processes to significantly reduce costs for research management, finance, student administration, and business continuity. Learn more at www.kuali.co.

Smith, Christopher T

unread,
Aug 19, 2015, 10:38:07 AM8/19/15
to Doug Pace, Ronald Gouldner, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

To add to this discussion – I haven’t regularly been seeing the same issues as Ron, but I was upgrading an environment to 1507 this morning and decided to add the bitronix parameter Doug mentioned below for good measure. When I started up the server and tried to run the XML ingester, it immediately failed with an exception that read “error enlisting a JdbcConnectionHandle of a JdbcPooledConnection…cannot enlist more than one non-XA resource”. (I’m paraphrasing but can post the full exception if anyone wants to see it.) I tried this multiple times and restarted the server a couple of times, but the error was consistent.

 

When I removed the timeout parameter and ran the ingester again, the rice-xml loaded without any problems, and I did get a single “transaction timed out” error when loading the coeus-xml but on the second try it ran without issue.

 

So it seems that setting the timeout too high may cause problems as well, if all of the connection resources are tied up by long-running transactions.

Ronald Gouldner

unread,
Aug 19, 2015, 4:12:37 PM8/19/15
to Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

OK I will try that setting, thanks!

 

The code really could be a lot smarter about doing PD searches.   The way it limits what is returned makes the results somewhat unpredictable and doesn’t really work well.  The performance is terrible.  If you perform the exact same search using Document Search and putting Document  Type : Proposal Development and your criteria for example “iniatiator:Gouldner” then the results are almost instant.  So clearly this search could be written to work much faster.

 

I was able to significantly improve the performance of our “All my proposals” search by doing two things

1)      Search proposals where initiator = user instead of aggregator (that was how previous version always worked anyway)

2)      In PropDevLookupableHelperServiceImpl.java exectuteSearch.  Don’t perform  individual proposal permission checks if the search is based on initiator.  If I was the initiator for the document I must have permission to see it so this expensive check isn’t needed.

if (StringUtils.isNotEmpty(initiator) && initiator.equals(getGlobalVariableService().getUserSession().getPrincipalName())) {
    doNotFilter =
true;
}
else {
    doNotFilter = canAccessAllProposals();
}

 

The canAccessAllProposals() call is the ridiculous expensive one.  It take every proposal and checks various types of permissions.  If a better way to perform this check was created performance would be much better.

 

The second change actually fixed my bitronix issue also because the canAccessAllProposals method was the killer.   I remove my change and test with the new parameter just to make sure longer queries can still work and then put my changes back in.

 

Ron

Image removed by sender. KualiCo.png

3300 N Ashton Boulevard, Suite 300

Lehi, UT 84043

Image removed by sender.Image removed by sender.Image removed by sender.Image removed by sender.

Ronald Gouldner

unread,
Aug 19, 2015, 4:29:25 PM8/19/15
to Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Chris,

                Where did you place the file ?  What did you name it and what value did you use ?

 

                I just tried placing bitronix-default-config.properties in resources

 

[Java8-ronald@infss14-08 kc (uh-modifications-1508.3)]$ cat coeus-webapp/src/main/resources/bitronix-default-config.properties

bitronix.tm.timer.defaultTransactionTimeout=600

 

and it didn’t work I am still getting the same errors.

 

Ron

Image removed by sender. KualiCo.png

3300 N Ashton Boulevard, Suite 300

Lehi, UT 84043

Image removed by sender.Image removed by sender.Image removed by sender.Image removed by sender.

KualiCo delivers open source administrative software using modern SaaS technologies that are built specifically for higher education. Our beautifully designed products streamline processes to significantly reduce costs for research management, finance, student administration, and business continuity. Learn more at www.kuali.co.

Smith, Christopher T

unread,
Aug 19, 2015, 4:36:51 PM8/19/15
to Ronald Gouldner, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Hey Ron – I put the file at coeus-impl/​src/​main/​resources/​bitronix-default-config.properties, which means it wound up inside the coeus-impl jar file. I don’t know for sure that that’s correct, but the other references to bitronix params seemed to be in the coeus-impl project (the DataSourceSpringBeans.xml file that Terry mentioned, for example) and it did seem to have a definite effect when I placed it there. I copied the param straight from Doug’s email, including the value of 120000.

To unsubscribe from this group and stop receiving emails from it, send an email to kc.tech+u...@kuali.org.

Ronald Gouldner

unread,
Aug 19, 2015, 4:53:43 PM8/19/15
to Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Increasing the timeout is not fixing the “all my proposals” issue.   I think the error is not due to transaction timeout.  The error seems to be as follows but I don’t understand it.

 

Caused by: bitronix.tm.internal.BitronixSystemException: cannot enlist more than one non-XA resource, tried enlisting an XAResourceHolderState with uniqueName=d3IFc4Tm7WQhkoAtl9w9_KC XAResource=a JDBC LrcXAResource in state NO_TX with XID null, already enlisted: an XAResourceHolderState with uniqueName=rIFTMBzAC3UpiUaLxO6N_KC_RICE XAResource=a JDBC LrcXAResource in state STARTED (started) with XID a Bitronix XID [6C766279624A78655335614D63684C4B59306F735F544D5F4B43000000001879786B000000C6 : 6C766279624A78655335614D63684C4B59306F735F544D5F4B430000000018797A80000000C7]

 

 

I have a feeling the issue is this crazy query (380 parameter bound)  wow……

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

 

From the logs...

 

 

[EL Info]: 2015-08-19 10:37:45.348--UnitOfWork(721044211)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?").

[EL Info]: 2015-08-19 10:37:45.36--UnitOfWork(721044211)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?").

[EL Info]: 2015-08-19 10:37:50.366--UnitOfWork(721044211)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?").

[EL Info]: 2015-08-19 10:37:55.374--UnitOfWork(721044211)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?").

[EL Info]: 2015-08-19 10:38:00.416--UnitOfWork(721044211)--Communication failure detected when attempting to perform read query outside of a transaction. Attempting to retry query. Error was: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?").

[EL Warning]: 2015-08-19 10:38:00.421--UnitOfWork(721044211)--Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?")

2015-08-19 10:38:00,427 [http-apr-8080-exec-8] u:gouldner/d: ERROR org.kuali.rice.krad.web.controller.UifHandlerExceptionResolver - The following error was caught by the UifHandlerExceptionResolver :

org.springframework.orm.jpa.JpaSystemException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?"); nested exception is javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?")

                at org.springframework.orm.jpa.EntityManagerFactoryUtils.convertJpaAccessExceptionIfPossible(EntityManagerFactoryUtils.java:321)

                at org.springframework.orm.jpa.DefaultJpaDialect.translateExceptionIfPossible(DefaultJpaDialect.java:120)

                at org.springframework.orm.jpa.AbstractEntityManagerFactoryBean.translateExceptionIfPossible(AbstractEntityManagerFactoryBean.java:403)

                at org.kuali.rice.krad.data.jpa.KradEntityManagerFactoryBean.translateExceptionIfPossible(KradEntityManagerFactoryBean.java:546)

                at org.springframework.dao.support.ChainedPersistenceExceptionTranslator.translateExceptionIfPossible(ChainedPersistenceExceptionTranslator.java:58)

                at org.springframework.dao.support.DataAccessUtils.translateIfNecessary(DataAccessUtils.java:213)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.doWithExceptionTranslation(JpaPersistenceProvider.java:555)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.findMatching(JpaPersistenceProvider.java:258)

                at sun.reflect.GeneratedMethodAccessor466.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

                at com.sun.proxy.$Proxy44.findMatching(Unknown Source)

                at org.kuali.rice.krad.data.provider.impl.ProviderBasedDataObjectService.findMatching(ProviderBasedDataObjectService.java:96)

                at org.kuali.coeus.propdev.impl.core.PropDevLookupableHelperServiceImpl.executeSearch(PropDevLookupableHelperServiceImpl.java:190)

                at org.kuali.rice.krad.lookup.LookupableImpl.getSearchResults(LookupableImpl.java:628)

                at org.kuali.rice.krad.lookup.LookupableImpl.performSearch(LookupableImpl.java:125)

                at org.kuali.rice.krad.lookup.LookupControllerServiceImpl.search(LookupControllerServiceImpl.java:137)

                at org.kuali.rice.krad.lookup.LookupController.search(LookupController.java:53)

                at org.kuali.rice.krad.lookup.LookupController$$FastClassBySpringCGLIB$$c4222517.invoke(<generated>)

                at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)

                at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:700)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

                at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96)

                at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260)

                at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)

                at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

                at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:633)

                at org.kuali.rice.krad.lookup.LookupController$$EnhancerBySpringCGLIB$$7c689aaa.search(<generated>)

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?")

                at org.eclipse.persistence.internal.jpa.QueryImpl.getDetailedException(QueryImpl.java:382)

                at org.eclipse.persistence.internal.jpa.QueryImpl.executeReadQuery(QueryImpl.java:260)

                at org.eclipse.persistence.internal.jpa.QueryImpl.getResultList(QueryImpl.java:473)

                at sun.reflect.GeneratedMethodAccessor263.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at net.bull.javamelody.JpaWrapper.doInvoke(JpaWrapper.java:70)

                at net.bull.javamelody.JpaWrapper$QueryHandler.invoke(JpaWrapper.java:203)

                at net.bull.javamelody.JdbcWrapper$DelegatingInvocationHandler.invoke(JdbcWrapper.java:285)

                at com.sun.proxy.$Proxy313.getResultList(Unknown Source)

                at org.kuali.rice.krad.data.jpa.JpaCriteriaQuery.getResults(JpaCriteriaQuery.java:58)

                at org.kuali.rice.krad.data.jpa.JpaCriteriaQuery.getResults(JpaCriteriaQuery.java:28)

                at org.kuali.rice.krad.data.jpa.DataObjectCriteriaQueryBase.forRowResults(DataObjectCriteriaQueryBase.java:154)

                at org.kuali.rice.krad.data.jpa.DataObjectCriteriaQueryBase.lookup(DataObjectCriteriaQueryBase.java:131)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider$3.call(JpaPersistenceProvider.java:261)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider$3.call(JpaPersistenceProvider.java:258)

                at org.kuali.rice.krad.data.jpa.JpaPersistenceProvider.doWithExceptionTranslation(JpaPersistenceProvider.java:552)

                ... 108 more

Caused by: Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.6.0.v20150309-bf26070): org.eclipse.persistence.exceptions.DatabaseException

Internal Exception: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

Error Code: 0

Call: SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?

                bind => [380 parameters bound]

Query: ReadAllQuery(referenceClass=DevelopmentProposal sql="SELECT * FROM (SELECT a.*, ROWNUM rnum  FROM (SELECT PROPOSAL_NUMBER AS a1, ACTIVITY_TYPE_CODE AS a2, AGENCY_DIVISION_CODE AS a3, AGENCY_PROGRAM_CODE AS a4, AGENCY_ROUTING_IDENTIFIER AS a5, ANTICIPATED_AWARD_TYPE_CODE AS a6, CFDA_NUMBER AS a7, CONTINUED_FROM AS a8, CREATE_TIMESTAMP AS a9, CREATE_USER AS a10, CREATION_STATUS_CODE AS a11, CURRENT_AWARD_NUMBER AS a12, DEADLINE_DATE AS a13, DEADLINE_TIME AS a14, DEADLINE_TYPE AS a15, HIERARCHY_BUDGET_TYPE AS a16, HIERARCHY_HASH_CODE AS a17, HIERARCHY_ORIG_CHILD_PROP_NBR AS a18, HIERARCHY_PROPOSAL_NUMBER AS a19, IS_HIERARCHY AS a20, MAIL_ACCOUNT_NUMBER AS a21, MAIL_BY AS a22, MAIL_DESCRIPTION AS a23, MAIL_TYPE AS a24, MAILING_ADDRESS_ID AS a25, NOTICE_OF_OPPORTUNITY_CODE AS a26, NSF_CODE AS a27, NUMBER_OF_COPIES AS a28, OBJ_ID AS a29, OPPORTUNITYID_GG AS a30, OWNED_BY_UNIT AS a31, PREV_GG_TRACKID AS a32, PRIME_SPONSOR_CODE AS a33, PROGRAM_ANNOUNCEMENT_NUMBER AS a34, PROGRAM_ANNOUNCEMENT_TITLE AS a35, PROPOSALNUMBER_GG AS a36, STATUS_CODE AS a37, PROPOSAL_TYPE_CODE AS a38, REQUESTED_END_DATE_INITIAL AS a39, REQUESTED_START_DATE_INITIAL AS a40, SPONSOR_CODE AS a41, SPONSOR_PROPOSAL_NUMBER AS a42, SUBCONTRACT_FLAG AS a43, SUBMIT_FLAG AS a44, TITLE AS a45, UPDATE_TIMESTAMP AS a46, UPDATE_USER AS a47, VER_NBR AS a48, FINAL_BUDGET_ID AS a49, HIERARCHY_LAST_BUDGET_ID AS a50, DOCUMENT_NUMBER AS a51 FROM EPS_PROPOSAL WHERE (DOCUMENT_NUMBER IN (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?))) a WHERE ROWNUM <= ?) WHERE rnum > ?")

                ... 123 more

Caused by: java.sql.SQLException: error enlisting a JdbcConnectionHandle of a JdbcPooledConnection from datasource d3IFc4Tm7WQhkoAtl9w9_KC in state ACCESSIBLE with usage count 1 wrapping a JDBC LrcXAConnection on oracle.jdbc.driver.T4CConnection@47c8fafa on a JDBC LrcConnectionHandle on a JDBC LrcXAResource in state NO_TX

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.enlistResource(JdbcConnectionHandle.java:87)

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.prepareStatement(JdbcConnectionHandle.java:242)

                at sun.reflect.GeneratedMethodAccessor231.invoke(Unknown Source)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

                at java.lang.reflect.Method.invoke(Method.java:497)

                at bitronix.tm.resource.jdbc.BaseProxyHandlerClass.invoke(BaseProxyHandlerClass.java:64)

                at com.sun.proxy.$Proxy15.prepareStatement(Unknown Source)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1565)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.prepareStatement(DatabaseAccessor.java:1514)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseCall.prepareStatement(DatabaseCall.java:778)

                at org.eclipse.persistence.internal.databaseaccess.DatabaseAccessor.basicExecuteCall(DatabaseAccessor.java:621)

                ... 160 more

Caused by: bitronix.tm.internal.BitronixSystemException: cannot enlist more than one non-XA resource, tried enlisting an XAResourceHolderState with uniqueName=d3IFc4Tm7WQhkoAtl9w9_KC XAResource=a JDBC LrcXAResource in state NO_TX with XID null, already enlisted: an XAResourceHolderState with uniqueName=rIFTMBzAC3UpiUaLxO6N_KC_RICE XAResource=a JDBC LrcXAResource in state STARTED (started) with XID a Bitronix XID [6C766279624A78655335614D63684C4B59306F735F544D5F4B43000000001879786B000000C6 : 6C766279624A78655335614D63684C4B59306F735F544D5F4B430000000018797A80000000C7]

                at bitronix.tm.internal.XAResourceManager.enlist(XAResourceManager.java:107)

                at bitronix.tm.BitronixTransaction.enlistResource(BitronixTransaction.java:130)

                at bitronix.tm.resource.common.TransactionContextHelper.enlistInCurrentTransaction(TransactionContextHelper.java:69)

                at bitronix.tm.resource.jdbc.JdbcConnectionHandle.enlistResource(JdbcConnectionHandle.java:85)

                ... 170 more

Ronald Gouldner

unread,
Aug 20, 2015, 2:56:13 PM8/20/15
to Ronald Gouldner, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Doug,

 

Would it be possible for you to work with my on this issue.  I think it only occurs in our environment because we have more data.  I don’t think your testing environment has enough data to create this condition.  It could also be a oracle issue with bitronix, I am not sure.

 

The exceptions below only happen when I have the file in place that you suggested.  With this file even a user with a few proposals throws exceptions when using “All my Propsoals” so it makes matters much worse.

 

With this setting

[Java8-ronald@infss14-08 resources (uh-modifications-1508.3)]$ cat bitronix-default-config.properties

bitronix.tm.timer.defaultTransactionTimeout=3600

 

The exceptions below are thrown.

 

After Deleting this file I return to the previous issue.  My code modification mentioned earlier to avoid the call to canAccessAllProposals() fixes the previous pooling issue but I don’t know when it where else it will show up if I let the defaultTransactionTimeout remain the default of 60

 

 

Ron

 

From: Ronald Gouldner [mailto:goul...@hawaii.edu]

Sent: Wednesday, August 19, 2015 10:54 AM
To: Doug Pace <dp...@kuali.co>

Ronald Gouldner

unread,
Aug 24, 2015, 5:35:43 PM8/24/15
to Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Chris,

 

Are you continuing with the 1508.3 release ?     I don’t understand why but setting this parameter to anything causes the “cannot enlist more than one non-XA resource error”.   Even if we set it to the default of 60.   The only way I can get rid of this error is to remove the parameter entirely.

 

When I look for this error “BitronixSystemException: cannot enlist more than one non-XA resource, tried enlisting an XAResourceHolderState with uniqueName”

I find one StackOverflow thread but not much help

http://stackoverflow.com/questions/21351049/hibernate-bitronix-spring-cannot-enlist-more-than-one-non-xa-resource

 

I am starting to think I need to revert to 1506.  I don’t know how we will maintain our code from this point forward.

 

Ron

Ronald Gouldner

unread,
Aug 24, 2015, 6:57:38 PM8/24/15
to Ronald Gouldner, Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Another question for you Chris.   Is your rice in Bundled or Embedded mode ?

 

We run bundled which means that rice and kc are running in same java instance.

 

There are two data sources, KC and Rice.  Since this error is happening when the KC datasource is attempted and the error says “cannot enlist more than one non-XA resource”

 

I am wondering if the two data sources are conflicting now.   Perhaps XA pool allowed two and bitronix does not ?

Image removed by sender. KualiCo.png

3300 N Ashton Boulevard, Suite 300

Lehi, UT 84043

Image removed by sender.Image removed by sender.Image removed by sender.Image removed by sender.

KualiCo delivers open source administrative software using modern SaaS technologies that are built specifically for higher education. Our beautifully designed products streamline processes to significantly reduce costs for research management, finance, student administration, and business continuity. Learn more at www.kuali.co.

To unsubscribe from this group and stop receiving emails from it, send an email to kc.technical.co...@kuali.org.

To unsubscribe from this group and stop receiving emails from it, send an email to kc.tech+u...@kuali.org.

Ken Geis

unread,
Aug 24, 2015, 7:57:49 PM8/24/15
to Ronald Gouldner, Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger
Ron, here’s a useful discussion. It suggests why things worked with Oracle and XAPool, and not with Bitronix.


I’m wondering if the riceDataSourceBitronixXa and dataSourceBitronixXa beans could be replaced with OracleXADataSource implementations.


Ken

Ronald Gouldner

unread,
Aug 24, 2015, 8:35:58 PM8/24/15
to Ken Geis, Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Thanks, I found this also and have been trying to digest what it all means.

I also found that rice had issues with oracle and bitronix when they made the switch initially.

 

https://jira.kuali.org/browse/KULRICE-4895

 

Still don’t know how to fix and this is burning up my schedule.

 

Ron

Ronald Gouldner

unread,
Aug 24, 2015, 9:55:11 PM8/24/15
to Ken Geis, Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

I found the problem.   By adding my bitronix-default-config.properties to the project I was overriding the identical properties file in rice.

[Java6-ronald@infss14-08 rice (uh-rice-2.5.3.1507.17)]$ find . -name bitronix-default-config.properties  | grep -v target

./rice-middleware/core/impl/src/main/resources/org/kuali/rice/core/config/bitronix-default-config.properties

./rice-middleware/impl/src/main/resources/bitronix-default-config.properties

 

The rice property file had one entry

bitronix.tm.allowMultipleLrc=true

 

Adding this to my copy of the property file fixed the issue and Doug’s original timeout parameter fixes the original issue.

 

Ron

 

From: Ken Geis [mailto:kg...@berkeley.edu]

Sent: Monday, August 24, 2015 1:58 PM

Image removed by sender. KualiCo.png

3300 N Ashton Boulevard, Suite 300

Lehi, UT 84043

Image removed by sender.Image removed by sender.Image removed by sender.Image removed by sender.

KualiCo delivers open source administrative software using modern SaaS technologies that are built specifically for higher education. Our beautifully designed products streamline processes to significantly reduce costs for research management, finance, student administration, and business continuity. Learn more at www.kuali.co.

To unsubscribe from this group and stop receiving emails from it, send an email to kc.technical.co...@kuali.org.

Smith, Christopher T

unread,
Aug 25, 2015, 10:26:23 AM8/25/15
to Ronald Gouldner, Ken Geis, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

Hey Ron,

 

Thanks for sharing this discovery – this helps us a lot. When I originally added a new bitronix config file with the timeout parameter, I was seeing the same “cannot enlist more than one non-XA resource error” as you but assumed it was directly related to changing the timeout. I ended up removing the timeout setting (and thus the new config file) entirely, since we weren’t getting the same errors as you with the default timeout setting. I’ll definitely add the file now though, as we’d like to be able to control the location of the tlog files, and I’ll probably increase the timeout as a precaution too.

 

Thanks,

Chris

Ronald Gouldner

unread,
Aug 25, 2015, 2:46:12 PM8/25/15
to Smith, Christopher T, Ken Geis, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger

I decided to make our changes in rice.   We build our own version already anyway and I wanted to be sure if KualiCo adds any parameters to this file in rice I would see them during a merge and would not lose them because I had my own copy of this file.

 

I don’t know why rice has two copies of this file, I am not sure which one gets used.  So unfortunately I had to modify both.

./rice-middleware/core/impl/src/main/resources/org/kuali/rice/core/config/bitronix-default-config.properties

./rice-middleware/impl/src/main/resources/bitronix-default-config.properties

Ken Geis

unread,
Aug 25, 2015, 3:50:25 PM8/25/15
to Ronald Gouldner, Smith, Christopher T, Doug Pace, Terry Durkin, kc.techni...@kuali.org, kc.tech@kuali.org (kc.tech@kuali.org), Travis Schneeberger
Be careful out there!

https://github.com/bitronix/btm/wiki/Transaction-manager-configuration#bitronixtmallowMultipleLrc
Having multiple LRC resources participate in a transaction gives up the recovery guarantee but sometimes is useful in development mode.

https://github.com/bitronix/btm/blob/master/btm/src/main/java/bitronix/tm/Configuration.java#L630
This is highly unsafe but could be useful for testing.


Ken
Reply all
Reply to author
Forward
0 new messages