Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Issue with session replication

831 views
Skip to first unread message

Abhishek Singh

unread,
Aug 19, 2004, 5:40:20 AM8/19/04
to
We are frequently getting the following error on Weblogic server 8.1.1.0. The server freezes every half hr as a result with very little load (5 user activity).

<Aug 19, 2004 12:28:13 AM PDT> <Error> <Cluster> <BEA-000117> <Received a stale
replication request for object –object id.>

BEA indicates that this error arises out of long pauses caused by GC or network problems: http://e-docs.bea.com/wls/docs81/messages/Cluster.html

We are working on migrating our application to Weblogic 8.1 (cluster) and using in-memory replication.

The memory sizing for the VM has been done as:

Admin Server:

-XX:MaxPermSize=64m -XX:NewSize=164m -XX:MaxNewSize=164m -Xmx512m -Xms512m

Managed Servers (Two):

-Xms512m -Xmx512m -XX:MaxPermSize=128m -XX:NewSize=164m -XX:MaxNewSize=164m

Any ideas/suggestions would be greatly appreciated!
Thanks
Abhishek

The thread dump under the unresponsive condition is as follows:

Full thread dump Java HotSpot(TM) Client VM (1.4.1_03-b02 mixed mode):

"ExecuteThread: '2' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid
=0x2E003B80 nid=0x778 waiting for monitor entry [2f16f000..2f16fd88]
at weblogic.servlet.internal.session.SessionData.setInternalAttribute(Se
ssionData.java:669)
- waiting to lock <0EFE3858> (a weblogic.servlet.internal.session.Replic
atedSessionData)
at weblogic.servlet.internal.session.ReplicatedSessionData.update(Replic
atedSessionData.java:256)
at weblogic.cluster.replication.ReplicationManager.update(ReplicationMan
ager.java:1257)
at weblogic.cluster.replication.ReplicationManager_WLSkel.invoke(Unknown
Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:466)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:409)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:353)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
144)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.jav
a:404)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest
java:30)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '1' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid
=0x2DFF9410 nid=0x62c waiting for monitor entry [2f0ff000..2f0ffd88]
at weblogic.servlet.internal.session.SessionData.setInternalAttribute(Se
ssionData.java:669)
- waiting to lock <0AD30000> (a weblogic.servlet.internal.session.Replic
atedSessionData)
at weblogic.servlet.internal.session.ReplicatedSessionData.update(Replic
atedSessionData.java:256)
at weblogic.cluster.replication.ReplicationManager.update(ReplicationMan
ager.java:1257)
at weblogic.cluster.replication.ReplicationManager_WLSkel.invoke(Unknown
Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:466)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:409)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:353)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
144)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.jav
a:404)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest
java:30)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '0' for queue: 'weblogic.kernel.Non-Blocking'" daemon prio=5 tid
=0x2C05BD58 nid=0x6bc waiting for monitor entry [2f08f000..2f08fd88]
at weblogic.servlet.internal.session.SessionData.setInternalAttribute(Se
ssionData.java:669)
- waiting to lock <0ED3AF98> (a weblogic.servlet.internal.session.Replic
atedSessionData)
at weblogic.servlet.internal.session.ReplicatedSessionData.update(Replic
atedSessionData.java:256)
at weblogic.cluster.replication.ReplicationManager.update(ReplicationMan
ager.java:1257)
at weblogic.cluster.replication.ReplicationManager_WLSkel.invoke(Unknown
Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:466)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:409)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:353)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
144)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.jav
a:404)
at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest
java:30)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"tavant.common.framework.scheduledTask.AttendanceMarkerTask" daemon prio=5 tid=0
x2BCB2170 nid=0x1ec waiting on condition [2f01f000..2f01fd88]
at java.lang.Thread.sleep(Native Method)
at tavant.common.framework.scheduledTask.Task.run(Task.java:118)
at java.lang.Thread.run(Thread.java:536)

"tavant.asa.core.AsaBackgroundTask" daemon prio=5 tid=0x2BC02198 nid=0x7e4 waiti
ng on condition [2efaf000..2efafd88]
at java.lang.Thread.sleep(Native Method)
at tavant.common.framework.scheduledTask.Task.run(Task.java:118)
at java.lang.Thread.run(Thread.java:536)

"tavant.common.framework.notification.MsgNotificationTask" daemon prio=5 tid=0x2
BE64E80 nid=0x758 waiting on condition [2ef3f000..2ef3fd88]
at java.lang.Thread.sleep(Native Method)
at tavant.common.framework.scheduledTask.Task.run(Task.java:118)
at java.lang.Thread.run(Thread.java:536)

"tavant.common.framework.scheduledTask.AttendanceVerifierTask" daemon prio=5 tid
=0x2BAB4AE0 nid=0x59c waiting on condition [2eecf000..2eecfd88]
at java.lang.Thread.sleep(Native Method)
at tavant.common.framework.scheduledTask.Task.run(Task.java:118)
at java.lang.Thread.run(Thread.java:536)

"SSLListenThread.Default" prio=5 tid=0x2BAFE8F8 nid=0x380 runnable [2ee2f000..2e
e2fd88]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
- locked <0D93A070> (a java.net.PlainSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:448)
at javax.net.ssl.impl.SSLServerSocketImpl.accept(Unknown Source)
at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:715)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:291)

"ListenThread.Default" prio=5 tid=0x2BA99A50 nid=0x710 runnable [2edef000..2edef
d88]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
- locked <0D939E28> (a java.net.PlainSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:448)
at java.net.ServerSocket.accept(ServerSocket.java:419)
at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java
:24)
at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:715)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:291)

"TavantTask" daemon prio=5 tid=0x2AE00450 nid=0x724 waiting on condition [2ed7f0
00..2ed7fd88]
at java.lang.Thread.sleep(Native Method)
at tavant.common.framework.scheduledTask.TaskController.run(TaskControll
er.java:122)

"Thread-10" daemon prio=2 tid=0x2DF9C170 nid=0x690 in Object.wait() [2ed0f000..2
ed0fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D68C448> (a tavant.platform.logging.enterprise.appenders.
JMSAppender$1)
at tavant.platform.logging.enterprise.appenders.Connector.run(Connector.
java:53)
- locked <0D68C448> (a tavant.platform.logging.enterprise.appenders.JMSA
ppender$1)

"Dispatcher-Thread-9" daemon prio=2 tid=0x2DF182B8 nid=0x72c in Object.wait() [2
ec9f000..2ec9fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D67FDD0> (a org.apache.log4j.helpers.BoundedFIFO)
at java.lang.Object.wait(Object.java:426)
at org.apache.log4j.Dispatcher.run(AsyncAppender.java:293)
- locked <0D67FDD0> (a org.apache.log4j.helpers.BoundedFIFO)

"Thread-8" prio=5 tid=0x2AEFACA8 nid=0x548 in Object.wait() [2d8bf000..2d8bfd88]

at java.lang.Object.wait(Native Method)
- waiting on <0D5DD898> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:429)
- locked <0D5DD898> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)

"Thread-7" daemon prio=5 tid=0x2B604D68 nid=0x47c in Object.wait() [2d87f000..2d
87fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D579198> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:426)
at java.util.TimerThread.mainLoop(Timer.java:403)
- locked <0D579198> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)

"weblogic.health.CoreHealthMonitor" daemon prio=5 tid=0x2AFD9700 nid=0x868 waiti
ng on condition [2d83f000..2d83fd88]
at java.lang.Thread.sleep(Native Method)
at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.
java:126)

"Thread-6" prio=5 tid=0x2B7F8E20 nid=0x684 in Object.wait() [2d7ff000..2d7ffd88]

at java.lang.Object.wait(Native Method)
- waiting on <0D413B00> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:429)
- locked <0D413B00> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)

"ExecuteThread: '0' for queue: 'Multicast'" daemon prio=5 tid=0x2AEE6D20 nid=0x8
b0 in Object.wait() [2d7bf000..2d7bfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D3E8010> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D3E8010> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"Thread-5" prio=5 tid=0x2AF44720 nid=0x800 runnable [2d77f000..2d77fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D3A3B80> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:429)
- locked <0D3A3B80> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)

"Thread-4" prio=5 tid=0x2AECC348 nid=0x4d8 in Object.wait() [2d3bf000..2d3bfd88]

at java.lang.Object.wait(Native Method)
- waiting on <0D3A2448> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:429)
- locked <0D3A2448> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)

"VDE Transaction Processor Thread" prio=2 tid=0x2B8C9170 nid=0x8a4 in Object.wai
t() [2d37f000..2d37fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D335498> (a com.octetstring.vde.backend.standard.Transact
ionProcessor)
at java.lang.Object.wait(Object.java:426)
at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(
TransactionProcessor.java:355)
- locked <0D335498> (a com.octetstring.vde.backend.standard.TransactionP
rocessor)
at com.octetstring.vde.backend.standard.TransactionProcessor.run(Transac
tionProcessor.java:215)

"ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x2B7547E
0 nid=0x60c in Object.wait() [2d33f000..2d33fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D282918> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D282918> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x2B7BB4D
8 nid=0x654 in Object.wait() [2d2ff000..2d2ffd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D282410> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D282410> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=5 tid=0x2B7BB31
8 nid=0x1fc in Object.wait() [2d2bf000..2d2bfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D281EE8> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D281EE8> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x2B98
5C18 nid=0x6e4 runnable [2d27f000..2d27fd88]
at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method)
at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:85)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
32)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x2B98
5160 nid=0x6fc runnable [2d23f000..2d23fd88]
at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method)
at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:85)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
32)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=5 tid=0x2B98
4F80 nid=0x780 runnable [2d1ff000..2d1ffd88]
at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method)
at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:85)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:
32)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"weblogic.security.SpinnerRandomSource" daemon prio=5 tid=0x2B983F80 nid=0x604 i
n Object.wait() [2cd8f000..2cd8fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D178860> (a java.lang.Object)
at java.lang.Object.wait(Object.java:426)
at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource
java:60)
- locked <0D178860> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:536)

"weblogic.time.TimeEventGenerator" daemon prio=9 tid=0x2B981D38 nid=0x77c in Obj
ect.wait() [2cd4f000..2cd4fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D16DBC0> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:271)
- locked <0D16DBC0> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerat
or.java:118)
at java.lang.Thread.run(Thread.java:536)

"ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x2B9
7E698 nid=0x6f0 in Object.wait() [2cd0f000..2cd0fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D16D378> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D16D378> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x2B9
7DA40 nid=0xa0 waiting for monitor entry [2cccf000..2cccfd88]
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:407)
- waiting to lock <0AD30000> (a weblogic.servlet.internal.session.Replic
atedSessionData)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.c
leanupExpiredSessions(SessionContext.java:508)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.t
rigger(SessionContext.java:463)
at weblogic.time.common.internal.ScheduledTrigger.run(ScheduledTrigger.j
ava:243)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(Schedul
edTrigger.java:229)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigg
er.java:223)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x2B9
7CDE8 nid=0x770 in Object.wait() [2cc8f000..2cc8fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D16CA40> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D16CA40> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x2B9
7C190 nid=0x874 in Object.wait() [2cc4f000..2cc4fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D16C598> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D16C598> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=5 tid=0x2B9
7BDF0 nid=0x6b0 in Object.wait() [2cc0f000..2cc0fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0D16C0F0> (a weblogic.kernel.ExecuteThread)
at java.lang.Object.wait(Object.java:426)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:145)
- locked <0D16C0F0> (a weblogic.kernel.ExecuteThread)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:164)

"ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B97A598 nid=0x788 runnable [2cbcf000..2cbcfd88]
at java.net.PlainDatagramSocketImpl.receive(Native Method)
- locked <0D572C10> (a java.net.PlainDatagramSocketImpl)
at java.net.DatagramSocket.receive(DatagramSocket.java:680)
- locked <05D96170> (a java.net.DatagramPacket)
- locked <0D572B20> (a java.net.MulticastSocket)
at weblogic.cluster.FragmentSocket.receive(FragmentSocket.java:169)
at weblogic.cluster.MulticastManager.execute(MulticastManager.java:377)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B979940 nid=0x1f8 in Object.wait() [2cb8f000..2cb8fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD30808> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD30808> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B978CE8 nid=0x554 in Object.wait() [2cb4f000..2cb4fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD30AC8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD30AC8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B978090 nid=0x244 in Object.wait() [2cb0f000..2cb0fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0ED3B180> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0ED3B180> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.update(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.updateSecondary(Repli
cationManager.java:677)
at weblogic.servlet.internal.session.ReplicatedSessionData.syncSession(R
eplicatedSessionData.java:488)
- locked <0ED3AF98> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.session.ReplicatedSessionContext.sync(Repli
catedSessionContext.java:176)
- locked <0ED3AF98> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.ServletRequestImpl.syncSession(ServletReque
stImpl.java:2436)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3680)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B977438 nid=0x774 in Object.wait() [2cacf000..2cacfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD30CF0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD30CF0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.update(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.updateSecondary(Repli
cationManager.java:677)
at weblogic.servlet.internal.session.ReplicatedSessionData.syncSession(R
eplicatedSessionData.java:488)
- locked <0AD30000> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.session.ReplicatedSessionContext.sync(Repli
catedSessionContext.java:176)
- locked <0AD30000> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.ServletRequestImpl.syncSession(ServletReque
stImpl.java:2436)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3680)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B9767E0 nid=0x864 in Object.wait() [2ca8f000..2ca8fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0EFE39C8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0EFE39C8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.update(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.updateSecondary(Repli
cationManager.java:730)
at weblogic.servlet.internal.session.ReplicatedSessionData.syncSession(R
eplicatedSessionData.java:490)
- locked <0EFE3858> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.session.ReplicatedSessionContext.sync(Repli
catedSessionContext.java:176)
- locked <0EFE3858> (a weblogic.servlet.internal.session.ReplicatedSessi
onData)
at weblogic.servlet.internal.ServletRequestImpl.syncSession(ServletReque
stImpl.java:2436)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3680)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B975B88 nid=0x3ec in Object.wait() [2ca4f000..2ca4fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD30EE8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD30EE8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B974F30 nid=0x824 in Object.wait() [2ca0f000..2ca0fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD311A8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD311A8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '16' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B9742D8 nid=0x5ec in Object.wait() [2c9cf000..2c9cfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD313D0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD313D0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '15' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B973680 nid=0x7a8 in Object.wait() [2c98f000..2c98fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD315F8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD315F8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B972A28 nid=0x834 in Object.wait() [2c94f000..2c94fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD31820> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD31820> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:391)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:376)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:370)
at weblogic.servlet.internal.session.ReplicatedSessionData.<init>(Replic
atedSessionData.java:117)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getNewSess
ion(ReplicatedSessionContext.java:310)
at weblogic.servlet.internal.ServletRequestImpl.getNewSession(ServletReq
uestImpl.java:2466)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2172)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.CertSecurityModule.checkUserPerm(C
ertSecurityModule.java:252)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:197)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B971DD0 nid=0x3e8 in Object.wait() [2c90f000..2c90fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD31C00> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD31C00> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:970)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:892)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B971178 nid=0x6c0 in Object.wait() [2c8cf000..2c8cfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD31E40> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD31E40> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B970520 nid=0x7d4 in Object.wait() [2c88f000..2c88fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD32068> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD32068> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:391)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:376)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:370)
at weblogic.servlet.internal.session.ReplicatedSessionData.<init>(Replic
atedSessionData.java:117)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getNewSess
ion(ReplicatedSessionContext.java:310)
at weblogic.servlet.internal.ServletRequestImpl.getNewSession(ServletReq
uestImpl.java:2466)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2172)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.CertSecurityModule.checkUserPerm(C
ertSecurityModule.java:252)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:197)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2
B96F8C8 nid=0x600 in Object.wait() [2c84f000..2c84fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD32468> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD32468> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96EC70 nid=0x700 in Object.wait() [2c80f000..2c80fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD32690> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD32690> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96E018 nid=0x878 in Object.wait() [2c7cf000..2c7cfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD328B8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD328B8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96D3C0 nid=0x1f0 in Object.wait() [2c78f000..2c78fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD32AE0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD32AE0> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:970)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:892)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96C768 nid=0x808 in Object.wait() [2c74f000..2c74fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD32D20> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD32D20> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:391)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:376)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:370)
at weblogic.servlet.internal.session.ReplicatedSessionData.<init>(Replic
atedSessionData.java:117)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getNewSess
ion(ReplicatedSessionContext.java:310)
at weblogic.servlet.internal.ServletRequestImpl.getNewSession(ServletReq
uestImpl.java:2466)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2172)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.CertSecurityModule.checkUserPerm(C
ertSecurityModule.java:252)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:197)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96BB10 nid=0x204 in Object.wait() [2c70f000..2c70fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33100> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33100> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:970)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:892)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96B008 nid=0x738 in Object.wait() [2c6cf000..2c6cfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33340> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33340> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
96A500 nid=0x58c in Object.wait() [2c68f000..2c68fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33568> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33568> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
958FA8 nid=0x89c in Object.wait() [2c64f000..2c64fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33790> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33790> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:391)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:376)
at weblogic.cluster.replication.ReplicationManager.register(ReplicationM
anager.java:370)
at weblogic.servlet.internal.session.ReplicatedSessionData.<init>(Replic
atedSessionData.java:117)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getNewSess
ion(ReplicatedSessionContext.java:310)
at weblogic.servlet.internal.ServletRequestImpl.getNewSession(ServletReq
uestImpl.java:2466)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2172)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.CertSecurityModule.checkUserPerm(C
ertSecurityModule.java:252)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:197)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
959100 nid=0x894 in Object.wait() [2c60f000..2c60fd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33B90> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33B90> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon prio=5 tid=0x2B
959258 nid=0x890 in Object.wait() [2c5cf000..2c5cfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0AD33DB8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:74)
- locked <0AD33DB8> (a weblogic.rjvm.ResponseImpl)
at weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:99)
at weblogic.rjvm.BasicOutboundRequest.sendReceive(BasicOutboundRequest.j
ava:104)
at weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:138)
at weblogic.cluster.replication.ReplicationManager_811_WLStub.create(Unk
nown Source)
at weblogic.cluster.replication.ReplicationManager.trySecondary(Replicat
ionManager.java:983)
at weblogic.cluster.replication.ReplicationManager.createSecondary(Repli
cationManager.java:916)
at weblogic.cluster.replication.ReplicationManager.getPrimary(Replicatio
nManager.java:869)
at weblogic.cluster.replication.ReplicationManager.lookup(ReplicationMan
ager.java:406)
at weblogic.servlet.internal.session.ReplicatedSessionContext.getSession
Internal(ReplicatedSessionContext.java:400)
at weblogic.servlet.internal.ServletRequestImpl.getValidSession(ServletR
equestImpl.java:2483)
at weblogic.servlet.internal.ServletRequestImpl.getSession(ServletReques
tImpl.java:2156)
at weblogic.servlet.security.internal.SecurityModule$SessionRetrievalAct
ion.run(SecurityModule.java:633)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Authenticate
dSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:
118)
at weblogic.servlet.security.internal.SecurityModule.getUserSession(Secu
rityModule.java:608)
at weblogic.servlet.security.internal.SecurityModule.beginCheck(Security
Module.java:153)
at weblogic.servlet.security.internal.CertSecurityModule.checkA(CertSecu
rityModule.java:74)
at weblogic.servlet.security.internal.ServletSecurityManager.checkAccess
(ServletSecurityManager.java:145)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppSe
rvletContext.java:3525)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestIm
pl.java:2569)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:170)

"Signal Dispatcher" daemon prio=10 tid=0x008B4FD0 nid=0x8ac waiting on condition
[0..0]

"Finalizer" daemon prio=9 tid=0x008FFE30 nid=0x3e0 in Object.wait() [2acff000..2
acffd88]
at java.lang.Object.wait(Native Method)
- waiting on <0CDF0398> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0CDF0398> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x008FE9A8 nid=0x820 in Object.wait() [2a
cbf000..2acbfd88]
at java.lang.Object.wait(Native Method)
- waiting on <0CDF02A0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:426)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:113)
- locked <0CDF02A0> (a java.lang.ref.Reference$Lock)

"main" prio=5 tid=0x00235FF8 nid=0x70c in Object.wait() [6f000..6fc40]
at java.lang.Object.wait(Native Method)
- waiting on <0CE57FA8> (a weblogic.t3.srvr.T3Srvr)
at java.lang.Object.wait(Object.java:426)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1170)
- locked <0CE57FA8> (a weblogic.t3.srvr.T3Srvr)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:384)
at weblogic.Server.main(Server.java:32)

"VM Thread" prio=5 tid=0x008FD770 nid=0x708 runnable

"VM Periodic Task Thread" prio=10 tid=0x008B3B68 nid=0x898 waiting on condition

"Suspend Checker Thread" prio=10 tid=0x008B45E8 nid=0x8b4 runnable

bodapati

unread,
Oct 1, 2004, 10:51:13 AM10/1/04
to
You will need to get the threaddumps from all the nodes in the cluster when the hang happens and post that. There have been a few fixes around this area in 8.1SP3 can you try to use that.
0 new messages