FusionReactor - Waiting for Monitor Entry

97 views
Skip to first unread message

Aaron Greenlee

unread,
Feb 26, 2011, 8:17:04 PM2/26/11
to fusion...@googlegroups.com
Hello all,

I saw a slow thread on one of my servers this evening and when I viewed the stack trace it showed it was blocked and waiting for FusionReactor to make a monitor entry. I have included the stack below and was curious what the groups thoughts are on this issue. 

Is this common? Avoidable? 

Thanks for your time and help.

Aaron Greenlee

Thread Stack Trace
Trace Time:   19:12:18.360 26-Feb-2011
Request ID:   454175
Script Name:  redacted
Started:      19:11:27.911 26-Feb-2011
Exec Time:    50449ms
Memory Used:  (86%)1,694,550KB
Memory Free:  262,313KB
Thread ID:    0x8b8 (2232)
Thread Name:  jrpp-1691
Priority:     5
Hashcode:     2084474851
State:        BLOCKED

"jrpp-1691" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.u.m(FusionReactor.java:399)
- waiting on <0x2e126d8b> (a java.util.LinkedHashMap held by thread 80, FusionReactor Web Server (Server Thread Pool Member Thread-24))
com.intergral.fusionreactor.filter.FusionReactorFilter.b(FusionReactorFilter.java:448)
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:254)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:164)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)

John Hawksley (Fusion Team)

unread,
Feb 28, 2011, 10:30:12 AM2/28/11
to FusionReactor
Hi Aaron;

At first glance, this is FR waiting to 'finish' a request - i.e. the
request has finished and has actually been flushed to the client, and
FR is waiting to do its housekeeping. The other named thread, thread
80, holds the monitor for an internal tracking structure. Without
getting a trace for this other thread, it's difficult to say what's
going on. It could be anything that's operating on the list of
requests: Request Details (briefly), Running Requests, Request History
etc.

Waiting for monitors is exceedingly common in Java as they are used
extensively - not only by FusionReactor - to regulate entry into
critical sections of code. We take great pains to ensure the time
spent inside these sections is a short as possible, but contention
does occur occasionally.

Do you have a complete trace for this point in time? If so, whatever
thread 80's doing ("Server Thread Pool Member Thread-24", part of the
FR internal web server) is holding the lock. Like I said, this might
be updating display pages. Was the server very loaded? Did many
people have Request History or Running Requests open?

Best regards,
-John


On Feb 27, 2:17 am, Aaron Greenlee <aarongreen...@gmail.com> wrote:
> Hello all,
>
> I saw a slow thread on one of my servers this evening and when I viewed the
> stack trace it showed it was blocked and waiting for FusionReactor to make a
> monitor entry. I have included the stack below and was curious what the
> groups thoughts are on this issue.
>
> Is this common? Avoidable?
>
> Thanks for your time and help.
>
> Aaron Greenleehttp://aarongreenlee.com/
>
> Thread Stack Trace
> Trace Time:   19:12:18.360 26-Feb-2011
> Request ID:   454175
> Script Name:  redacted
> Started:      19:11:27.911 26-Feb-2011
> Exec Time:    50449ms
> Memory Used:  (86%)1,694,550KB
> Memory Free:  262,313KB
> Thread ID:    0x8b8 (2232)
> Thread Name:  jrpp-1691
> Priority:     5
> Hashcode:     2084474851
> State:        BLOCKED
>
> "jrpp-1691" prio=5 waiting for monitor entry
>
> com.intergral.fusionreactor.core.u.m(FusionReactor.java:399)
> - waiting on <0x2e126d8b> (a java.util.LinkedHashMap held by thread 80,
> FusionReactor Web Server (Server Thread Pool Member Thread-24))
> com.intergral.fusionreactor.filter.FusionReactorFilter.b(FusionReactorFilte r.java:448)
> com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilte r.java:254)
> com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReact orFilter.java:164)
> jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
> coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServlet Filter.java:42)

Aaron Greenlee

unread,
Feb 28, 2011, 3:42:43 PM2/28/11
to fusion...@googlegroups.com
Thanks for your response, John.

I was the only person monitoring Fusion Reactor and this server was only serving 3-4 requests a second when I caught this long running request.

I've been using Fusion Reactor for about a year in my development environment but we only recently purchased it for our production servers. So, I tend to spend a lot of time just poking around trying to learn more about FR and the way our site is actually behaving. I have not observed a repeat of this issue and will assume it was isolated. 99.9% of our requests are under 300ms so it should be easy to see if this happens again.

Do you have any tips on capturing the stack trace for other threads when an issue like this occurs? I have my CP warnings set to save the stack trace once it sees a request hit 10 seconds but I'm not sure how I would provide you with the trace for thread 80.

Respectfully,

Aaron Greenlee

charlie arehart

unread,
Feb 28, 2011, 5:16:10 PM2/28/11
to fusion...@googlegroups.com

Aaron, assuming you don’t catch it in one of your CP alerts (which would include the thread dump in the body), you can also obtain one by going to Resources>List All Threads, then click the button “stack trace all”.

 

/charlie

 

--
You received this message because you are subscribed to the Google Groups "FusionReactor" group.
To post to this group, send email to fusion...@googlegroups.com.
To unsubscribe from this group, send email to fusionreacto...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/fusionreactor?hl=en.

John Hawksley

unread,
Mar 1, 2011, 4:05:14 AM3/1/11
to fusion...@googlegroups.com, charlie arehart
Hi Aaron, Charlie,

Yes that's what I'd suggest, thanks Charlie.  It's not impossible to see contention like this; after all this is what the monitor/lock functionality is for.  We would only really start to worry when a 2-party (or worse) deadlock occurs (where one thread holds lock A, and another holds lock B, and both are waiting for the other lock).

If you can get us a trace it would be useful, but I would say that (fingers crossed) this is just an isolated incident :-)

Best regards,
-John
-- 
John Hawksley
Senior Engineer

Voice: +49 7031 221 502 | Fax: +49 7031 221 524
www.intergral.com

Intergral GmbH - Schickardstr 32 - D-71034 Boeblingen - Germany
Geschaeftsfuehrer: David Tattersall, Darren Pywell
Sitz der Gesellschaft: Boeblingen

Aaron Greenlee

unread,
Feb 5, 2012, 11:41:01 AM2/5/12
to fusion...@googlegroups.com, charlie arehart
Here is a recent thread dump as a follow-up to this issue. This server was just updated to FR 4.0.5. Is there anything I can adjust in Fusion Reactor to help avoid this blocking? Thanks!

All Running Request Stack Traces

Thread Stack Trace
Trace Time:   10:31:11.181 05-Feb-2012
Request ID:   1918
Started:      10:30:25.161 05-Feb-2012
Exec Time:    46020ms
Memory Used:  (67%)1,394,898KB
Memory Free:  665,901KB
Thread ID:    0xaf (175)
Thread Name:  jrpp-35
Priority:     5
Hashcode:     2083017854
State:        BLOCKED

"jrpp-35" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.181 05-Feb-2012
Request ID:   1915
Started:      10:30:23.226 05-Feb-2012
Exec Time:    47955ms
Memory Used:  (78%)1,610,562KB
Memory Free:  450,237KB
Thread ID:    0xb1 (177)
Thread Name:  jrpp-37
Priority:     5
Hashcode:     1541841016
State:        RUNNABLE

"jrpp-37" prio=5 runnable

org.apache.oro.text.regex.Perl5Matcher.__interpret(null:???)
org.apache.oro.text.regex.Perl5Matcher.contains(null:???)
org.apache.oro.text.regex.Util.substitute(null:???)
org.apache.oro.text.regex.Util.substitute(null:???)
coldfusion.runtime.StringFunc.REReplace(StringFunc.java:724)
coldfusion.runtime.CFPage.REReplace(CFPage.java:2749)
cfApplication2ecfc1868353865$funcONREQUESTEND._factor1(C:\inetpub\adobetv4\atv4\Application.cfc:195)
cfApplication2ecfc1868353865$funcONREQUESTEND.runFunction(C:\inetpub\adobetv4\atv4\Application.cfc:183)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.AppEventInvoker.invoke(AppEventInvoker.java:88)
coldfusion.runtime.AppEventInvoker.onRequestEnd(AppEventInvoker.java:323)
coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:377)
coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
coldfusion.filter.PathFilter.invoke(PathFilter.java:94)
coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
coldfusion.filter.CachingFilter.invoke(CachingFilter.java:62)
coldfusion.CfmServlet.service(CfmServlet.java:200)
coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:428)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.243 05-Feb-2012
Request ID:   2021
Started:      10:30:53.818 05-Feb-2012
Exec Time:    17425ms
Memory Used:  (98%)2,023,171KB
Memory Free:  37,628KB
Thread ID:    0x9b (155)
Thread Name:  jrpp-15
Priority:     5
Hashcode:     759605283
State:        BLOCKED

"jrpp-15" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.259 05-Feb-2012
Request ID:   2027
Started:      10:30:56.111 05-Feb-2012
Exec Time:    15148ms
Memory Used:  (81%)1,672,653KB
Memory Free:  388,146KB
Thread ID:    0xb7 (183)
Thread Name:  jrpp-40
Priority:     5
Hashcode:     2121053254
State:        RUNNABLE

"jrpp-40" prio=5 runnable

java.util.zip.Deflater.deflateBytes(Deflater.java:???)[Native Method]
java.util.zip.Deflater.deflate(Deflater.java:290)
java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:159)
java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:118)
java.util.zip.GZIPOutputStream.write(GZIPOutputStream.java:72)
com.intergral.fusionreactor.filter.c.c.write(GzipResponseStream.java:328)
coldfusion.runtime.CachedBufferedOutputStream.flushBuffer(CachedBufferedOutputStream.java:86)
coldfusion.runtime.CachedBufferedOutputStream.flush(CachedBufferedOutputStream.java:129)
sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:278)
sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:122)
java.io.OutputStreamWriter.flush(OutputStreamWriter.java:212)
java.io.PrintWriter.flush(PrintWriter.java:276)
coldfusion.runtime.NeoJspWriter.flush(NeoJspWriter.java:316)
coldfusion.runtime.NeoPageContext.flushOutput(NeoPageContext.java:1981)
coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:42)
coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
coldfusion.filter.CachingFilter.invoke(CachingFilter.java:62)
coldfusion.CfmServlet.service(CfmServlet.java:200)
coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:428)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.274 05-Feb-2012
Request ID:   2008
Started:      10:30:50.542 05-Feb-2012
Exec Time:    20732ms
Memory Used:  (91%)1,883,432KB
Memory Free:  177,367KB
Thread ID:    0xa4 (164)
Thread Name:  jrpp-24
Priority:     5
Hashcode:     474324930
State:        BLOCKED

"jrpp-24" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.274 05-Feb-2012
Request ID:   1998
Started:      10:30:48.30 05-Feb-2012
Exec Time:    23244ms
Memory Used:  (93%)1,935,784KB
Memory Free:  125,015KB
Thread ID:    0xbc (188)
Thread Name:  jrpp-45
Priority:     5
Hashcode:     1590020694
State:        BLOCKED

"jrpp-45" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.274 05-Feb-2012
Request ID:   2019
Started:      10:30:53.740 05-Feb-2012
Exec Time:    17534ms
Memory Used:  (94%)1,957,598KB
Memory Free:  103,201KB
Thread ID:    0xd5 (213)
Thread Name:  jrpp-66
Priority:     5
Hashcode:     1676483413
State:        BLOCKED

"jrpp-66" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.274 05-Feb-2012
Request ID:   2020
Started:      10:30:53.771 05-Feb-2012
Exec Time:    17503ms
Memory Used:  (96%)1,996,105KB
Memory Free:  64,694KB
Thread ID:    0x9a (154)
Thread Name:  jrpp-14
Priority:     5
Hashcode:     447384229
State:        BLOCKED

"jrpp-14" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.filter.FlashRequestControlFilter.doFilter(FlashRequestControlFilter.java:71)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.290 05-Feb-2012
Request ID:   1992
Started:      10:30:48.15 05-Feb-2012
Exec Time:    23275ms
Memory Used:  (93%)1,924,382KB
Memory Free:  136,417KB
Thread ID:    0xa5 (165)
Thread Name:  jrpp-25
Priority:     5
Hashcode:     628811122
State:        BLOCKED

"jrpp-25" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.290 05-Feb-2012
Request ID:   2030
Started:      10:30:56.376 05-Feb-2012
Exec Time:    14914ms
Memory Used:  (96%)1,987,784KB
Memory Free:  73,015KB
Thread ID:    0x97 (151)
Thread Name:  jrpp-11
Priority:     5
Hashcode:     985454494
State:        BLOCKED

"jrpp-11" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   1988
Started:      10:30:47.812 05-Feb-2012
Exec Time:    23493ms
Memory Used:  (80%)1,651,692KB
Memory Free:  409,107KB
Thread ID:    0x7e (126)
Thread Name:  jrpp-1
Priority:     5
Hashcode:     2006099514
State:        BLOCKED

"jrpp-1" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2031
Started:      10:30:56.376 05-Feb-2012
Exec Time:    14929ms
Memory Used:  (96%)1,988,808KB
Memory Free:  71,991KB
Thread ID:    0xbb (187)
Thread Name:  jrpp-44
Priority:     5
Hashcode:     655224722
State:        BLOCKED

"jrpp-44" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2006
Started:      10:30:50.542 05-Feb-2012
Exec Time:    20763ms
Memory Used:  (91%)1,882,664KB
Memory Free:  178,135KB
Thread ID:    0xd7 (215)
Thread Name:  jrpp-68
Priority:     5
Hashcode:     1793166391
State:        BLOCKED

"jrpp-68" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2004
Started:      10:30:50.433 05-Feb-2012
Exec Time:    20872ms
Memory Used:  (85%)1,765,636KB
Memory Free:  295,163KB
Thread ID:    0xae (174)
Thread Name:  jrpp-34
Priority:     5
Hashcode:     168191673
State:        BLOCKED

"jrpp-34" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2003
Started:      10:30:48.46 05-Feb-2012
Exec Time:    23259ms
Memory Used:  (94%)1,943,423KB
Memory Free:  117,376KB
Thread ID:    0xbd (189)
Thread Name:  jrpp-46
Priority:     5
Hashcode:     5821410
State:        BLOCKED

"jrpp-46" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2025
Started:      10:30:56.111 05-Feb-2012
Exec Time:    15194ms
Memory Used:  (81%)1,670,608KB
Memory Free:  390,191KB
Thread ID:    0xa7 (167)
Thread Name:  jrpp-27
Priority:     5
Hashcode:     1538247724
State:        BLOCKED

"jrpp-27" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.305 05-Feb-2012
Request ID:   2024
Started:      10:30:56.95 05-Feb-2012
Exec Time:    15210ms
Memory Used:  (80%)1,668,779KB
Memory Free:  392,020KB
Thread ID:    0xbf (191)
Thread Name:  jrpp-47
Priority:     5
Hashcode:     1676122787
State:        BLOCKED

"jrpp-47" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   1987
Started:      10:30:47.750 05-Feb-2012
Exec Time:    23602ms
Memory Used:  (78%)1,609,967KB
Memory Free:  450,833KB
Thread ID:    0xd1 (209)
Thread Name:  jrpp-63
Priority:     5
Hashcode:     1605875692
State:        BLOCKED

"jrpp-63" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2050
Started:      10:31:02.289 05-Feb-2012
Exec Time:    9063ms
Memory Used:  (86%)1,790,669KB
Memory Free:  270,130KB
Thread ID:    0xa0 (160)
Thread Name:  jrpp-20
Priority:     5
Hashcode:     788903696
State:        BLOCKED

"jrpp-20" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2036
Started:      10:30:58.498 05-Feb-2012
Exec Time:    12854ms
Memory Used:  (82%)1,700,909KB
Memory Free:  359,890KB
Thread ID:    0xcf (207)
Thread Name:  jrpp-61
Priority:     5
Hashcode:     874738151
State:        BLOCKED

"jrpp-61" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2060
Started:      10:31:08.560 05-Feb-2012
Exec Time:    2792ms
Memory Used:  (93%)1,922,917KB
Memory Free:  137,882KB
Thread ID:    0xb9 (185)
Thread Name:  jrpp-42
Priority:     5
Hashcode:     640045169
State:        RUNNABLE

"jrpp-42" prio=5 runnable

coldfusion.wddx.Base64Encoder.decode(Base64Encoder.java:148)
coldfusion.runtime.CFPage.ToBinary(CFPage.java:5401)
cfObjectMarshaller2ecfc1209919150$funcDESERIALIZEWITHOBJECTLOAD.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\core\conversion\ObjectMarshaller.cfc:120)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.CfJspPage._invokeUDF(CfJspPage.java:2582)
cfObjectMarshaller2ecfc1209919150$funcDESERIALIZEOBJECT.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\core\conversion\ObjectMarshaller.cfc:86)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:517)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:496)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:355)
coldfusion.runtime.CfJspPage._invoke(CfJspPage.java:2301)
cfDiskStore2ecfc721466680$funcGETQUIET.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\cache\store\DiskStore.cfc:155)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.CfJspPage._invokeUDF(CfJspPage.java:2582)
cfDiskStore2ecfc721466680$funcGET.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\cache\store\DiskStore.cfc:132)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.CfJspPage._invoke(CfJspPage.java:2360)
cfCacheBoxProvider2ecfc1295375397$funcGETQUIET.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\cache\providers\CacheBoxProvider.cfc:246)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.CfJspPage._invokeUDF(CfJspPage.java:2582)
cfCacheBoxProvider2ecfc1295375397$funcGET.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\cache\providers\CacheBoxProvider.cfc:225)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.filter.SilentFilter.invoke(SilentFilter.java:47)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.CfJspPage._invoke(CfJspPage.java:2360)
cfColdbox2ecfc246780608$funcPROCESSCOLDBOXREQUEST.runFunction(C:\inetpub\adobetv4\lib\frameworks\coldbox35\system\Coldbox.cfc:217)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.CfJspPage._invoke(CfJspPage.java:2360)
cfApplication2ecfc1868353865$funcONREQUESTSTART.runFunction(C:\inetpub\adobetv4\atv4\Application.cfc:154)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.AppEventInvoker.invoke(AppEventInvoker.java:88)
coldfusion.runtime.AppEventInvoker.onRequestStart(AppEventInvoker.java:258)
coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:349)
coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
coldfusion.filter.PathFilter.invoke(PathFilter.java:94)
coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
coldfusion.filter.CachingFilter.invoke(CachingFilter.java:62)
coldfusion.CfmServlet.service(CfmServlet.java:200)
coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:428)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2062
Started:      10:31:10.837 05-Feb-2012
Exec Time:    515ms
Memory Used:  (72%)1,488,511KB
Memory Free:  572,288KB
Thread ID:    0x93 (147)
Thread Name:  jrpp-7
Priority:     5
Hashcode:     1094783746
State:        BLOCKED

"jrpp-7" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2039
Started:      10:30:58.529 05-Feb-2012
Exec Time:    12823ms
Memory Used:  (82%)1,701,259KB
Memory Free:  359,540KB
Thread ID:    0xd3 (211)
Thread Name:  jrpp-65
Priority:     5
Hashcode:     1079081511
State:        BLOCKED

"jrpp-65" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.352 05-Feb-2012
Request ID:   2061
Started:      10:31:08.560 05-Feb-2012
Exec Time:    2792ms
Memory Used:  (93%)1,935,134KB
Memory Free:  125,665KB
Thread ID:    0xce (206)
Thread Name:  jrpp-60
Priority:     5
Hashcode:     1434942949
State:        RUNNABLE

"jrpp-60" prio=5 runnable

java.util.Arrays.copyOfRange(Arrays.java:3209)
java.lang.String.(String.java:215)
java.lang.StringBuffer.toString(StringBuffer.java:585)
org.apache.oro.text.regex.Util.substitute(null:???)
coldfusion.runtime.StringFunc.REReplace(StringFunc.java:724)
coldfusion.runtime.CFPage.REReplace(CFPage.java:2749)
cfApplication2ecfc1868353865$funcONREQUESTEND._factor1(C:\inetpub\adobetv4\atv4\Application.cfc:193)
cfApplication2ecfc1868353865$funcONREQUESTEND.runFunction(C:\inetpub\adobetv4\atv4\Application.cfc:183)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:472)
coldfusion.runtime.UDFMethod$ReturnTypeFilter.invoke(UDFMethod.java:405)
coldfusion.runtime.UDFMethod$ArgumentCollectionFilter.invoke(UDFMethod.java:368)
coldfusion.filter.FunctionAccessFilter.invoke(FunctionAccessFilter.java:55)
coldfusion.runtime.UDFMethod.runFilterChain(UDFMethod.java:321)
coldfusion.runtime.UDFMethod.invoke(UDFMethod.java:220)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:491)
coldfusion.runtime.TemplateProxy.invoke(TemplateProxy.java:337)
coldfusion.runtime.AppEventInvoker.invoke(AppEventInvoker.java:88)
coldfusion.runtime.AppEventInvoker.onRequestEnd(AppEventInvoker.java:323)
coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.java:377)
coldfusion.filter.RequestMonitorFilter.invoke(RequestMonitorFilter.java:48)
coldfusion.filter.MonitoringFilter.invoke(MonitoringFilter.java:40)
coldfusion.filter.PathFilter.invoke(PathFilter.java:94)
coldfusion.filter.ExceptionFilter.invoke(ExceptionFilter.java:70)
coldfusion.filter.ClientScopePersistenceFilter.invoke(ClientScopePersistenceFilter.java:28)
coldfusion.filter.BrowserFilter.invoke(BrowserFilter.java:38)
coldfusion.filter.NoCacheFilter.invoke(NoCacheFilter.java:46)
coldfusion.filter.GlobalsFilter.invoke(GlobalsFilter.java:38)
coldfusion.filter.DatasourceFilter.invoke(DatasourceFilter.java:22)
coldfusion.filter.CachingFilter.invoke(CachingFilter.java:62)
coldfusion.CfmServlet.service(CfmServlet.java:200)
coldfusion.bootstrap.BootstrapServlet.service(BootstrapServlet.java:89)
jrun.servlet.FilterChain.doFilter(FilterChain.java:86)
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:428)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.368 05-Feb-2012
Request ID:   2066
Started:      10:31:10.869 05-Feb-2012
Exec Time:    499ms
Memory Used:  (74%)1,530,460KB
Memory Free:  530,339KB
Thread ID:    0xb2 (178)
Thread Name:  jrpp-38
Priority:     5
Hashcode:     1154641966
State:        BLOCKED

"jrpp-38" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)
jrun.servlet.jrpp.JRunProxyService.invokeRunnable(JRunProxyService.java:203)
jrunx.scheduler.ThreadPool$ThreadThrottle.invokeRunnable(ThreadPool.java:428)
jrunx.scheduler.WorkerThread.run(WorkerThread.java:66)


Thread Stack Trace
Trace Time:   10:31:11.368 05-Feb-2012
Request ID:   2068
Started:      10:31:10.884 05-Feb-2012
Exec Time:    484ms
Memory Used:  (75%)1,547,826KB
Memory Free:  512,973KB
Thread ID:    0xc3 (195)
Thread Name:  jrpp-50
Priority:     5
Hashcode:     1765559169
State:        BLOCKED

"jrpp-50" prio=5 waiting for monitor entry

com.intergral.fusionreactor.core.v.m(FusionReactor.java:486)
- waiting on <0x3fa91c56> (a java.util.LinkedHashMap held by thread 92, FusionReactor Web Server (Server Thread Pool Member Thread-31))
com.intergral.fusionreactor.filter.FusionReactorFilter.c(FusionReactorFilter.java:500)
com.intergral.fusionreactor.filter.FusionReactorFilter.d(FusionReactorFilter.java:262)
com.intergral.fusionreactor.filter.FusionReactorFilter.doFilter(FusionReactorFilter.java:171)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.filter.FlashRequestControlFilter.doFilter(FlashRequestControlFilter.java:71)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
coldfusion.monitor.event.MonitoringServletFilter.doFilter(MonitoringServletFilter.java:42)
coldfusion.bootstrap.BootstrapFilter.doFilter(BootstrapFilter.java:46)
jrun.servlet.FilterChain.doFilter(FilterChain.java:94)
jrun.servlet.FilterChain.service(FilterChain.java:101)
jrun.servlet.ServletInvoker.invoke(ServletInvoker.java:106)
jrun.servlet.JRunInvokerChain.invokeNext(JRunInvokerChain.java:42)
jrun.servlet.JRunRequestDispatcher.invoke(JRunRequestDispatcher.java:286)
jrun.servlet.ServletEngineService.dispatch(ServletEngineService.java:543)

John Hawksley

unread,
Feb 6, 2012, 6:42:41 AM2/6/12
to fusion...@googlegroups.com
Hi Aaron,

I've just had a look through the trace and the key to this is figuring out what the FR internal web server is doing with 0x3fa91c56, which is the map of currently-running requests.  We synchronize this map because it's used a lot concurrently, and naturally we try to make the synchronized blocks as small as possible.  Unfortunately the trace you posted is for running requests, rather than the complete system, so the thread which locked 0x3fa91c56 isn't shown.

If/when this recurs, could you do a full trace by doing FusionReactor -> Resources -> List All Threads -> Stack Trace All, then post the result or send us a mail at sup...@fusion-reactor.com, and we'll get right on it!

Many thanks,
-John
--
You received this message because you are subscribed to the Google Groups "FusionReactor" group.
To view this discussion on the web visit https://groups.google.com/d/msg/fusionreactor/-/3-WHrBrI_ckJ.

To post to this group, send email to fusion...@googlegroups.com.
To unsubscribe from this group, send email to fusionreacto...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/fusionreactor?hl=en.

Aaron Greenlee

unread,
Feb 6, 2012, 7:15:43 AM2/6/12
to fusion...@googlegroups.com
Thank you for the reply. I'll try capture a full stack trace.

Aaron
Reply all
Reply to author
Forward
0 new messages