Ubuntu 12.04, TOMCAT: 6.0.35: runaway threads, possible memory leak and OutOfMemoryError: PermGen
1,328 views
Skip to first unread message
bg
Sep 5, 2012, 4:12:16 PM9/5/12
to lif...@googlegroups.com
Hi guys -
Any guidance on the best way to eleminate variables - and correctly identify next steps and the root cause would be most appreciated!
Currently we are thinking
-> We recently upgraded to Java1.7, so we can regress back to 1.6
-> Could the version of Tomcat be an issue, perhaps upgrading that to ?? latest presumably
-> Throw Tomcat in the sea, and run on Jetty
-> Oh goodness what to do!!!
I've seen this thread, but not sure how to identify if its the same underlying issue https://groups.google.com/forum/?fromgroups=#!topic/liftweb/RPS0IRXWZtg - although I think a fix was created in Lift to address it
Our solution is split into multiple Lift apps (I'm not exactly sure how it looks after the build, but I think there are 5 separate apps) We've been running stably on a slightly different setup (
some details on that comparison below) but a new environment is not playing ball. The stack is Ubuntu 12.04, TOMCAT: 6.0.35, Java 1.7.07 and MongoDB 2.0.7, and we seeing a few memory related errors.
JAVA_OPTS="-Drun.mode=production -server -Xms1536m -Xmx2048m -XX:NewSize=512m -XX:MaxNewSize=512m
-XX:PermSize=512m -XX:MaxPermSize=512m -XX:+DisableExplicitGC -Djava.awt.headless=true -Dfile.encoding=UTF
-8"
Extracts of what I feel are most relvant (disclaimer, its just a stab in the dark really) - longer log extract at the end of the post.
We also see CPU spiking to 100% when we don't have any user load, followed by a crash
SEVERE: The web application [] appears to have started a thread named [ReplicaSetStatus:Updater] but has failed to stop it. This is very likely to create a memory leak.
[MongoCleaner1369470652]
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@42a399e]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@702cb634]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
and then
java.lang.OutOfMemoryError: PermGen space
at java.lang.ClassLoader.findBootstrapClass(Native Method)
at java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:1061)
at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
at java.lang.ClassLoader.loadClass(ClassLoader.java:410)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:410)
at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:186)
at org.apache.catalina.loader.WebappClassLoader.clearReferencesRmiTargets(WebappClassLoader.java:2539)
at org.apache.catalina.loader.WebappClassLoader.clearReferences(WebappClassLoader.java:1924)
at org.apache.catalina.loader.WebappClassLoader.stop(WebappClassLoader.java:1833)
at org.apache.catalina.loader.WebappLoader.stop(WebappLoader.java:740)
at org.apache.catalina.core.StandardContext.stop(StandardContext.java:4920)
at org.apache.catalina.core.ContainerBase.removeChild(ContainerBase.java:936)
at org.apache.catalina.startup.HostConfig.undeployApps(HostConfig.java:1359)
at org.apache.catalina.startup.HostConfig.stop(HostConfig.java:1330)
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:326)
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1098)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1110)
at org.apache.catalina.core.StandardEngine.stop(StandardEngine.java:468)
at org.apache.catalina.core.StandardService.stop(StandardService.java:604)
at org.apache.catalina.core.StandardServer.stop(StandardServer.java:788)
at org.apache.catalina.startup.Catalina.stop(Catalina.java:662)
at org.apache.catalina.startup.Catalina$CatalinaShutdownHook.run(Catalina.java:706)
...
Exception in thread "pool-15-thread-1"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-15-thread-1"
Sep 05, 2012 2:12:06 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context [/manager-app]
java.lang.OutOfMemoryError: PermGen space
...
Sep 05, 2012 2:12:14 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context []
java.lang.OutOfMemoryError: PermGen space
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-2"
Java HotSpot(TM) 64-Bit Server VM warning: Exception java.lang.OutOfMemoryError occurred dispatching signal SIGTERM to handler- the VM may need to be forcibly terminated
So - our stable environment is CENTOS 6.3 and tomcat: 6.0.24-45.el6 and java version "1.6.0_24" OpenJDK Runtime Environment (IcedTea6 1.11.4) (rhel-1.49.1.11.4.el6_3-x86_64)
OpenJDK 64-Bit Server VM (build 20.0-b12, mixed mode) and MongoDB 2.07
Here we see the below message:
SEVERE: A web application created a ThreadLocal with key of type [null] (value [com.mongodb.DBTCPConnector$1@b412c18]) and a value of type [com.mongodb.DBTCPConnector.MyPort] (value [com.mongodb.DBTCPConnector$MyPort@618787c9])
but failed to remove it when the web application was stopped. To prevent a memory leak, the ThreadLocal has been forcibly removed.
So my guess is that because here, Tomcat is playing a stronger hand and forcibly removing the thread, it doesn't hog our memory forever, or at least for the few minutes before we come crashing down? But then I read a thread that says Lift is very good at tidying up its own threads correctly.
Moito obrigado!
Brent
more logs:
INFO: Pausing Coyote HTTP/1.1 on http-8080
Sep 05, 2012 2:11:56 PM org.apache.catalina.core.StandardService stop
INFO: Stopping service Catalina
14:11:56.455 [Thread-11] DEBUG net.liftweb.http.LiftServlet - Destroyed Lift handler.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [] appears to have started a thread named [ReplicaSetStatus:Updater] but has failed to stop it. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [] appears to have started a thread named [MongoCleaner2111003265] but has failed to stop it. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads
SEVERE: The web application [] appears to have started a thread named [Lift Scheduler] but has failed to stop it. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:56 PM org.apache.catalina.loader.WebappClassLoader clearThreadLocalMap
SEVERE: The web application [] created a ThreadLocal with key of type [scala.util.DynamicVariable$$anon$1] (value [scala.util.DynamicVariable$$anon$1@1c83ef06]) and a value of type [org.apache.tomcat.util.log.SystemLogHandler] (value [org.apache.tomcat.util.log.SystemLogHandler@19c1818a]) but failed to remove it when the web application was stopped. This is very likely to create a memory leak.
Sep 05, 2012 2:11:57 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context []
java.lang.OutOfMemoryError: PermGen space
at java.lang.ClassLoader.findBootstrapClass(Native Method)
at java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:1061)
at java.lang.ClassLoader.loadClass(ClassLoader.java:412)
at java.lang.ClassLoader.loadClass(ClassLoader.java:410)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:410)
at java.lang.ClassLoader.loadClass(ClassLoader.java:356)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:186)
at org.apache.catalina.loader.WebappClassLoader.clearReferencesRmiTargets(WebappClassLoader.java:2539)
at org.apache.catalina.loader.WebappClassLoader.clearReferences(WebappClassLoader.java:1924)
at org.apache.catalina.loader.WebappClassLoader.stop(WebappClassLoader.java:1833)
at org.apache.catalina.loader.WebappLoader.stop(WebappLoader.java:740)
at org.apache.catalina.core.StandardContext.stop(StandardContext.java:4920)
at org.apache.catalina.core.ContainerBase.removeChild(ContainerBase.java:936)
at org.apache.catalina.startup.HostConfig.undeployApps(HostConfig.java:1359)
at org.apache.catalina.startup.HostConfig.stop(HostConfig.java:1330)
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:326)
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1098)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1110)
at org.apache.catalina.core.StandardEngine.stop(StandardEngine.java:468)
at org.apache.catalina.core.StandardService.stop(StandardService.java:604)
at org.apache.catalina.core.StandardServer.stop(StandardServer.java:788)
at org.apache.catalina.startup.Catalina.stop(Catalina.java:662)
at org.apache.catalina.startup.Catalina$CatalinaShutdownHook.run(Catalina.java:706)
14:12:02.390 [pool-7-thread-8] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Sep 05, 2012 2:11:59 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context []
java.lang.OutOfMemoryError: PermGen space
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:791)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at org.apache.catalina.loader.WebappClassLoader.findClassInternal(WebappClassLoader.java:2818)
at org.apache.catalina.loader.WebappClassLoader.findClass(WebappClassLoader.java:1159)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1647)
at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1526)
at net.liftweb.http.LiftServlet.destroy(LiftServlet.scala:71)
at net.liftweb.http.provider.HTTPProvider$class.terminate(HTTPProvider.scala:44)
at net.liftweb.http.LiftFilter.terminate(LiftServlet.scala:757)
at net.liftweb.http.provider.servlet.ServletFilterProvider$class.destroy(ServletFilterProvider.scala:47)
at net.liftweb.http.LiftFilter.destroy(LiftServlet.scala:757)
at org.apache.catalina.core.ApplicationFilterConfig.release(ApplicationFilterConfig.java:357)
at org.apache.catalina.core.StandardContext.filterStop(StandardContext.java:4107)
at org.apache.catalina.core.StandardContext.stop(StandardContext.java:4876)
at org.apache.catalina.core.ContainerBase.removeChild(ContainerBase.java:936)
at org.apache.catalina.startup.HostConfig.undeployApps(HostConfig.java:1359)
at org.apache.catalina.startup.HostConfig.stop(HostConfig.java:1330)
at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:326)
at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1098)
at org.apache.catalina.core.ContainerBase.stop(ContainerBase.java:1110)
at org.apache.catalina.core.StandardEngine.stop(StandardEngine.java:468)
at org.apache.catalina.core.StandardService.stop(StandardService.java:604)
at org.apache.catalina.core.StandardServer.stop(StandardServer.java:788)
at org.apache.catalina.startup.Catalina.stop(Catalina.java:662)
at org.apache.catalina.startup.Catalina$CatalinaShutdownHook.run(Catalina.java:706)
14:12:05.565 [pool-7-thread-8] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception in thread "pool-15-thread-1"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-15-thread-1"
Sep 05, 2012 2:12:06 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context [/manager-app]
java.lang.OutOfMemoryError: PermGen space
Sep 05, 2012 2:12:14 PM org.apache.catalina.startup.HostConfig undeployApps
WARNING: Error while removing context []
java.lang.OutOfMemoryError: PermGen space
Sep 05, 2012 2:12:45 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/share/tomcat6/server/classes], exists: [false], isDirectory: [false], canRead: [false]
Sep 05, 2012 2:12:45 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/share/tomcat6/server], exists: [false], isDirectory: [false], canRead: [false]
Sep 05, 2012 2:12:45 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/share/tomcat6/shared/classes], exists: [false], isDirectory: [false], canRead: [false]
Sep 05, 2012 2:12:45 PM org.apache.catalina.startup.ClassLoaderFactory validateFile
WARNING: Problem with directory [/usr/share/tomcat6/shared], exists: [false], isDirectory: [false], canRead: [false]
Sep 05, 2012 2:12:46 PM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-8080
Sep 05, 2012 2:12:46 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 958 ms
Sep 05, 2012 2:12:46 PM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Sep 05, 2012 2:12:46 PM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.35
Sep 05, 2012 2:12:46 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
14:12:48.906 [main] DEBUG net.liftweb.util.Props - Loaded key/value properties from resource /props/production.default.props
krypton
27017
14:12:49.104 [main] INFO bootstrap.liftweb.Boot - Running version: <unknown>
14:12:49.124 [main] INFO bootstrap.liftweb.Boot - Using event: SOMETHING
14:12:49.135 [main] INFO bootstrap.liftweb.Boot - Running mode:Production
14:12:49.136 [main] INFO bootstrap.liftweb.Boot - Bootstrap up
Sep 05, 2012 2:12:49 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
14:12:50.778 [main] DEBUG net.liftweb.util.Props - Loaded key/value properties from resource /props/production.default.props
krypton
27017
14:12:51.017 [main] INFO bootstrap.liftweb.Boot - Running version: TEST-SERVER SVN2622: on ARGON-LAPTOP-SERVER
14:12:51.019 [main] INFO bootstrap.liftweb.Boot - Running mode:Production
14:12:51.019 [main] INFO bootstrap.liftweb.Boot - Bootstrap up
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDescriptor
INFO: Deploying configuration descriptor examples.xml
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDescriptor
INFO: Deploying configuration descriptor manager.xml
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDescriptor
INFO: Deploying configuration descriptor docs.xml
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDescriptor
INFO: Deploying configuration descriptor host-manager.xml
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDescriptor
INFO: Deploying configuration descriptor ROOT.xml
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory sojo-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory projo-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory user-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory manager-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory reg-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory admin-app
Sep 05, 2012 2:12:51 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
14:12:52.877 [main] DEBUG net.liftweb.util.Props - Loaded key/value properties from resource /props/production.default.props
krypton
27017
14:12:53.118 [main] INFO bootstrap.liftweb.Boot - Running version: 2622
14:12:53.127 [main] INFO bootstrap.liftweb.Boot - Using event: SOMETHING
14:12:53.474 [main] INFO bootstrap.liftweb.Boot - ... and this event IS in the database
14:12:53.476 [main] INFO bootstrap.liftweb.Boot - Using theme: qs
14:12:53.477 [main] INFO bootstrap.liftweb.Boot - Running mode:Production
14:12:53.477 [main] INFO bootstrap.liftweb.Boot - Bootstrap up
Sep 05, 2012 2:12:53 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory ROOT
14:12:54.635 [main] DEBUG net.liftweb.util.Props - Loaded key/value properties from resource /props/production.default.props
krypton
27017
14:12:54.764 [main] INFO bootstrap.liftweb.Boot - Running version: <unknown>
14:12:54.767 [main] INFO bootstrap.liftweb.Boot - Using event: SOMETHING
14:12:54.767 [main] INFO bootstrap.liftweb.Boot - Running mode:Production
14:12:54.768 [main] INFO bootstrap.liftweb.Boot - Bootstrap up
Sep 05, 2012 2:12:54 PM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-8080
Sep 05, 2012 2:12:54 PM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /0.0.0.0:8009
Sep 05, 2012 2:12:54 PM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/36 config=null
Sep 05, 2012 2:12:55 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 8530 ms
14:13:02.186 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on //json/users: 3 ms
14:13:02.187 [http-8080-1] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on //json/user_count: 3 ms
14:13:02.568 [http-8080-1] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on //json/user_count: 297 ms
14:13:02.629 [http-8080-1] INFO net.liftweb.util.TimeHelpers - Service request (GET) //json/user_count returned 200, took 526 Milliseconds
14:13:02.683 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on //json/users: 411 ms
14:13:02.684 [http-8080-2] INFO net.liftweb.util.TimeHelpers - Service request (GET) //json/users returned 200, took 575 Milliseconds
14:13:13.670 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 1 ms
14:13:13.787 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 48 ms
14:13:14.822 [http-8080-3] ERROR c.blendology.sojo_user.model.Session - ERROR: Could not find device for device data
14:13:14.873 [http-8080-3] ERROR c.blendology.sojo_user.model.Session - ERROR: Could not find device for device data
14:13:15.012 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 1217 ms
14:13:15.095 [http-8080-3] INFO net.liftweb.util.TimeHelpers - Service request (GET) / returned 200, took 1498 Milliseconds
14:13:15.187 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 0 ms
14:13:15.235 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 43 ms
14:13:15.236 [http-8080-3] INFO net.liftweb.util.TimeHelpers - Service request (GET) /ajax_request/liftAjax.js returned 200, took 52 Milliseconds
14:13:15.532 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /json/contacts.js: 0 ms
14:13:15.540 [http-8080-3] ERROR c.blendology.sojo_user.model.Session - ERROR: Could not find device for device data
14:13:15.591 [http-8080-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /json/contacts.js: 56 ms
14:13:15.596 [http-8080-3] INFO net.liftweb.util.TimeHelpers - Service request (GET) /json/contacts.js returned 200, took 65 Milliseconds
14:13:20.088 [http-8080-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 1 ms
14:13:20.322 [http-8080-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 71 ms
14:13:21.357 [http-8080-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /: 1025 ms
14:13:21.426 [http-8080-4] INFO net.liftweb.util.TimeHelpers - Service request (GET) / returned 200, took 1404 Milliseconds
14:13:21.471 [http-8080-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 0 ms
14:13:21.505 [http-8080-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 30 ms
14:13:21.508 [http-8080-4] INFO net.liftweb.util.TimeHelpers - Service request (GET) /ajax_request/liftAjax.js returned 200, took 40 Milliseconds
14:13:28.757 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /event/table: 0 ms
14:13:29.481 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /event/table: 717 ms
14:13:29.518 [http-8080-2] INFO net.liftweb.util.TimeHelpers - Service request (GET) /event/table returned 200, took 763 Milliseconds
14:13:29.573 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 0 ms
14:13:29.580 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /ajax_request/liftAjax.js: 4 ms
14:13:29.585 [http-8080-2] INFO net.liftweb.util.TimeHelpers - Service request (GET) /ajax_request/liftAjax.js returned 200, took 13 Milliseconds
14:13:34.416 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /test/generateData: 0 ms
14:13:34.438 [http-8080-2] INFO c.b.s.snippet.PlaceCometOnPage - The current cometActor name is Empty
14:13:34.439 [http-8080-2] INFO c.b.s.snippet.PlaceCometOnPage - The current cometActor name is Full(F583091643191B0N0EJ)
14:13:34.440 [http-8080-2] INFO c.b.s.snippet.PlaceCometOnPage - Using CometActor with name: Full(F583091643191B0N0EJ)
14:13:34.501 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 3 ms
#################### REDNER
<div xmlns="http://www.w3.org/1999/xhtml">
<div id="result">
<ol id="received_summary">
<li></li>
</ol>
</div>
</div>
14:13:34.548 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 44 ms
14:13:34.920 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 371 ms
14:13:34.925 [pool-13-thread-2] ERROR c.b.s.comet.ResetDatabaseComet - [URL]: CometActor monitoring session: F583091643191B0N0EJ
14:13:34.932 [pool-13-thread-2] INFO c.b.s.comet.ResetDatabaseListeners - Our map is Map(F583091643191B0N0EJ -> com.blendology.sojo_admin.comet.DispatcherActor@196008b8)
14:13:34.935 [pool-13-thread-2] INFO c.b.s.comet.ResetDatabaseComet - Registering comet actor: com.blendology.sojo_admin.comet.ResetDatabaseComet@579d4b58
14:13:34.936 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 13 ms
14:13:34.937 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:13:34.955 [pool-13-thread-3] INFO c.b.sojo_admin.comet.DispatcherActor - We are adding actor: com.blendology.sojo_admin.comet.ResetDatabaseComet@579d4b58 to the list
14:13:34.956 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 18 ms
14:13:36.645 [http-8080-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /test/generateData: 2225 ms
Exception in thread "http-8080-2"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-2"
14:13:42.876 [pool-13-thread-5] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:13:49.322 [pool-13-thread-5] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2714 ms
Exception in thread "pool-13-thread-5"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-5"
Exception in thread "ContainerBackgroundProcessor[StandardEngine[Catalina]]"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ContainerBackgroundProcessor[StandardEngine[Catalina]]"
14:14:02.132 [pool-13-thread-9] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:14:03.465 [pool-13-thread-9] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 896 ms
Exception in thread "pool-13-thread-9"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-9"
14:14:13.405 [pool-13-thread-12] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:14:24.968 [pool-13-thread-12] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 11562 ms
Exception in thread "pool-13-thread-12"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-12"
14:14:35.164 [pool-13-thread-16] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:14:41.472 [pool-13-thread-16] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 6306 ms
Exception in thread "pool-13-thread-16"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-16"
14:14:45.894 [pool-13-thread-19] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:14:47.390 [pool-13-thread-19] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1246 ms
Exception in thread "pool-13-thread-19" 14:14:56.022 [pool-13-thread-1] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-19"
14:15:01.022 [pool-13-thread-1] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 4999 ms
Exception in thread "pool-13-thread-1"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-1"
14:15:06.635 [pool-13-thread-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:15:13.384 [http-8080-5] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /test/generateData: 0 ms
14:15:14.089 [http-8080-5] INFO c.b.s.snippet.PlaceCometOnPage - The current cometActor name is Empty
14:15:14.090 [http-8080-5] INFO c.b.s.snippet.PlaceCometOnPage - The current cometActor name is Full(F583091643198NQWZ5A)
14:15:14.090 [http-8080-5] INFO c.b.s.snippet.PlaceCometOnPage - Using CometActor with name: Full(F583091643198NQWZ5A)
14:15:15.013 [pool-13-thread-3] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 8377 ms
14:15:15.483 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
#################### REDNER
<div xmlns="http://www.w3.org/1999/xhtml">
<div id="result">
<ol id="received_summary">
<li></li>
</ol>
</div>
</div>
14:15:15.487 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 3 ms
14:15:15.489 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:15:15.720 [pool-13-thread-4] ERROR c.b.s.comet.ResetDatabaseComet - [URL]: CometActor monitoring session: F583091643198NQWZ5A
14:15:15.721 [pool-13-thread-4] INFO c.b.s.comet.ResetDatabaseListeners - Our map is Map(F583091643191B0N0EJ -> com.blendology.sojo_admin.comet.DispatcherActor@196008b8, F583091643198NQWZ5A -> com.blendology.sojo_admin.comet.DispatcherActor@366f6369)
14:15:15.721 [pool-13-thread-4] INFO c.b.s.comet.ResetDatabaseComet - Registering comet actor: com.blendology.sojo_admin.comet.ResetDatabaseComet@4ae79e6a
14:15:15.722 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1 ms
14:15:15.952 [http-8080-5] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on /test/generateData: 2106 ms
14:15:15.952 [pool-13-thread-6] INFO c.b.sojo_admin.comet.DispatcherActor - We are adding actor: com.blendology.sojo_admin.comet.ResetDatabaseComet@4ae79e6a to the list
14:15:16.438 [pool-13-thread-8] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception in thread "pool-13-thread-3"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-3"
14:15:26.722 [pool-13-thread-11] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:15:29.886 [pool-13-thread-8] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 13447 ms
Exception in thread "pool-13-thread-8" 14:15:46.793 [pool-13-thread-15] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-8"
14:15:47.472 [pool-13-thread-11] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 20749 ms
Exception in thread "http-8080-4" 14:15:48.608 [pool-13-thread-15] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1586 ms
Exception in thread "pool-13-thread-11"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-4"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-11"
Exception in thread "pool-13-thread-15"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-15"
14:15:56.931 [pool-13-thread-18] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:15:56.933 [pool-13-thread-20] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:15:59.168 [pool-13-thread-18] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2233 ms
14:15:59.619 [pool-13-thread-20] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2234 ms
Exception in thread "pool-13-thread-18"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-18"
Exception in thread "pool-13-thread-20" 14:16:07.223 [pool-13-thread-28] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:16:07.224 [pool-13-thread-22] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:16:10.844 [pool-13-thread-22] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 3617 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-20"
14:16:20.809 [pool-13-thread-28] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 13582 ms
Exception in thread "pool-13-thread-22" 14:16:27.794 [pool-13-thread-7] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-22"
Exception in thread "pool-13-thread-28" 14:16:36.169 [pool-13-thread-7] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 8372 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-28"
14:16:37.944 [pool-13-thread-10] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception in thread "pool-13-thread-7"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-7"
14:16:42.057 [pool-13-thread-10] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 4111 ms
Exception in thread "pool-13-thread-10" 14:16:48.254 [pool-13-thread-24] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:16:48.255 [pool-13-thread-14] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-10"
14:16:50.956 [pool-13-thread-24] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2698 ms
14:16:52.323 [pool-13-thread-14] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 4065 ms
Exception in thread "pool-13-thread-24" Exception in thread "pool-13-thread-14" 14:16:58.956 [pool-13-thread-26] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:16:58.958 [pool-13-thread-17] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-24"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-14"
14:17:01.854 [pool-13-thread-26] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2895 ms
14:17:04.547 [pool-13-thread-17] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 5587 ms
Exception in thread "pool-13-thread-26"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-26"
Exception in thread "pool-13-thread-17" 14:17:09.619 [pool-13-thread-21] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:17:09.620 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-17"
14:17:10.751 [pool-13-thread-21] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1128 ms
14:17:24.007 [pool-13-thread-2] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 14383 ms
Exception in thread "pool-13-thread-21"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-21"
14:17:30.175 [pool-13-thread-6] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception in thread "pool-13-thread-2"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-2"
14:17:32.875 [pool-13-thread-6] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2699 ms
Exception in thread "ReplicaSetStatus:Updater" Exception in thread "pool-13-thread-6" 14:17:40.331 [pool-13-thread-23] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:17:40.332 [pool-13-thread-31] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:17:41.882 [pool-13-thread-23] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 1550 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "ReplicaSetStatus:Updater"
14:17:43.189 [pool-13-thread-31] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2635 ms
Exception in thread "pool-13-thread-23"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-6"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-23"
Exception in thread "http-8080-9" Exception in thread "pool-13-thread-31"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-9"
14:17:51.760 [pool-13-thread-13] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
14:17:51.760 [pool-13-thread-33] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-31"
14:17:55.047 [pool-13-thread-13] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 3285 ms
Exception in thread "pool-13-thread-13" 14:18:02.991 [pool-13-thread-34] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-13"
14:18:08.272 [pool-13-thread-33] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 16511 ms
14:18:10.019 [pool-13-thread-34] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 7027 ms
Exception in thread "pool-13-thread-33"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-33"
Exception in thread "pool-13-thread-34"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-34"
14:18:23.252 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 0 ms
Exception in thread "http-8080-5" 14:18:25.886 [pool-13-thread-4] DEBUG bootstrap.liftweb.RequestAnalyzer - Total request time on Outside HTTP Request (e.g., on Actor): 2633 ms
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-5"
Exception in thread "pool-13-thread-4"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "pool-13-thread-4"
Exception in thread "http-8080-7"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-7"
Java HotSpot(TM) 64-Bit Server VM warning: Exception java.lang.OutOfMemoryError occurred dispatching signal SIGTERM to handler- the VM may need to be forcibly terminated
Exception in thread "http-8080-6"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "http-8080-6"
Java HotSpot(TM) 64-Bit Server VM warning: Exception java.lang.OutOfMemoryError occurred dispatching signal SIGTERM to handler- the VM may need to be forcibly terminated
Olek Swirski
Sep 5, 2012, 8:20:23 PM9/5/12
to lif...@googlegroups.com
i would go with :
-> Throw Tomcat in the sea, and run on embedded Jetty
:-) embedded jetty takes very little memory (still you can
give it more by using java options, but after fresh start
small liftweb/jetty bundle takes 60-80MB of RAM. I was
very surprised this was even possible.
-> Throw Tomcat in the sea, and run on embedded Jetty
:-) embedded jetty takes very little memory (still you can
give it more by using java options, but after fresh start
small liftweb/jetty bundle takes 60-80MB of RAM. I was
very surprised this was even possible.
--
--
Lift, the simply functional web framework: http://liftweb.net
Code: http://github.com/lift
Discussion: http://groups.google.com/group/liftweb
Stuck? Help us help you: https://www.assembla.com/wiki/show/liftweb/Posting_example_code
Diego Medina
Sep 5, 2012, 8:20:56 PM9/5/12
to lif...@googlegroups.com
Does it happen only when you shutdown Tomcat? or during normal operations?
As a workaround I would try going back to java6, and then I know lots of people use jetty instead of tomcat (but there are users with Lift on tomcat on productions.
At work we use jetty and haven't had any issues.
Regards,
Diego
Sent from my android cell
--
Naftoli Gugenheim
Sep 5, 2012, 8:24:24 PM9/5/12
to lif...@googlegroups.com
Does embedded jetty require less memory than the usual way of using jetty?
Olek Swirski
Sep 5, 2012, 8:30:42 PM9/5/12
to lif...@googlegroups.com
I don't really know why, but it takes several times less memory. I
think
it may have something to do, with standalone version loading many
unused jars into the memory. Same primitive app took oven 500MB on
my jetty server running in standalone mode. I was getting disappointed
with jetty because of that, because I knew, there was nothing special
in my app, that would really require all that memory. Then I took a look
at how much memory jetty takes, when run (embedded) from sbt. It
was around 100MB, so this made me think hard. In another thread you
can read results of my experiment :)
it may have something to do, with standalone version loading many
unused jars into the memory. Same primitive app took oven 500MB on
my jetty server running in standalone mode. I was getting disappointed
with jetty because of that, because I knew, there was nothing special
in my app, that would really require all that memory. Then I took a look
at how much memory jetty takes, when run (embedded) from sbt. It
was around 100MB, so this made me think hard. In another thread you
can read results of my experiment :)
Olek Swirski
Sep 5, 2012, 8:32:47 PM9/5/12
to lif...@googlegroups.com
still you will most probably give it more memory, when running some
serious app in production, but at least i know RAM is not wasted.
serious app in production, but at least i know RAM is not wasted.
Olek Swirski
Sep 5, 2012, 8:49:59 PM9/5/12
to lif...@googlegroups.com
also you will have each webapp completely separated. easy and quick
to restart without affecting others. long running tomcat with many
apps will always accumulate more and more memory which it
doesn't even use well. with embeded jetty it should be possible
to run 2 instances of same app. if you would some day need to
kill one instance, you first start a fallback one and direct traffic
to it. this would only drop some sessions (maybe even this can
be managed, just by not crating new sessions on an instance you
want to kill, and waiting for it to become idle). well even if the
user would be dropped and had to log in again, this is still much better
than downtime. I haven't done it yet, but I read people do that and should
work well. also you put your jar on any computer or server and
it has all it's libs in specific version you know it will work with.
each app can be even run on different java version (just use it
while compiling) then you run it with java -jar and it should work
almost anywhere.
to restart without affecting others. long running tomcat with many
apps will always accumulate more and more memory which it
doesn't even use well. with embeded jetty it should be possible
to run 2 instances of same app. if you would some day need to
kill one instance, you first start a fallback one and direct traffic
to it. this would only drop some sessions (maybe even this can
be managed, just by not crating new sessions on an instance you
want to kill, and waiting for it to become idle). well even if the
user would be dropped and had to log in again, this is still much better
than downtime. I haven't done it yet, but I read people do that and should
work well. also you put your jar on any computer or server and
it has all it's libs in specific version you know it will work with.
each app can be even run on different java version (just use it
while compiling) then you run it with java -jar and it should work
almost anywhere.
David Pollak
Sep 5, 2012, 11:31:58 PM9/5/12
to lif...@googlegroups.com
First, the out of memory errors have to do with PermGen. Please expand your PermGen heap (see http://www.brokenbuild.com/blog/2006/08/04/java-jvm-gc-permgen-and-memory-options/ ). It's likely that the way JDK 7 is jitting things differently and using more permgen space.
Tomcat has a darned annoying problem of complaining about thread local variables that are not cleared. Ignore it or disable it.
FWIW, I run Telegram on Ubuntu 12.04 with JDK 7 and Jetty. It's awesome. I've never had any good luck with Tomcat.
--
--
Lift, the simply functional web framework: http://liftweb.net
Code: http://github.com/lift
Discussion: http://groups.google.com/group/liftweb
Stuck? Help us help you: https://www.assembla.com/wiki/show/liftweb/Posting_example_code
Lift, the simply functional web framework http://liftweb.net
Grégoire Neuville
Sep 6, 2012, 4:44:48 AM9/6/12
to lif...@googlegroups.com
There seems to have been some work regarding ThreadLocals on tomcat 7
; maybe upgrading tomcat would be worth a try before throwing it away
?
Grégoire Neuville
; maybe upgrading tomcat would be worth a try before throwing it away
?
bg
Sep 6, 2012, 4:54:49 AM9/6/12
to lif...@googlegroups.com
Thanks for the responses. Few follow up questions:
Is threre a way to tell if the "SEVERE: The web application [] created a ThreadLocal but failed to remove it when the web application was stopped. This is very likely to create a memory leak." is causing the out of Perm gen, or is it more likely that I have multiple memory related issues?
We have -XX:PermSize=512m, I read that going too high can also cause issues - would anyone be brave enough to put a number on that (we only have 4gb total memory, and will have a very low usage app - 10s of users)
Any thoughts on why our other server, also with a version 6 tomcat does a little better?
David, do you run Jetty in embeded or stand alone? Interested as there are some comments regarding the stand alone's use of memory.
Does anyone have a recomendation for memory monitoring tools that they found to reveal all the answers for them (and worked well on Ubuntu)
Looks like our next steps will be:
Downgrade Java
Upgrade Tomcat
Change to Jetty embedded
Cheers all
Lukasz Kuczera
Sep 6, 2012, 5:31:22 AM9/6/12
to lif...@googlegroups.com
Don't worry about thread warnings in Tomcat it should clean stuff out. We use tomcat on production without any problems. I'd rather blame Java7 I had issues with JDK7 and saw people recommending OpenJDK for 7.
See my responses inlined.
On Thursday, September 6, 2012 10:54:49 AM UTC+2, bg wrote:
See my responses inlined.
On Thursday, September 6, 2012 10:54:49 AM UTC+2, bg wrote:
Is threre a way to tell if the "SEVERE: The web application [] created a ThreadLocal but failed to remove it when the web application was stopped. This is very likely to create a memory leak." is causing the out of Perm gen, or is it more likely that I have multiple memory related issues?
Its not related to PermGen. But it seems that you reload your application when tomcat is running, this can cause PermGen issues.
We have -XX:PermSize=512m, I read that going too high can also cause issues - would anyone be brave enough to put a number on that (we only have 4gb total memory, and will have a very low usage app - 10s of users)
This is more than enough for average webapp. Try to add -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC
Any thoughts on why our other server, also with a version 6 tomcat does a little better?
I recommend upgrading to Tomcat7 it handles better application reloading.
Alexandre Russel
Sep 6, 2012, 7:16:36 AM9/6/12
to lif...@googlegroups.com
> Is threre a way to tell if the "SEVERE: The web application [] created a
> ThreadLocal but failed to remove it when the web application was stopped.
> This is very likely to create a memory leak." is causing the out of Perm
> gen, or is it more likely that I have multiple memory related issues?
not if you are stopping tomcat you don't care about it. But if you
> ThreadLocal but failed to remove it when the web application was stopped.
> This is very likely to create a memory leak." is causing the out of Perm
> gen, or is it more likely that I have multiple memory related issues?
un/deploy your application without stopping tomcat, then you want to
get rid of it, clean up the ThreadLocal in one of the application or
servlet listener.
bg
Sep 6, 2012, 8:10:04 AM9/6/12
to lif...@googlegroups.com
OK so turns out we had missed that we had two config files, one in /etc/init.d/tomcat6 and the other one /etc/defaults/tomcat6 the later one overwrites the first. Java Visual VM shows a very nice graph of us understandably maxing out the default 96m of PermGen space. Now that we are using the correct config file and we have 512m things are much better.
Thanks for you input, I'll post any more related finding I get, but this one was pretty simple in the end.
David Pollak
Sep 6, 2012, 11:53:28 AM9/6/12
to lif...@googlegroups.com
On Thu, Sep 6, 2012 at 1:54 AM, bg <brent...@gmail.com> wrote:
Thanks for the responses. Few follow up questions:Is threre a way to tell if the "SEVERE: The web application [] created a ThreadLocal but failed to remove it when the web application was stopped. This is very likely to create a memory leak." is causing the out of Perm gen, or is it more likely that I have multiple memory related issues?
This has **NOTHING** to do with the PermGen issue. Please read the PermGen link and other information on PermGen.
PermGen is where the JVM stores classes. So, if you load lots and lots of classes into your JVM, you'll run out of PermGen. If you disable class garbage collection and reload your app without restarting your app server, you'll run out of PermGen.
But keeping thread-local variables around is not going to impact PermGen.
We have -XX:PermSize=512m, I read that going too high can also cause issues - would anyone be brave enough to put a number on that (we only have 4gb total memory, and will have a very low usage app - 10s of users)
Dunno.
Any thoughts on why our other server, also with a version 6 tomcat does a little better?David, do you run Jetty in embeded or stand alone? Interested as there are some comments regarding the stand alone's use of memory.
I run Jetty stand-alone. It works like a charm.
bg
Sep 6, 2012, 4:38:20 PM9/6/12
to lif...@googlegroups.com
Cheers all for your answers
Alastair Andrew
Nov 20, 2014, 8:17:37 AM11/20/14
to lif...@googlegroups.com
Sorry to hijack / revive this old thread, but I was encountering exactly the same warning message when stopping / undeploying my webapp in Tomcat 8.0.14. A severe ThreadLocal potential leak showing a scala.util.DynamicVariable key and a SystemLogHandler as the value. Google returned few hits of relevance other than this thread.
Here's my $0.02 for posterity:
The problem is that Tomcat wraps Scala println calls and is redirecting them to its logs (i.e. via SystemLogHandler bit). Replace any calls to println in your webapp with an appropriate logging framework call (in my case logback & slf4j) and that should resolve it.
...
Henrik Härkönen
Feb 11, 2017, 12:14:20 PM2/11/17
to Lift
Hey, cool, I can confirm this.
I was browsing through Tomcat 9.0.0.0 M15 logs on my Jelastic environments, and noticed couple of memory leak warnings.
Together with your tip about println()s and by adding the following line to boot.scala, I was able to get rid of all of the warnings / severitys:
Thanks!
-Henrik
I was browsing through Tomcat 9.0.0.0 M15 logs on my Jelastic environments, and noticed couple of memory leak warnings.
Together with your tip about println()s and by adding the following line to boot.scala, I was able to get rid of all of the warnings / severitys:
net.liftweb.actor.ThreadPoolRules.nullContextClassLoader = true(this to get rid of the Lift Scheduler thread warning)
Thanks!
-Henrik
Reply all
Reply to author
Forward
0 new messages