Jenkins on Ubuntu/PowerPC hangs

150 views
Skip to first unread message

Yossi Gottlieb

unread,
Dec 2, 2014, 7:31:26 PM12/2/14
to jenkins...@googlegroups.com
I'm struggling to get Jenkins to run on a Ubuntu Utopic (14.10) PowerPC (ppc64le) machine.

Initially I had an issue with JNA failing as the version bundled with Jenkins did not have a ppc64le shared object.  I managed to find a JNA 4.1 binary package, installed it and used jna.boot.library.path to get Jenkin's version to find the shared object.

Now everything looks fine in the logs but once Jenkins is up any HTTP request just hangs forever.  Sending commands on the SSH port, however, does seem to work.
I am not sure whether or not this problem is related to my JNA hack.  I did grab a trace but can't see anything that's obviously wrong there (but I am not familiar with Jenkins).  Any ideas on how to take it from here will be really appreciated.

The short version of the dump:
root@localhost:/usr/share/jenkins# grep -A 3 Waiting /tmp/javacore.20141202.181659.49199.0001.txt
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "HashSessionScavenger-0" (J9VMThread:0x00000000001F2800)
2LKMONINUSE      sys_mon_t:0x00003FFF8102C748 infl_mon_t: 0x00003FFF8102C7C8:
3LKMONOBJECT       java/lang/ref/ReferenceQueue@0x00000000E0483850: <unowned>
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "Java2D Disposer" (J9VMThread:0x00000000004F4500)
2LKMONINUSE      sys_mon_t:0x00003FFF81BEF718 infl_mon_t: 0x00003FFF81BEF798:
3LKMONOBJECT       java/util/TaskQueue@0x00000000E078E388: <unowned>
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "Jenkins cron thread" (J9VMThread:0x00000000005FC300)
NULL           
1LKREGMONDUMP  JVM System Monitor Dump (registered monitors):
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "GC Slave" (J9VMThread:0x000000000012BA00)
3LKWAITNOTIFY            "GC Slave" (J9VMThread:0x000000000012C900)
3LKWAITNOTIFY            "GC Slave" (J9VMThread:0x0000000000130B00)
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "Concurrent Mark Helper" (J9VMThread:0x0000000000127800)
2LKREGMON          MM_ConcurrentGC::initWork lock (0x00003FFF8002BE28): <unowned>
2LKREGMON          MM_ConcurrentGC::concurrentTuning lock (0x00003FFF8002BED8): <unowned>
--
3LKWAITERQ            Waiting to enter:
3LKWAITER                "JIT-SamplerThread" (J9VMThread:0x0000000000063800)
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "DestroyJavaVM helper thread" (J9VMThread:0x0000000000010500)
2LKREGMON          VM exclusive access lock (0x00003FFF80248CD8): <unowned>
2LKREGMON          VM Runtime flags Mutex lock (0x00003FFF80248D88): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "JIT Compilation Thread-1" (J9VMThread:0x0000000000059600)
2LKREGMON          JIT-SchedulingMonitor lock (0x00003FFF802E1AA8): <unowned>
2LKREGMON          JIT-DLTmonitor lock (0x00003FFF802E1B58): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "JIT Compilation Thread-0 Suspended" (J9VMThread:0x0000000000011400)
2LKREGMON          Thread public flags mutex lock (0x00003FFF802E20D8): <unowned>
2LKREGMON          &newThread->threadNameMutex lock (0x00003FFF802E2188): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "JIT Compilation Thread-2 Suspended" (J9VMThread:0x000000000005A500)
2LKREGMON          Thread public flags mutex lock (0x00003FFF802E24F8): <unowned>
2LKREGMON          &newThread->threadNameMutex lock (0x00003FFF802E25A8): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "JIT Compilation Thread-3 Suspended" (J9VMThread:0x000000000005E700)
2LKREGMON          Thread public flags mutex lock (0x00003FFF802E2708): <unowned>
2LKREGMON          &newThread->threadNameMutex lock (0x00003FFF802E27B8): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "JIT Diagnostic Compilation Thread-4 Suspended" (J9VMThread:0x000000000005F600)
2LKREGMON          Thread public flags mutex lock (0x00003FFF802E2918): <unowned>
2LKREGMON          &newThread->threadNameMutex lock (0x00003FFF802E29C8): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "IProfiler" (J9VMThread:0x0000000000064700)
2LKREGMON          Thread public flags mutex lock (0x00003FFF540008D8): <unowned>
2LKREGMON          &newThread->threadNameMutex lock (0x00003FFF54000988): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "MemoryPoolMXBean notification dispatcher" (J9VMThread:0x0000000000D13200)
2LKREGMON          &vm->managementData->dlparNotificationMonitor lock (0x00003FFF54000B98): <unowned>
2LKREGMON          JIT-QueueSlotMonitor-0 lock (0x00003FFF54000C48): <unowned>
--
3LKNOTIFYQ            Waiting to be notified:
3LKWAITNOTIFY            "Finalizer thread" (J9VMThread:0x00000000001C9600)
2LKREGMON          JIT-QueueSlotMonitor-8 lock (0x00003FFE580018A8): <unowned>
2LKREGMON          JIT-QueueSlotMonitor-9 lock (0x00003FFE58001958): <unowned>
--
3XMTHREADBLOCK     Waiting on: java/util/TaskQueue@0x00000000E0680B98 Owned by: <unowned>
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=2048 (0x800)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/lang/Object.wait(Native Method)
--
3XMTHREADBLOCK     Waiting on: java/util/TaskQueue@0x00000000E078E388 Owned by: <unowned>
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=0 (0x0)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/lang/Object.wait(Native Method)
--
3XMTHREADBLOCK     Waiting on: java/lang/ref/ReferenceQueue@0x00000000E0483850 Owned by: <unowned>
3XMHEAPALLOC             Heap bytes allocated since last GC cycle=0 (0x0)
3XMTHREADINFO3           Java callstack:
4XESTACKTRACE                at java/lang/Object.wait(Native Method)
--
3CLTEXTCLASS   hudson/model/Queue$WaitingItem(0x0000000000621500)
3CLTEXTCLASS   hudson/model/Queue$BuildableItem(0x0000000000620F00)
3CLTEXTCLASS   hudson/model/Queue$BlockedItem(0x0000000000620100)
3CLTEXTCLASS   hudson/model/Queue$NotWaitingItem(0x000000000061FC00)
3CLTEXTCLASS   hudson/model/Queue$Item(0x000000000061F300)
3CLTEXTCLASS   hudson/model/queue/ScheduleResult$Existing(0x000000000061E900)
3CLTEXTCLASS   hudson/model/queue/ScheduleResult$Created(0x000000000061E600)

Andrew Geissler

unread,
Nov 10, 2015, 5:38:19 PM11/10/15
to Jenkins Users
I tried to get this working as well today on a ppc64le Ubuntu install.  I get the same issue, no obvious errors but the web browser just continue to hang forever.

~/jenkins$ uname -a
Linux 3.16.0-44-generic #59-Ubuntu SMP Tue Jul 7 02:08:17 UTC 2015 ppc64le ppc64le ppc64le GNU/Linux
:~/jenkins$ java -version
java version "1.7.0_79"
OpenJDK Runtime Environment (IcedTea 2.5.5) (7u79-2.5.5-0ubuntu0.14.10.2)
OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)

(I added the extra mem in case it was an issue but didn't see any difference)
(I built this from a clean github clone today - 11/10/2015)

Any pointers would be appreciated, I've got the source code and can hack away if needed to debug.

~/jenkins$ java -Xmx1024M -Xms512M -jar ./war/target/jenkins.war --httpPort=8080
Running from: /home/andrewg/jenkins/war/target/jenkins.war
webroot: $user.home/.jenkins
Nov 10, 2015 4:14:30 PM winstone.Logger logInternal
INFO: Beginning extraction from war file
Nov 10, 2015 4:14:30 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: jetty-winstone-2.8
Nov 10, 2015 4:14:32 PM org.eclipse.jetty.util.log.JavaUtilLog info
INFO: NO JSP Support for , did not find org.apache.jasper.servlet.JspServlet
Jenkins home directory: /home/andrewg/.jenkins found at: $user.home/.jenkins
Nov 10, 2015 4:14:32 PM org.eclipse.jetty.util.log.JavaUtilLog info
Nov 10, 2015 4:14:32 PM winstone.Logger logInternal
INFO: Winstone Servlet Engine v2.0 running: controlPort=disabled
Nov 10, 2015 4:14:33 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Nov 10, 2015 4:14:33 PM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Nov 10, 2015 4:14:33 PM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Nov 10, 2015 4:14:33 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Nov 10, 2015 4:14:33 PM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs
Nov 10, 2015 4:14:35 PM hudson.model.AsyncPeriodicWork$1 run
INFO: Started Download metadata
Nov 10, 2015 4:14:35 PM hudson.model.AsyncPeriodicWork$1 run
INFO: Finished Download metadata. 2 ms
Nov 10, 2015 4:14:35 PM org.jenkinsci.main.modules.sshd.SSHD start
INFO: Started SSHD at port 55285
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Completed initialization
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Listed all plugins
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Prepared all plugins
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started all plugins
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Augmented all extensions
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Loaded all jobs
Nov 10, 2015 4:14:35 PM jenkins.InitReactorRunner$1 onAttained
INFO: Completed initialization
Nov 10, 2015 4:14:35 PM hudson.WebAppMain$3 run
INFO: Jenkins is fully up and running
2015-11-10 16:16:09
Full thread dump OpenJDK 64-Bit Server VM (24.79-b02 mixed mode):

"JmDNS(habcap11p1.local.).State.Timer" prio=10 tid=0x00003ffd30004000 nid=0x834b in Object.wait() [0x00003ffb8a9fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000f6a24c10> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000f6a24c10> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"JmDNS(habcap11p1.local.).Timer" daemon prio=10 tid=0x00003ffd30003000 nid=0x834a in Object.wait() [0x00003ffb8b5fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000f6a24540> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000f6a24540> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"SocketListener(habcap11p1.local.)" daemon prio=10 tid=0x00003ffd30008000 nid=0x8349 runnable [0x00003ffeaa3bd000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainDatagramSocketImpl.receive0(Native Method)
        - locked <0x00000000f69e95c0> (a java.net.PlainDatagramSocketImpl)
        at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:146)
        - locked <0x00000000f69e95c0> (a java.net.PlainDatagramSocketImpl)
        at java.net.DatagramSocket.receive(DatagramSocket.java:816)
        - locked <0x00000000f69f1c30> (a java.net.DatagramPacket)
        - locked <0x00000000f69da960> (a java.net.MulticastSocket)
        at javax.jmdns.impl.SocketListener.run(SocketListener.java:41)

"Jenkins UDP 33848 monitoring thread" prio=10 tid=0x00003ffe44131800 nid=0x8330 runnable [0x00003ffc86ffd000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainDatagramSocketImpl.receive0(Native Method)
        - locked <0x00000000f3fd8220> (a java.net.PlainDatagramSocketImpl)
        at java.net.AbstractPlainDatagramSocketImpl.receive(AbstractPlainDatagramSocketImpl.java:146)
        - locked <0x00000000f3fd8220> (a java.net.PlainDatagramSocketImpl)
        at java.net.DatagramSocket.receive(DatagramSocket.java:816)
        - locked <0x00000000f65b6ca0> (a java.net.DatagramPacket)
        - locked <0x00000000f3fd7038> (a java.net.MulticastSocket)
        at hudson.UDPBroadcastThread.run(UDPBroadcastThread.java:83)

"TCP slave agent listener port=0" prio=10 tid=0x00003ffe44133000 nid=0x832f runnable [0x00003ffc87ffd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
        - locked <0x00000000f3fccaa0> (a java.lang.Object)
        at hudson.TcpSlaveAgentListener.run(TcpSlaveAgentListener.java:95)

"NioSocketAcceptor-1" prio=10 tid=0x00003ffd6405d000 nid=0x832e runnable [0x00003ffb06ffd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000f3eea4f8> (a sun.nio.ch.Util$2)
        - locked <0x00000000f3eea4e8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000f3eea3d0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102)
        at org.apache.mina.transport.socket.nio.NioSocketAcceptor.select(NioSocketAcceptor.java:238)
        at org.apache.mina.core.polling.AbstractPollingIoAcceptor$Acceptor.run(AbstractPollingIoAcceptor.java:432)
        at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#10]" daemon prio=10 tid=0x00003ffd54004800 nid=0x832c waiting on condition [0x00003ffb071fd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#9]" daemon prio=10 tid=0x00003ffd74155000 nid=0x832b waiting on condition [0x00003ffb073fd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#8]" daemon prio=10 tid=0x00003ffd74032800 nid=0x8329 waiting on condition [0x00003ffb075fd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#7]" daemon prio=10 tid=0x00003ffd7400a800 nid=0x8326 waiting on condition [0x00003ffb077fd000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#6]" daemon prio=10 tid=0x00003ffd74008000 nid=0x8325 waiting on condition [0x00003ffb079fd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#5]" daemon prio=10 tid=0x00003ffd74006800 nid=0x8324 waiting on condition [0x00003ffb07bfd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#4]" daemon prio=10 tid=0x00003ffd74003800 nid=0x8323 waiting on condition [0x00003ffb07dfd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#3]" daemon prio=10 tid=0x00003ffd74005000 nid=0x8322 waiting on condition [0x00003ffb8834d000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#2]" daemon prio=10 tid=0x00003ffd78001800 nid=0x8321 waiting on condition [0x00003ffb07ffd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"jenkins.util.Timer [#1]" daemon prio=10 tid=0x00003ffe4408b800 nid=0x827f waiting on condition [0x00003ffe80bfd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000facfa318> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"Jenkins cron thread" prio=10 tid=0x00003ffe44038000 nid=0x827e in Object.wait() [0x00003ffe80dfd000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000fac9f210> (a java.util.TaskQueue)
        at java.lang.Object.wait(Object.java:503)
        at java.util.TimerThread.mainLoop(Timer.java:526)
        - locked <0x00000000fac9f210> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"DestroyJavaVM" prio=10 tid=0x00003fff78009800 nid=0x8214 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"LauncherControlThread[ControlPort=-1]" prio=10 tid=0x00003fff79624800 nid=0x827d waiting on condition [0x00003ffe80ffd000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at winstone.Launcher.run(Launcher.java:245)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#40] Acceptor19 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79622000 nid=0x827c waiting for monitor entry [0x00003ffe811fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#39] Acceptor18 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79620000 nid=0x827b runnable [0x00003ffe813fd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
        - locked <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#38] Acceptor17 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff7961e000 nid=0x827a waiting for monitor entry [0x00003ffe815fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#37] Acceptor16 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff7961b800 nid=0x8279 waiting for monitor entry [0x00003ffe817fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#36] Acceptor15 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79619800 nid=0x8278 waiting for monitor entry [0x00003ffe819fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#35] Acceptor14 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79617800 nid=0x8277 waiting for monitor entry [0x00003ffe81bfd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#34] Acceptor13 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79615800 nid=0x8276 waiting for monitor entry [0x00003ffe81dfd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#33] Acceptor12 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79613800 nid=0x8275 waiting for monitor entry [0x00003ffe81ffd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#32] Acceptor11 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79611800 nid=0x8274 waiting for monitor entry [0x00003ffe821fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#31] Acceptor10 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff7960f800 nid=0x8273 waiting for monitor entry [0x00003ffe823fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#30] Acceptor9 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff7960d000 nid=0x8272 waiting for monitor entry [0x00003ffe825fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#29] Acceptor8 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff7960b000 nid=0x8271 waiting for monitor entry [0x00003ffe827fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#28] Acceptor7 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79609000 nid=0x8270 waiting for monitor entry [0x00003ffe829fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#27] Acceptor6 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79606800 nid=0x826f waiting for monitor entry [0x00003ffe82bfd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#26] Acceptor5 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79604800 nid=0x826e waiting for monitor entry [0x00003ffe82dfd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#25] Acceptor4 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79602800 nid=0x826d waiting for monitor entry [0x00003ffe82ffd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#24] Acceptor3 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff79600800 nid=0x826c waiting for monitor entry [0x00003ffe831fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#23] Acceptor2 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff795fe000 nid=0x826b waiting for monitor entry [0x00003ffe833fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#22] Acceptor1 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff795fc000 nid=0x826a waiting for monitor entry [0x00003ffe835fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#21] Acceptor0 SelectChann...@0.0.0.0:8080" daemon prio=10 tid=0x00003fff795fa800 nid=0x8269 waiting for monitor entry [0x00003ffe837fd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
        at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        - waiting to lock <0x00000000fac9f550> (a java.lang.Object)
        at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#20] Selector19" daemon prio=10 tid=0x00003fff795f8000 nid=0x8268 runnable [0x00003ffe839fd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000facfc328> (a sun.nio.ch.Util$2)
        - locked <0x00000000facfc318> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000facfc1e0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#19] Selector18" daemon prio=10 tid=0x00003fff795f6000 nid=0x8267 runnable [0x00003ffe83bfd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad328e8> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad328d8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad327b0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#18] Selector17" daemon prio=10 tid=0x00003fff795f4000 nid=0x8266 runnable [0x00003ffe83dfd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000facfdb78> (a sun.nio.ch.Util$2)
        - locked <0x00000000facfdb68> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000facfda30> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#17] Selector16" daemon prio=10 tid=0x00003fff795f1800 nid=0x8265 runnable [0x00003ffe83ffd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000facff220> (a sun.nio.ch.Util$2)
        - locked <0x00000000facff210> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000facff0d8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#16] Selector15" daemon prio=10 tid=0x00003fff795ef800 nid=0x8264 runnable [0x00003ffea83bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad41530> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad41520> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad413e8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#15] Selector14" daemon prio=10 tid=0x00003fff795ed800 nid=0x8263 runnable [0x00003ffea85bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad42ba8> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad42b98> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad42a60> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#14] Selector13" daemon prio=10 tid=0x00003fff795eb800 nid=0x8262 runnable [0x00003ffea87bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad44250> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad44240> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad44108> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#13] Selector12" daemon prio=10 tid=0x00003fff795e9000 nid=0x8261 runnable [0x00003ffea89bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad35758> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad35748> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad35620> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#12] Selector11" daemon prio=10 tid=0x00003fff795e7000 nid=0x8260 runnable [0x00003ffea8bbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fac9fe00> (a sun.nio.ch.Util$2)
        - locked <0x00000000fac9fdf0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fac9fcc8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#11] Selector10" daemon prio=10 tid=0x00003fff795e5000 nid=0x825f runnable [0x00003ffea8dbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad34238> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad34228> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad34100> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#10] Selector9" daemon prio=10 tid=0x00003fff795e2800 nid=0x825e runnable [0x00003ffea8fbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad36ea0> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad36e90> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad36d68> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#9] Selector8" daemon prio=10 tid=0x00003fff795e0800 nid=0x825d runnable [0x00003ffea91bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad313a8> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad31398> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad31270> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#8] Selector7" daemon prio=10 tid=0x00003fff795de800 nid=0x825c runnable [0x00003ffea93bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad4ab20> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad4ab10> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad4a9e8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#7] Selector6" daemon prio=10 tid=0x00003fff795dc800 nid=0x825b runnable [0x00003ffea95bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad493f8> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad493e8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad492c0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#6] Selector5" daemon prio=10 tid=0x00003fff795da000 nid=0x825a runnable [0x00003ffea97bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad46490> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad46480> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad46348> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#5] Selector4" daemon prio=10 tid=0x00003fff795d8000 nid=0x8259 runnable [0x00003ffea99bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad4d970> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad4d960> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad4d838> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#4] Selector3" daemon prio=10 tid=0x00003fff795d6000 nid=0x8258 runnable [0x00003ffea9bbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad4c040> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad4c030> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad4bf08> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#3] Selector2" daemon prio=10 tid=0x00003fff795d3800 nid=0x8257 runnable [0x00003ffea9dbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad4fb10> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad4fb00> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad4f9d8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#2] Selector1" daemon prio=10 tid=0x00003fff795d2000 nid=0x8256 runnable [0x00003ffea9fbd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000facfab60> (a sun.nio.ch.Util$2)
        - locked <0x00000000facfab50> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000facfaa08> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"RequestHandlerThread[#1] Selector0" daemon prio=10 tid=0x00003fff7934e800 nid=0x8255 runnable [0x00003ffeaa1bd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        - locked <0x00000000fad58060> (a sun.nio.ch.Util$2)
        - locked <0x00000000fad58050> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000000fad47ee8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"Java2D Disposer" daemon prio=10 tid=0x00003fff79302800 nid=0x8253 in Object.wait() [0x00003ffeaa5bd000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000fad5ad50> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
        - locked <0x00000000fad5ad50> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at sun.java2d.Disposer.run(Disposer.java:145)
        at java.lang.Thread.run(Thread.java:745)

"HashSessionScavenger-0" daemon prio=10 tid=0x00003fff79066000 nid=0x8252 in Object.wait() [0x00003ffeab69d000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000fad5aec8> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000fad5aec8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"Service Thread" daemon prio=10 tid=0x00003fff78804800 nid=0x8250 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" daemon prio=10 tid=0x00003fff78802000 nid=0x824f waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" daemon prio=10 tid=0x00003fff787ff000 nid=0x824e waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x00003fff787fd000 nid=0x824d waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x00003fff787d1800 nid=0x824c in Object.wait() [0x00003ffeb99fd000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000fad20ee8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
        - locked <0x00000000fad20ee8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" daemon prio=10 tid=0x00003fff787cf800 nid=0x824b in Object.wait() [0x00003ffeb9bfd000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000fad20978> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:503)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
        - locked <0x00000000fad20978> (a java.lang.ref.Reference$Lock)

"VM Thread" prio=10 tid=0x00003fff787cb000 nid=0x824a runnable 

"GC task thread#0 (ParallelGC)" prio=10 tid=0x00003fff7801f800 nid=0x8215 runnable 

"GC task thread#1 (ParallelGC)" prio=10 tid=0x00003fff78021800 nid=0x8216 runnable 

"GC task thread#2 (ParallelGC)" prio=10 tid=0x00003fff78023800 nid=0x8217 runnable 

"GC task thread#3 (ParallelGC)" prio=10 tid=0x00003fff78025800 nid=0x8218 runnable 

"GC task thread#4 (ParallelGC)" prio=10 tid=0x00003fff78027000 nid=0x8219 runnable 

"GC task thread#5 (ParallelGC)" prio=10 tid=0x00003fff78029000 nid=0x821a runnable 

"GC task thread#6 (ParallelGC)" prio=10 tid=0x00003fff7802b000 nid=0x821b runnable 

"GC task thread#7 (ParallelGC)" prio=10 tid=0x00003fff7802d000 nid=0x821c runnable 

"GC task thread#8 (ParallelGC)" prio=10 tid=0x00003fff7802f000 nid=0x821d runnable 

"GC task thread#9 (ParallelGC)" prio=10 tid=0x00003fff78031000 nid=0x821e runnable 

"GC task thread#10 (ParallelGC)" prio=10 tid=0x00003fff78033000 nid=0x821f runnable 

"GC task thread#11 (ParallelGC)" prio=10 tid=0x00003fff78034800 nid=0x8220 runnable 

"GC task thread#12 (ParallelGC)" prio=10 tid=0x00003fff78036800 nid=0x8221 runnable 

"GC task thread#13 (ParallelGC)" prio=10 tid=0x00003fff78038800 nid=0x8222 runnable 

"GC task thread#14 (ParallelGC)" prio=10 tid=0x00003fff7803a800 nid=0x8223 runnable 

"GC task thread#15 (ParallelGC)" prio=10 tid=0x00003fff7803c800 nid=0x8224 runnable 

"GC task thread#16 (ParallelGC)" prio=10 tid=0x00003fff7803e800 nid=0x8225 runnable 

"GC task thread#17 (ParallelGC)" prio=10 tid=0x00003fff78040000 nid=0x8226 runnable 

"GC task thread#18 (ParallelGC)" prio=10 tid=0x00003fff78042000 nid=0x8227 runnable 

"GC task thread#19 (ParallelGC)" prio=10 tid=0x00003fff78044000 nid=0x8228 runnable 

"GC task thread#20 (ParallelGC)" prio=10 tid=0x00003fff78046000 nid=0x8229 runnable 

"GC task thread#21 (ParallelGC)" prio=10 tid=0x00003fff78048000 nid=0x822a runnable 

"GC task thread#22 (ParallelGC)" prio=10 tid=0x00003fff7804a000 nid=0x822b runnable 

"GC task thread#23 (ParallelGC)" prio=10 tid=0x00003fff7804c000 nid=0x822c runnable 

"GC task thread#24 (ParallelGC)" prio=10 tid=0x00003fff7804d800 nid=0x822d runnable 

"GC task thread#25 (ParallelGC)" prio=10 tid=0x00003fff7804f800 nid=0x822e runnable 

"GC task thread#26 (ParallelGC)" prio=10 tid=0x00003fff78051800 nid=0x822f runnable 

"GC task thread#27 (ParallelGC)" prio=10 tid=0x00003fff78053800 nid=0x8230 runnable 

"GC task thread#28 (ParallelGC)" prio=10 tid=0x00003fff78055800 nid=0x8231 runnable 

"GC task thread#29 (ParallelGC)" prio=10 tid=0x00003fff78057800 nid=0x8232 runnable 

"GC task thread#30 (ParallelGC)" prio=10 tid=0x00003fff78059000 nid=0x8233 runnable 

"GC task thread#31 (ParallelGC)" prio=10 tid=0x00003fff7805b000 nid=0x8234 runnable 

"GC task thread#32 (ParallelGC)" prio=10 tid=0x00003fff7805d000 nid=0x8235 runnable 

"GC task thread#33 (ParallelGC)" prio=10 tid=0x00003fff7805f000 nid=0x8236 runnable 

"GC task thread#34 (ParallelGC)" prio=10 tid=0x00003fff78061000 nid=0x8237 runnable 

"GC task thread#35 (ParallelGC)" prio=10 tid=0x00003fff78063000 nid=0x8238 runnable 

"GC task thread#36 (ParallelGC)" prio=10 tid=0x00003fff78064800 nid=0x8239 runnable 

"GC task thread#37 (ParallelGC)" prio=10 tid=0x00003fff78066800 nid=0x823a runnable 

"GC task thread#38 (ParallelGC)" prio=10 tid=0x00003fff78068800 nid=0x823b runnable 

"GC task thread#39 (ParallelGC)" prio=10 tid=0x00003fff7806a800 nid=0x823c runnable 

"GC task thread#40 (ParallelGC)" prio=10 tid=0x00003fff7806c800 nid=0x823d runnable 

"GC task thread#41 (ParallelGC)" prio=10 tid=0x00003fff7806e800 nid=0x823e runnable 

"GC task thread#42 (ParallelGC)" prio=10 tid=0x00003fff78070800 nid=0x823f runnable 

"GC task thread#43 (ParallelGC)" prio=10 tid=0x00003fff78072000 nid=0x8240 runnable 

"GC task thread#44 (ParallelGC)" prio=10 tid=0x00003fff78074000 nid=0x8241 runnable 

"GC task thread#45 (ParallelGC)" prio=10 tid=0x00003fff78076000 nid=0x8242 runnable 

"GC task thread#46 (ParallelGC)" prio=10 tid=0x00003fff78078000 nid=0x8243 runnable 

"GC task thread#47 (ParallelGC)" prio=10 tid=0x00003fff7807a000 nid=0x8244 runnable 

"GC task thread#48 (ParallelGC)" prio=10 tid=0x00003fff7807c000 nid=0x8245 runnable 

"GC task thread#49 (ParallelGC)" prio=10 tid=0x00003fff7807d800 nid=0x8246 runnable 

"GC task thread#50 (ParallelGC)" prio=10 tid=0x00003fff7807f800 nid=0x8247 runnable 

"GC task thread#51 (ParallelGC)" prio=10 tid=0x00003fff78081800 nid=0x8248 runnable 

"GC task thread#52 (ParallelGC)" prio=10 tid=0x00003fff78083800 nid=0x8249 runnable 

"VM Periodic Task Thread" prio=10 tid=0x00003fff7880f000 nid=0x8251 waiting on condition 

JNI global references: 292

Heap
 PSYoungGen      total 285696K, used 224469K [0x00000000eaa80000, 0x0000000100000000, 0x0000000100000000)
  eden space 264192K, 79% used [0x00000000eaa80000,0x00000000f76ac620,0x00000000fac80000)
  from space 21504K, 71% used [0x00000000fac80000,0x00000000fbb890a8,0x00000000fc180000)
  to   space 21504K, 0% used [0x00000000feb00000,0x00000000feb00000,0x0000000100000000)
 ParOldGen       total 349696K, used 88K [0x00000000c0000000, 0x00000000d5580000, 0x00000000eaa80000)
  object space 349696K, 0% used [0x00000000c0000000,0x00000000c0016010,0x00000000d5580000)
 PSPermGen       total 38912K, used 38698K [0x00000000bc000000, 0x00000000be600000, 0x00000000c0000000)
  object space 38912K, 99% used [0x00000000bc000000,0x00000000be5ca808,0x00000000be600000)

Andrew Geissler

unread,
Nov 11, 2015, 11:29:11 PM11/11/15
to Jenkins Users
Everyone that's blocked is blocked on a lock that RequestHandlerThread[#39] owns.  That thread seems to be sitting in at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method).  I'm wondering if the native implementation of that accept interface is not fully implemented on ppc64 le.

Andrew Geissler

unread,
Dec 23, 2015, 10:39:51 AM12/23/15
to Jenkins Users
I ended up getting things to work by just installing jenkins into apache tomcat7 on the ppc64le Ubuntu 14.10 server (vs. using the built in jenkins web server).
...

Andrew Geissler

unread,
Mar 22, 2016, 6:39:06 PM3/22/16
to Jenkins Users
Made a docker image as well, def needs some TLC but gets the job done - https://hub.docker.com/r/geissonator/ubuntu-jenkins-ppc64le/
Reply all
Reply to author
Forward
0 new messages