jstack trace of unresponsive master

[Eriks]

I have a situation were the flume master becomes unresponsive and
ultimately causes the load on the box to cause me to reboot the
server.

This is a stack trace of the flume-master while I attempted to execute
"getconfigs". It was not responding.

There is a deadlock at the end.

2011-06-10 16:32:52
Full thread dump OpenJDK 64-Bit Server VM (19.0-b09 mixed mode):

"pool-1-thread-205" prio=10 tid=0x00000000014d8000 nid=0xa5d runnable
[0x00007f6993a79000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:146)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked <0x00000007d7ff30f8> (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:
127)
at
com.cloudera.flume.handlers.thrift.TStatsTransport.read(TStatsTransport.java:
59)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:
378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:
297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:
204)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:626)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-204" prio=10 tid=0x00000000014d5800 nid=0xa5c waiting
for monitor entry [0x00007f6993b7a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-203" prio=10 tid=0x00000000014d3800 nid=0xa5b waiting
for monitor entry [0x00007f6993c7b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-3-thread-1" prio=10 tid=0x00000000014d1000 nid=0xa5a runnable
[0x00007f6993d7c000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:146)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked <0x00000007d9493408> (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:
127)
at
com.cloudera.flume.handlers.thrift.TStatsTransport.read(TStatsTransport.java:
59)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:
378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:
297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:
204)
at com.cloudera.flume.reporter.server.thrift.ThriftFlumeReportServer
$Processor.process(ThriftFlumeReportServer.java:252)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-2-thread-1" prio=10 tid=0x00000000014cf000 nid=0xa59 waiting for
monitor entry [0x00007f6993e7d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getAllConfigs(TranslatingConfigurationManager.java:
213)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterAdminServer.getConfigs(MasterAdminServer.java:
93)
at
com.cloudera.flume.master.MasterAdminServerThrift.getConfigs(MasterAdminServerThrift.java:
158)
at com.cloudera.flume.conf.thrift.FlumeMasterAdminServer$Processor
$getConfigs.process(FlumeMasterAdminServer.java:820)
at com.cloudera.flume.conf.thrift.FlumeMasterAdminServer
$Processor.process(FlumeMasterAdminServer.java:692)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-202" prio=10 tid=0x00000000014cd000 nid=0xa58 waiting
for monitor entry [0x00007f6993f7e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-201" prio=10 tid=0x00000000018b8000 nid=0xa57 waiting
for monitor entry [0x00007f699407f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-200" prio=10 tid=0x00000000018b6000 nid=0xa56 waiting
for monitor entry [0x00007f6994180000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-199" prio=10 tid=0x00000000018b3800 nid=0xa55 waiting
for monitor entry [0x00007f6994281000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-198" prio=10 tid=0x00000000018b1800 nid=0xa54 waiting
for monitor entry [0x00007f6994382000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-197" prio=10 tid=0x00000000018af800 nid=0xa53 waiting
for monitor entry [0x00007f6994483000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-196" prio=10 tid=0x00000000018ad000 nid=0xa52 waiting
for monitor entry [0x00007f6994584000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-195" prio=10 tid=0x00000000018ab000 nid=0xa51 waiting
for monitor entry [0x00007f6994685000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-194" prio=10 tid=0x00000000019c9800 nid=0xa50 waiting
for monitor entry [0x00007f6994786000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-193" prio=10 tid=0x00000000019c7800 nid=0xa4f waiting
for monitor entry [0x00007f6994887000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-192" prio=10 tid=0x00000000019c5800 nid=0xa4e waiting
for monitor entry [0x00007f6994988000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-191" prio=10 tid=0x00000000019c3000 nid=0xa4d waiting
for monitor entry [0x00007f6994a89000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-190" prio=10 tid=0x00000000019c1000 nid=0xa4c waiting
for monitor entry [0x00007f6994b8a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-189" prio=10 tid=0x00000000019bf000 nid=0xa4b waiting
for monitor entry [0x00007f6994c8b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-188" prio=10 tid=0x00000000019bc800 nid=0xa4a waiting
for monitor entry [0x00007f6994d8c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-187" prio=10 tid=0x00000000019bb000 nid=0xa49 waiting
for monitor entry [0x00007f6994e8d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-186" prio=10 tid=0x0000000001a7c800 nid=0xa48 waiting
for monitor entry [0x00007f6994f8e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-185" prio=10 tid=0x0000000001a7a000 nid=0xa47 waiting
for monitor entry [0x00007f699508f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-184" prio=10 tid=0x0000000001a78000 nid=0xa46 waiting
for monitor entry [0x00007f6995190000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-183" prio=10 tid=0x0000000001a76000 nid=0xa45 waiting
for monitor entry [0x00007f6995291000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-182" prio=10 tid=0x0000000001a73800 nid=0xa44 waiting
for monitor entry [0x00007f6995392000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-181" prio=10 tid=0x0000000001a71800 nid=0xa43 waiting
for monitor entry [0x00007f6995493000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-180" prio=10 tid=0x0000000001a6f800 nid=0xa42 waiting
for monitor entry [0x00007f6995594000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-179" prio=10 tid=0x000000000146e000 nid=0xa40 waiting
for monitor entry [0x00007f6995695000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-178" prio=10 tid=0x000000000146c000 nid=0xa3f waiting
for monitor entry [0x00007f6995796000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-177" prio=10 tid=0x000000000146a000 nid=0xa3e waiting
for monitor entry [0x00007f6995897000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-176" prio=10 tid=0x0000000001467800 nid=0xa3d waiting
for monitor entry [0x00007f6995998000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-175" prio=10 tid=0x0000000001465800 nid=0xa3c waiting
for monitor entry [0x00007f6995a99000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-174" prio=10 tid=0x0000000001463800 nid=0xa3b waiting
for monitor entry [0x00007f6995b9a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-173" prio=10 tid=0x0000000001461000 nid=0xa3a waiting
for monitor entry [0x00007f6995c9b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-172" prio=10 tid=0x0000000001f4e000 nid=0xa39 waiting
for monitor entry [0x00007f6995d9c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-171" prio=10 tid=0x0000000001f4c000 nid=0xa38 waiting
for monitor entry [0x00007f6995e9d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-170" prio=10 tid=0x0000000001f49800 nid=0xa37 waiting
for monitor entry [0x00007f6995f9e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-169" prio=10 tid=0x0000000001f47800 nid=0xa36 waiting
for monitor entry [0x00007f699609f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-168" prio=10 tid=0x0000000001f45800 nid=0xa35 waiting
for monitor entry [0x00007f69961a0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-167" prio=10 tid=0x0000000001f43000 nid=0xa34 waiting
for monitor entry [0x00007f69962a1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-166" prio=10 tid=0x0000000001f41000 nid=0xa33 waiting
for monitor entry [0x00007f69963a2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-165" prio=10 tid=0x0000000001f40000 nid=0xa32 waiting
for monitor entry [0x00007f69964a3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-164" prio=10 tid=0x00000000014ef800 nid=0xa31 waiting
for monitor entry [0x00007f69965a4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-163" prio=10 tid=0x00000000014ed000 nid=0xa30 waiting
for monitor entry [0x00007f69966a5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-162" prio=10 tid=0x00000000014eb000 nid=0xa2f waiting
for monitor entry [0x00007f69967a6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-161" prio=10 tid=0x00000000014e9000 nid=0xa2e waiting
for monitor entry [0x00007f69968a7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-160" prio=10 tid=0x00000000014e6800 nid=0xa2d runnable
[0x00007f69969a8000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:146)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked <0x00000007d7fcbb58> (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:
127)
at
com.cloudera.flume.handlers.thrift.TStatsTransport.read(TStatsTransport.java:
59)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:
378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:
297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:
204)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:626)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-159" prio=10 tid=0x00000000014e4800 nid=0xa2c waiting
for monitor entry [0x00007f6996aa9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-158" prio=10 tid=0x000000000208d000 nid=0xa2b waiting
for monitor entry [0x00007f6996baa000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-157" prio=10 tid=0x000000000208a800 nid=0xa2a waiting
for monitor entry [0x00007f6996cab000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-156" prio=10 tid=0x0000000002088800 nid=0xa29 waiting
for monitor entry [0x00007f6996dac000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-155" prio=10 tid=0x0000000002086800 nid=0xa28 runnable
[0x00007f6996ead000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:146)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked <0x00000007d7fc6db8> (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:
127)
at
com.cloudera.flume.handlers.thrift.TStatsTransport.read(TStatsTransport.java:
59)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:
378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:
297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:
204)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:626)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-154" prio=10 tid=0x0000000002085000 nid=0xa27 waiting
for monitor entry [0x00007f6996fae000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-153" prio=10 tid=0x0000000001974800 nid=0xa26 waiting
for monitor entry [0x00007f69970af000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-152" prio=10 tid=0x0000000001973000 nid=0xa25 waiting
for monitor entry [0x00007f69971b0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-151" prio=10 tid=0x0000000001971000 nid=0xa23 waiting
for monitor entry [0x00007f69972b1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-150" prio=10 tid=0x000000000196f000 nid=0xa22 waiting
for monitor entry [0x00007f69973b2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-149" prio=10 tid=0x000000000132a800 nid=0xa21 waiting
for monitor entry [0x00007f69974b3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-148" prio=10 tid=0x0000000001328800 nid=0xa20 waiting
for monitor entry [0x00007f69975b4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-147" prio=10 tid=0x0000000001326000 nid=0xa1f waiting
for monitor entry [0x00007f69976b5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-146" prio=10 tid=0x00000000019a5000 nid=0xa1e waiting
for monitor entry [0x00007f69977b6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-145" prio=10 tid=0x00000000019a3000 nid=0xa1d waiting
for monitor entry [0x00007f69978b7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-144" prio=10 tid=0x00000000019a0800 nid=0xa1c waiting
for monitor entry [0x00007f69979b8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-143" prio=10 tid=0x000000000199e800 nid=0xa1b waiting
for monitor entry [0x00007f6997ab9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-142" prio=10 tid=0x0000000001629000 nid=0xa1a waiting
for monitor entry [0x00007f6997bba000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-141" prio=10 tid=0x0000000001627000 nid=0xa19 waiting
for monitor entry [0x00007f6997cbb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-140" prio=10 tid=0x0000000002318000 nid=0xa18 waiting
for monitor entry [0x00007f6997dbc000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-139" prio=10 tid=0x0000000002315800 nid=0xa17 waiting
for monitor entry [0x00007f6997ebd000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-138" prio=10 tid=0x0000000002313800 nid=0xa16 waiting
for monitor entry [0x00007f6997fbe000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-137" prio=10 tid=0x0000000002311800 nid=0xa15 waiting
for monitor entry [0x00007f69980bf000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-136" prio=10 tid=0x0000000001c4d000 nid=0xa14 waiting
for monitor entry [0x00007f69981c0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-135" prio=10 tid=0x0000000001c4a800 nid=0xa13 waiting
for monitor entry [0x00007f69982c1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-134" prio=10 tid=0x0000000001c48800 nid=0xa12 waiting
for monitor entry [0x00007f69983c2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-133" prio=10 tid=0x0000000002280000 nid=0xa11 waiting
for monitor entry [0x00007f69984c3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-132" prio=10 tid=0x000000000227e000 nid=0xa10 waiting
for monitor entry [0x00007f69985c4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-131" prio=10 tid=0x000000000227b800 nid=0xa0f waiting
for monitor entry [0x00007f69986c5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-130" prio=10 tid=0x0000000002279800 nid=0xa0d waiting
for monitor entry [0x00007f69987c6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-129" prio=10 tid=0x0000000001f89800 nid=0xa0c waiting
for monitor entry [0x00007f69988c7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-128" prio=10 tid=0x0000000001f87000 nid=0xa0b waiting
for monitor entry [0x00007f69989c8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-127" prio=10 tid=0x0000000001f85000 nid=0xa0a waiting
for monitor entry [0x00007f6998ac9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-126" prio=10 tid=0x0000000001f83800 nid=0xa09 waiting
for monitor entry [0x00007f6998bca000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-125" prio=10 tid=0x000000000163f000 nid=0xa08 waiting
for monitor entry [0x00007f6998ccb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-124" prio=10 tid=0x000000000163d000 nid=0xa07 waiting
for monitor entry [0x00007f6998dcc000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-123" prio=10 tid=0x000000000163a800 nid=0xa06 waiting
for monitor entry [0x00007f6998ecd000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-122" prio=10 tid=0x0000000001a2a000 nid=0xa05 waiting
for monitor entry [0x00007f6998fce000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-121" prio=10 tid=0x0000000001a27800 nid=0xa04 waiting
for monitor entry [0x00007f69990cf000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-120" prio=10 tid=0x0000000001a25800 nid=0xa03 waiting
for monitor entry [0x00007f69991d0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-119" prio=10 tid=0x0000000001a23000 nid=0xa02 waiting
for monitor entry [0x00007f69992d1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-118" prio=10 tid=0x0000000001b42800 nid=0xa01 waiting
for monitor entry [0x00007f69993d2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-117" prio=10 tid=0x0000000001b40800 nid=0xa00 waiting
for monitor entry [0x00007f69994d3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-116" prio=10 tid=0x0000000001b3e000 nid=0x9ff waiting
for monitor entry [0x00007f69995d4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-115" prio=10 tid=0x0000000001b3c800 nid=0x9fe waiting
for monitor entry [0x00007f69996d5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-114" prio=10 tid=0x0000000001785800 nid=0x9fd waiting
for monitor entry [0x00007f69997d6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-113" prio=10 tid=0x0000000001783800 nid=0x9fc waiting
for monitor entry [0x00007f69998d7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-112" prio=10 tid=0x0000000001781800 nid=0x9fb waiting
for monitor entry [0x00007f69999d8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-111" prio=10 tid=0x000000000164a800 nid=0x9fa waiting
for monitor entry [0x00007f6999ad9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-110" prio=10 tid=0x0000000001648800 nid=0x9f9 waiting
for monitor entry [0x00007f6999bda000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-109" prio=10 tid=0x0000000001646000 nid=0x9f8 waiting
for monitor entry [0x00007f6999cdb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-108" prio=10 tid=0x0000000001644000 nid=0x9f7 waiting
for monitor entry [0x00007f6999ddc000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-107" prio=10 tid=0x0000000002247000 nid=0x9f6 waiting
for monitor entry [0x00007f6999edd000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-106" prio=10 tid=0x0000000002245800 nid=0x9f5 waiting
for monitor entry [0x00007f6999fde000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-105" prio=10 tid=0x0000000002244000 nid=0x9f4 waiting
for monitor entry [0x00007f699a0df000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-104" prio=10 tid=0x0000000002242000 nid=0x9f3 waiting
for monitor entry [0x00007f699a1e0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-103" prio=10 tid=0x00000000016a1000 nid=0x9f2 waiting
for monitor entry [0x00007f699a2e1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-102" prio=10 tid=0x000000000169f000 nid=0x9f1 waiting
for monitor entry [0x00007f699a3e2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-101" prio=10 tid=0x000000000169d000 nid=0x9ef waiting
for monitor entry [0x00007f699a4e3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-100" prio=10 tid=0x000000000169a800 nid=0x9ee waiting
for monitor entry [0x00007f699a5e4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-99" prio=10 tid=0x00000000018e4800 nid=0x9ed waiting
for monitor entry [0x00007f699a6e5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-98" prio=10 tid=0x00000000018e2000 nid=0x9ec waiting
for monitor entry [0x00007f699a7e6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-97" prio=10 tid=0x00000000018e0000 nid=0x9eb waiting
for monitor entry [0x00007f699a8e7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-96" prio=10 tid=0x0000000001f68000 nid=0x9ea waiting
for monitor entry [0x00007f699a9e8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-95" prio=10 tid=0x0000000001f66000 nid=0x9e9 waiting
for monitor entry [0x00007f699aae9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-94" prio=10 tid=0x0000000001f64000 nid=0x9e8 waiting
for monitor entry [0x00007f699abea000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-93" prio=10 tid=0x0000000001f61800 nid=0x9e7 waiting
for monitor entry [0x00007f699aceb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-92" prio=10 tid=0x0000000002167800 nid=0x9e6 waiting
for monitor entry [0x00007f699adec000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-91" prio=10 tid=0x0000000002165000 nid=0x9e5 waiting
for monitor entry [0x00007f699aeed000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-90" prio=10 tid=0x0000000002163000 nid=0x9e4 waiting
for monitor entry [0x00007f699afee000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-89" prio=10 tid=0x0000000002161000 nid=0x9e3 waiting
for monitor entry [0x00007f699b0ef000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-88" prio=10 tid=0x00000000018cf800 nid=0x9e2 waiting
for monitor entry [0x00007f699b1f0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-87" prio=10 tid=0x00000000018cd800 nid=0x9e1 waiting
for monitor entry [0x00007f699b2f1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-86" prio=10 tid=0x00000000018cb000 nid=0x9e0 waiting
for monitor entry [0x00007f699b3f2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-85" prio=10 tid=0x00000000014f9000 nid=0x9df waiting
for monitor entry [0x00007f699b4f3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-84" prio=10 tid=0x00000000014f6800 nid=0x9de waiting
for monitor entry [0x00007f699b5f4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-83" prio=10 tid=0x00000000014f4800 nid=0x9dd waiting
for monitor entry [0x00007f699b6f5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-82" prio=10 tid=0x00000000014f2000 nid=0x9dc waiting
for monitor entry [0x00007f699b7f6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-81" prio=10 tid=0x0000000001476800 nid=0x9db waiting
for monitor entry [0x00007f699b8f7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-80" prio=10 tid=0x0000000001475000 nid=0x9da waiting
for monitor entry [0x00007f699b9f8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-79" prio=10 tid=0x0000000001473800 nid=0x9d9 waiting
for monitor entry [0x00007f699baf9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-78" prio=10 tid=0x0000000001471800 nid=0x9d8 waiting
for monitor entry [0x00007f699bbfa000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-77" prio=10 tid=0x00000000020e4000 nid=0x9d7 waiting
for monitor entry [0x00007f699bcfb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-76" prio=10 tid=0x00000000020e2000 nid=0x9d6 waiting
for monitor entry [0x00007f699bdfc000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-75" prio=10 tid=0x00000000020df800 nid=0x9c9 waiting
for monitor entry [0x00007f699befd000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-74" prio=10 tid=0x00000000020de000 nid=0x9c8 waiting
for monitor entry [0x00007f699bffe000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-73" prio=10 tid=0x00000000015c1800 nid=0x9c7 waiting
for monitor entry [0x00007f69a0172000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-72" prio=10 tid=0x00000000015c0000 nid=0x9c6 waiting
for monitor entry [0x00007f69a0273000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-71" prio=10 tid=0x00000000015be000 nid=0x9c5 waiting
for monitor entry [0x00007f69a0374000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-70" prio=10 tid=0x00000000015bc800 nid=0x9c4 waiting
for monitor entry [0x00007f69a0475000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-69" prio=10 tid=0x00000000015bb000 nid=0x9c3 waiting
for monitor entry [0x00007f69a0576000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-68" prio=10 tid=0x0000000002330800 nid=0x9c2 waiting
for monitor entry [0x00007f69a0677000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-67" prio=10 tid=0x000000000232e800 nid=0x9c1 waiting
for monitor entry [0x00007f69a0778000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-66" prio=10 tid=0x000000000232d000 nid=0x9c0 waiting
for monitor entry [0x00007f69a0879000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-65" prio=10 tid=0x0000000002097800 nid=0x9bf waiting
for monitor entry [0x00007f69a097a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-64" prio=10 tid=0x0000000002096000 nid=0x9be waiting
for monitor entry [0x00007f69a0a7b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-63" prio=10 tid=0x0000000002094000 nid=0x9bd waiting
for monitor entry [0x00007f69a0b7c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-62" prio=10 tid=0x0000000002092000 nid=0x9bc waiting
for monitor entry [0x00007f69a0c7d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-61" prio=10 tid=0x0000000001f05800 nid=0x9bb waiting
for monitor entry [0x00007f69a0d7e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-60" prio=10 tid=0x0000000001f03000 nid=0x9ba waiting
for monitor entry [0x00007f69a0e7f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-59" prio=10 tid=0x0000000001f01000 nid=0x9b9 waiting
for monitor entry [0x00007f69a0f80000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-58" prio=10 tid=0x0000000001eff000 nid=0x9b8 waiting
for monitor entry [0x00007f69a1081000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-57" prio=10 tid=0x0000000002355000 nid=0x9b7 waiting
for monitor entry [0x00007f69a1182000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-56" prio=10 tid=0x0000000002353000 nid=0x9b6 waiting
for monitor entry [0x00007f69a1283000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-55" prio=10 tid=0x0000000002350800 nid=0x9b5 waiting
for monitor entry [0x00007f69a1384000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-54" prio=10 tid=0x000000000234f000 nid=0x9b4 waiting
for monitor entry [0x00007f69a1485000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-53" prio=10 tid=0x000000000209b000 nid=0x9b3 waiting
for monitor entry [0x00007f69a1586000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-52" prio=10 tid=0x0000000002098800 nid=0x9b0 waiting
for monitor entry [0x00007f69a1687000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-51" prio=10 tid=0x00000000021a1000 nid=0x9af waiting
for monitor entry [0x00007f69a1788000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-50" prio=10 tid=0x000000000208f800 nid=0x9ae waiting
for monitor entry [0x00007f69a1889000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-49" prio=10 tid=0x00000000014fa000 nid=0x9ad waiting
for monitor entry [0x00007f69a198a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-48" prio=10 tid=0x0000000001af2000 nid=0x9ac waiting
for monitor entry [0x00007f69a1a8b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-47" prio=10 tid=0x000000000246e800 nid=0x9ab waiting
for monitor entry [0x00007f69a1b8c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-46" prio=10 tid=0x000000000246d000 nid=0x9aa waiting
for monitor entry [0x00007f69a1c8d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-45" prio=10 tid=0x000000000246b800 nid=0x9a9 waiting
for monitor entry [0x00007f69a1d8e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-44" prio=10 tid=0x0000000001aa7800 nid=0x9a8 waiting
for monitor entry [0x00007f69a1e8f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-43" prio=10 tid=0x0000000001aa5800 nid=0x9a7 waiting
for monitor entry [0x00007f69a1f90000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-42" prio=10 tid=0x0000000001aa3000 nid=0x9a6 waiting
for monitor entry [0x00007f69a2091000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-41" prio=10 tid=0x0000000001b4a000 nid=0x9a5 waiting
for monitor entry [0x00007f69a2192000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-40" prio=10 tid=0x0000000001b47800 nid=0x9a4 waiting
for monitor entry [0x00007f69a2293000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-39" prio=10 tid=0x0000000001b46000 nid=0x9a3 waiting
for monitor entry [0x00007f69a2394000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-38" prio=10 tid=0x0000000001b44000 nid=0x9a2 waiting
for monitor entry [0x00007f69a2495000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-37" prio=10 tid=0x000000000178e800 nid=0x9a1 waiting
for monitor entry [0x00007f69a2596000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-36" prio=10 tid=0x000000000178d000 nid=0x9a0 waiting
for monitor entry [0x00007f69a2697000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-35" prio=10 tid=0x000000000178b000 nid=0x99f waiting
for monitor entry [0x00007f69a2798000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-34" prio=10 tid=0x0000000001ab1800 nid=0x99e waiting
for monitor entry [0x00007f69a2899000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-33" prio=10 tid=0x0000000001aaf800 nid=0x99d waiting
for monitor entry [0x00007f69a299a000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-32" prio=10 tid=0x0000000001aae000 nid=0x99c waiting
for monitor entry [0x00007f69a2a9b000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-31" prio=10 tid=0x00000000022ad000 nid=0x99b waiting
for monitor entry [0x00007f69a2b9c000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-30" prio=10 tid=0x00000000022aa000 nid=0x99a waiting
for monitor entry [0x00007f69a2c9d000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-29" prio=10 tid=0x00000000022a8000 nid=0x999 waiting
for monitor entry [0x00007f69a2d9e000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-28" prio=10 tid=0x00000000022a6800 nid=0x998 waiting
for monitor entry [0x00007f69a2e9f000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-27" prio=10 tid=0x0000000002745800 nid=0x996 waiting
for monitor entry [0x00007f69a2fa0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-26" prio=10 tid=0x0000000002744800 nid=0x995 waiting
for monitor entry [0x00007f69a30a1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-25" prio=10 tid=0x00000000020a1000 nid=0x994 waiting
for monitor entry [0x00007f69a31a2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-24" prio=10 tid=0x0000000001cb5000 nid=0x993 waiting
for monitor entry [0x00007f69a32a3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-23" prio=10 tid=0x00000000025b8000 nid=0x992 waiting
for monitor entry [0x00007f69a33a4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-22" prio=10 tid=0x00000000025b5800 nid=0x991 waiting
for monitor entry [0x00007f69a34a5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-21" prio=10 tid=0x00000000025b3800 nid=0x990 waiting
for monitor entry [0x00007f69a35a6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-20" prio=10 tid=0x000000000242e800 nid=0x98f waiting
for monitor entry [0x00007f69a36a7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-19" prio=10 tid=0x000000000242c800 nid=0x98e waiting
for monitor entry [0x00007f69a37a8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-18" prio=10 tid=0x0000000001c43000 nid=0x98d waiting
for monitor entry [0x00007f69a38a9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.StatusManager.getStatus(StatusManager.java:
209)
- waiting to lock <0x00000007dfdf5380> (a java.util.HashMap)
at
com.cloudera.flume.master.logical.LogicalNameManager.updateNode(LogicalNameManager.java:
101)
- locked <0x00000007dfdf53e0> (a
com.cloudera.flume.master.logical.LogicalNameManager)
at
com.cloudera.flume.master.logical.LogicalNameManager.update(LogicalNameManager.java:
150)
- locked <0x00000007dfdf53e0> (a
com.cloudera.flume.master.logical.LogicalNameManager)
at
com.cloudera.flume.master.logical.LogicalConfigurationManager.updateAll(LogicalConfigurationManager.java:
236)
at
com.cloudera.flume.master.TranslatingConfigurationManager.addLogicalNode(TranslatingConfigurationManager.java:
450)
- locked <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
111)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-17" prio=10 tid=0x0000000001c42000 nid=0x98c waiting
for monitor entry [0x00007f69a39aa000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-16" prio=10 tid=0x0000000002239000 nid=0x98b waiting
for monitor entry [0x00007f69a3aab000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-15" prio=10 tid=0x0000000001fd4000 nid=0x98a waiting
for monitor entry [0x00007f69a3bac000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-14" prio=10 tid=0x000000000223c800 nid=0x989 waiting
for monitor entry [0x00007f69a3cad000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-13" prio=10 tid=0x0000000002144000 nid=0x988 waiting
for monitor entry [0x00007f69a3dae000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getConfig(TranslatingConfigurationManager.java:
87)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getConfig(MasterClientServer.java:
91)
at
com.cloudera.flume.master.MasterClientServerThrift.getConfig(MasterClientServerThrift.java:
70)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getConfig.process(ThriftFlumeClientServer.java:686)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-12" prio=10 tid=0x0000000002141800 nid=0x987 waiting
for monitor entry [0x00007f69a3eaf000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-11" prio=10 tid=0x0000000002632000 nid=0x986 waiting
for monitor entry [0x00007f69a3fb0000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getChokeMap(TranslatingConfigurationManager.java:
434)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getChokeMap(MasterClientServer.java:
87)
at
com.cloudera.flume.master.MasterClientServerThrift.getChokeMap(MasterClientServerThrift.java:
66)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getChokeMap.process(ThriftFlumeClientServer.java:738)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-10" prio=10 tid=0x0000000001f57800 nid=0x985 waiting
for monitor entry [0x00007f69a40b1000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-9" prio=10 tid=0x0000000001f57000 nid=0x984 waiting for
monitor entry [0x00007f69a41b2000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getPhysicalNode(TranslatingConfigurationManager.java:
474)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.StatusManager.updateHeartbeatStatus(StatusManager.java:
92)
- locked <0x00000007dfdf5380> (a java.util.HashMap)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
117)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-8" prio=10 tid=0x0000000001eb6800 nid=0x983 waiting for
monitor entry [0x00007f69a42b3000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-7" prio=10 tid=0x00000000021a2800 nid=0x982 waiting for
monitor entry [0x00007f69a43b4000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-6" prio=10 tid=0x0000000001a14800 nid=0x981 waiting for
monitor entry [0x00007f69a44b5000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
106)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-5" prio=10 tid=0x0000000002111000 nid=0x980 waiting for
monitor entry [0x00007f69a45b6000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"DestroyJavaVM" prio=10 tid=0x0000000001313800 nid=0x949 waiting on
condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Lost node reaper" prio=10 tid=0x0000000001c07800 nid=0x97f waiting
for monitor entry [0x00007f69a46b7000]
java.lang.Thread.State: BLOCKED (on object monitor)
at com.cloudera.flume.master.StatusManager.checkup(StatusManager.java:
123)
- waiting to lock <0x00000007dfdf5380> (a java.util.HashMap)
at com.cloudera.flume.master.FlumeMaster$1.run(FlumeMaster.java:307)

"pool-1-thread-4" prio=10 tid=0x00000000021ef800 nid=0x97e waiting for
monitor entry [0x00007f69a47b8000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-3" prio=10 tid=0x0000000001c1e000 nid=0x97d waiting for
monitor entry [0x00007f69a48b9000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-2" prio=10 tid=0x000000000229b800 nid=0x97c waiting for
monitor entry [0x00007f69a49ba000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"pool-1-thread-1" prio=10 tid=0x0000000001b8d000 nid=0x97b waiting for
monitor entry [0x00007f69a4abb000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

"main-EventThread" daemon prio=10 tid=0x0000000002320000 nid=0x97a
waiting on condition [0x00007f69a4bbc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007dfdfd5f0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer
$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:
386)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:
502)

"main-SendThread(int-ion-platform64.logs.unit-test.muleion.com:3181)"
daemon prio=10 tid=0x0000000001b54800 nid=0x979 runnable
[0x00007f69a4cbd000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007dfdfe578> (a sun.nio.ch.Util$1)
- locked <0x00000007dfdfe568> (a java.util.Collections
$UnmodifiableSet)
- locked <0x00000007dfdfe0d0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:
1107)

"main-EventThread" daemon prio=10 tid=0x0000000001d07000 nid=0x978
waiting on condition [0x00007f69a4dbe000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007dfddab88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer
$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:
386)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:
502)

"main-SendThread(int-ion-platform64.logs.unit-test.muleion.com:3181)"
daemon prio=10 tid=0x0000000001f82000 nid=0x977 runnable
[0x00007f69a4ebf000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007dfdd8d48> (a sun.nio.ch.Util$1)
- locked <0x00000007dfdd8d38> (a java.util.Collections
$UnmodifiableSet)
- locked <0x00000007dfdd88a0> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:
1107)

"exec-thread" prio=10 tid=0x0000000001966800 nid=0x976 waiting on
condition [0x00007f69a4fc0000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007dfdd7130> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:
226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer
$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2081)
at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:
423)
at com.cloudera.flume.master.CommandManager
$ExecThread.run(CommandManager.java:235)

"Thrift server:class org.apache.thrift.TProcessorFactory on class
org.apache.thrift.transport.TSaneServerSocket" prio=10
tid=0x0000000001f15800 nid=0x975 runnable [0x00007f69a50c1000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:
375)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at
org.apache.thrift.transport.TSaneServerSocket.acceptImpl(TSaneServerSocket.java:
132)
at
org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:
31)
at org.apache.thrift.server.TSaneThreadPoolServer
$1.run(TSaneThreadPoolServer.java:175)

"Thrift server:class org.apache.thrift.TProcessorFactory on class
org.apache.thrift.transport.TSaneServerSocket" prio=10
tid=0x0000000001aa1800 nid=0x974 runnable [0x00007f69a51c2000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:
375)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at
org.apache.thrift.transport.TSaneServerSocket.acceptImpl(TSaneServerSocket.java:
132)
at
org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:
31)
at org.apache.thrift.server.TSaneThreadPoolServer
$1.run(TSaneThreadPoolServer.java:175)

"Thrift server:class org.apache.thrift.TProcessorFactory on class
org.apache.thrift.transport.TSaneServerSocket" prio=10
tid=0x0000000001c5b800 nid=0x973 runnable [0x00007f69a52c3000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:
375)
at java.net.ServerSocket.implAccept(ServerSocket.java:470)
at java.net.ServerSocket.accept(ServerSocket.java:438)
at
org.apache.thrift.transport.TSaneServerSocket.acceptImpl(TSaneServerSocket.java:
132)
at
org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:
31)
at org.apache.thrift.server.TSaneThreadPoolServer
$1.run(TSaneThreadPoolServer.java:175)

"Timer-0" daemon prio=10 tid=0x0000000001af6000 nid=0x972 in
Object.wait() [0x00007f69a53ca000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfda5868> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:531)
- locked <0x00000007dfda5868> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:484)

"535364565@qtp-2058859513-1 - Acceptor0
SelectChann...@0.0.0.0:35871" prio=10 tid=0x0000000001822000
nid=0x971 runnable [0x00007f69a54cb000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007dfdd6540> (a sun.nio.ch.Util$1)
- locked <0x00000007dfdd6530> (a java.util.Collections
$UnmodifiableSet)
- locked <0x00000007dfdd6058> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.mortbay.io.nio.SelectorManager
$SelectSet.doSelect(SelectorManager.java:484)
at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:
191)
at
org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:
124)
at org.mortbay.jetty.AbstractConnector
$Acceptor.run(AbstractConnector.java:707)
at org.mortbay.thread.QueuedThreadPool
$PoolThread.run(QueuedThreadPool.java:582)

"939602315@qtp-2058859513-0" prio=10 tid=0x0000000001807800 nid=0x970
in Object.wait() [0x00007f69a55cc000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfdd5b98> (a
org.mortbay.thread.QueuedThreadPool$PoolThread)
at org.mortbay.thread.QueuedThreadPool
$PoolThread.run(QueuedThreadPool.java:625)
- locked <0x00000007dfdd5b98> (a org.mortbay.thread.QueuedThreadPool
$PoolThread)

"ProcessThread:-1" prio=10 tid=0x00000000018c1800 nid=0x961 waiting on
condition [0x00007f69a58d5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007dfdff3b0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer
$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:
386)
at
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:
103)

"SyncThread:0" prio=10 tid=0x00000000018c1000 nid=0x960 waiting on
condition [0x00007f69a59d6000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007dfdffc10> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer
$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:
386)
at
org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:
94)

"SessionTracker" prio=10 tid=0x00000000015e2000 nid=0x95f in
Object.wait() [0x00007f69a5ad7000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfe6d0f8> (a
org.apache.zookeeper.server.SessionTrackerImpl)
at
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:
142)
- locked <0x00000007dfe6d0f8> (a
org.apache.zookeeper.server.SessionTrackerImpl)

"NIOServerCxn.Factory:0.0.0.0/0.0.0.0:3181" daemon prio=10
tid=0x00000000018e8800 nid=0x95e runnable [0x00007f69a5bd8000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:83)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x00000007dfe6ba88> (a sun.nio.ch.Util$1)
- locked <0x00000007dfe6ba78> (a java.util.Collections
$UnmodifiableSet)
- locked <0x00000007dfe6ad10> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.server.NIOServerCnxn
$Factory.run(NIOServerCnxn.java:232)

"ZooKeeper standalone thread" prio=10 tid=0x0000000001685000 nid=0x95d
in Object.wait() [0x00007f69a5ee2000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfe6a8a0> (a
org.apache.zookeeper.server.NIOServerCnxn$Factory)
at java.lang.Thread.join(Thread.java:1160)
- locked <0x00000007dfe6a8a0> (a
org.apache.zookeeper.server.NIOServerCnxn$Factory)
at java.lang.Thread.join(Thread.java:1213)
at
org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:
111)
at com.cloudera.flume.master.ZKInProcessServer
$1.run(ZKInProcessServer.java:96)

"Low Memory Detector" daemon prio=10 tid=0x00000000013af000 nid=0x954
runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=10 tid=0x00000000013aa000 nid=0x953
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x00000000013a7000 nid=0x952
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x00000000013a5800 nid=0x951
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x0000000001381000 nid=0x94f in
Object.wait() [0x00007f69a7236000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfea4af0> (a java.lang.ref.ReferenceQueue
$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:133)
- locked <0x00000007dfea4af0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:149)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:177)

"Reference Handler" daemon prio=10 tid=0x000000000137f000 nid=0x94e in
Object.wait() [0x00007f69a7337000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007dfddf2f0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x00000007dfddf2f0> (a java.lang.ref.Reference$Lock)

"VM Thread" prio=10 tid=0x0000000001378000 nid=0x94c runnable

"GC task thread#0 (ParallelGC)" prio=10 tid=0x000000000131e000
nid=0x94a runnable

"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000001320000
nid=0x94b runnable

"VM Periodic Task Thread" prio=10 tid=0x00000000013b1800 nid=0x955
waiting on condition

JNI global references: 1402


Found one Java-level deadlock:
=============================
"pool-1-thread-205":
waiting to lock monitor 0x0000000001a19438 (object
0x00000007dfdd77b0, a
com.cloudera.flume.master.logical.LogicalConfigurationManager),
which is held by "pool-1-thread-18"
"pool-1-thread-18":
waiting to lock monitor 0x00000000021eb3e8 (object
0x00000007dfdf5380, a java.util.HashMap),
which is held by "pool-1-thread-9"
"pool-1-thread-9":
waiting to lock monitor 0x0000000001a19438 (object
0x00000007dfdd77b0, a
com.cloudera.flume.master.logical.LogicalConfigurationManager),
which is held by "pool-1-thread-18"

Java stack information for the threads listed above:
===================================================
"pool-1-thread-205":
at
com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(TranslatingConfigurationManager.java:
427)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientServer.java:
83)
at
com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterClientServerThrift.java:
62)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$getLogicalNodes.process(ThriftFlumeClientServer.java:712)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
"pool-1-thread-18":
at
com.cloudera.flume.master.StatusManager.getStatus(StatusManager.java:
209)
- waiting to lock <0x00000007dfdf5380> (a java.util.HashMap)
at
com.cloudera.flume.master.logical.LogicalNameManager.updateNode(LogicalNameManager.java:
101)
- locked <0x00000007dfdf53e0> (a
com.cloudera.flume.master.logical.LogicalNameManager)
at
com.cloudera.flume.master.logical.LogicalNameManager.update(LogicalNameManager.java:
150)
- locked <0x00000007dfdf53e0> (a
com.cloudera.flume.master.logical.LogicalNameManager)
at
com.cloudera.flume.master.logical.LogicalConfigurationManager.updateAll(LogicalConfigurationManager.java:
236)
at
com.cloudera.flume.master.TranslatingConfigurationManager.addLogicalNode(TranslatingConfigurationManager.java:
450)
- locked <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
111)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
"pool-1-thread-9":
at
com.cloudera.flume.master.TranslatingConfigurationManager.getPhysicalNode(TranslatingConfigurationManager.java:
474)
- waiting to lock <0x00000007dfdd77b0> (a
com.cloudera.flume.master.logical.LogicalConfigurationManager)
at
com.cloudera.flume.master.StatusManager.updateHeartbeatStatus(StatusManager.java:
92)
- locked <0x00000007dfdf5380> (a java.util.HashMap)
at
com.cloudera.flume.master.MasterClientServer.heartbeat(MasterClientServer.java:
117)
at
com.cloudera.flume.master.MasterClientServerThrift.heartbeat(MasterClientServerThrift.java:
75)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
$heartbeat.process(ThriftFlumeClientServer.java:659)
at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
$Processor.process(ThriftFlumeClientServer.java:638)
at org.apache.thrift.server.TSaneThreadPoolServer
$WorkerProcess.run(TSaneThreadPoolServer.java:280)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
1110)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)

Found 1 deadlock.

Heap
PSYoungGen total 128000K, used 28572K [0x00000007d7f60000,
0x00000007e0160000, 0x0000000800000000)
eden space 122880K, 19% used
[0x00000007d7f60000,0x00000007d96a5b60,0x00000007df760000)
from space 5120K, 92% used
[0x00000007dfc60000,0x00000007e0101828,0x00000007e0160000)
to space 5120K, 0% used
[0x00000007df760000,0x00000007df760000,0x00000007dfc60000)
PSOldGen total 81984K, used 0K [0x0000000787e00000,
0x000000078ce10000, 0x00000007d7f60000)
object space 81984K, 0% used
[0x0000000787e00000,0x0000000787e00000,0x000000078ce10000)
PSPermGen total 24896K, used 24863K [0x000000077d800000,
0x000000077f050000, 0x0000000787e00000)
object space 24896K, 99% used
[0x000000077d800000,0x000000077f047d60,0x000000077f050000)

[Trevor Wright]

I have seen the same issue using the multiple master configuration
with ~200 physical nodes spawning 200 logical agents, 6 collectors,
and 3 - 5 masters. I tried using internal and external ZooKeeper
clusters as well. My solution was to move away from the multiple
master deployment and use the memory based master configuration.

>         at...
>
> read more »

[Eriks]

I'm using a single master at the moment. 1 collector and 26
agents....

also running flume-0.9.3-cdh3u0.

I will try using the memory based master configuration, but if the
master restarts all agent configs are lost, right?

> > 59)
> >         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> >         at
> > org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:
> > 378)
> >         at
> > org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:
> > 297)
> >         at
> > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol .java:

> > 427)
> >         - waiting to lock <0x00000007dfdd77b0> (a
> > com.cloudera.flume.master.logical.LogicalConfigurationManager)
> >         at
> > com.cloudera.flume.master.MasterClientServer.getLogicalNodes(MasterClientSe rver.java:
> > 83)
> >         at
> > com.cloudera.flume.master.MasterClientServerThrift.getLogicalNodes(MasterCl ientServerThrift.java:

> > 62)
> >         at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer$Processor
> > $getLogicalNodes.process(ThriftFlumeClientServer.java:712)
> >         at com.cloudera.flume.conf.thrift.ThriftFlumeClientServer
> > $Processor.process(ThriftFlumeClientServer.java:638)
> >         at org.apache.thrift.server.TSaneThreadPoolServer
> > $WorkerProcess.run(TSaneThreadPoolServer.java:280)
> >         at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
> > 1110)
> >         at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:603)
> >         at java.lang.Thread.run(Thread.java:636)
>
> > "pool-1-thread-201" prio=10 tid=0x00000000018b8000 nid=0xa57 waiting
> > for monitor entry [0x00007f699407f000]
> >    java.lang.Thread.State: BLOCKED (on object monitor)
> >         at
> > com.cloudera.flume.master.TranslatingConfigurationManager.getLogicalNode(Tr anslatingConfigurationManager.java:

> > 427)
> >         - waiting to lock <0x00000007dfdd77b0> (a...
>
> read more »

[Jonathan Hsieh]

My guess is that it is related to this: https://issues.cloudera.org/browse/FLUME-171

Unfortunately, the image which shows the root cause of the deadlock was lost.  Can you add the stack traces to that jira?  I'll bump up the priority to critical.

Jon.

--
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera

// j...@cloudera.com

 

[Erik Seilnacht]

Hi Jon.

I've added the stack trace to FLUME-171

thanks,

-Erik

---

From: Jonathan Hsieh <j...@cloudera.com>
To: Eriks <erik_se...@yahoo.com>
Cc: Flume Users <flume...@cloudera.org>
Sent: Fri, June 10, 2011 11:37:56 AM
Subject: Re: jstack trace of unresponsive master