How to Run Glowroot (APM) in HP Unix

[srikris...@gmail.com]

Hi,

I need to run Glowroot APM in HP Unix Environment (HP-UX PCTUTDBS B.11.31 U ia64),

With the Application Server as Jboss 7.2.0 Final. I'm relatively new to Unix OS. Kindly help me in this.

Thanks

Srikrishna

[Trask Stalnaker]

Hi, are you following steps on the wiki?

https://github.com/glowroot/glowroot/wiki/Agent-Installation

What have you tried, and where are you stuck?

Thanks,

Trask

[srikrishna a]

Thanks for the reply Trask,

I need to run Glowroot(APM) in my localhost with the POrt number 4000. 

I'm getting issue when installing Apache Cassandra. 

Detailed step by step by would be very helpful.

Thanks

Srikrishna

[Trask Stalnaker]

Hi Srikrishna,

From what I can tell, HP-UX has its own JVM implementation:

https://en.wikipedia.org/wiki/List_of_Java_virtual_machines#Proprietary_implementations

https://h20392.www2.hpe.com/portal/swdepot/displayProductInfo.do?productNumber=HPUXJDKJRE80

and Apache Cassandra only supports the Oracle JVM and the OpenJDK JVM:

http://cassandra.apache.org/doc/latest/getting_started/installing.html#prerequisites

Trask

[srikrishna a]

Hi Trask,

Thanks a lot for reply. 

I've deployed Application in Jboss App Server( Env: HP Ux) Can I monitor the application from Windows. Can I do that.

Thanks

Srikrisna

[Trask Stalnaker]

Give it a try.  I haven't tested Glowroot agent in HP-UX JVM.  I looked around, but it doesn't seem easy to find an HP-UX environment to test in (cannot run HP-UX inside VirtualBox or AWS which are normally what I use to test other environments).  If you get errors, post the glowroot agent log file and I'll have a look.

Thanks,

Trask

[srikrishna a]

Hi Trask,

I've installed Glowroot in Windows, My Application (Jboss App Server) is running on <10.236.xx.xxx:portno> , my glowroot(UI) is running on localhost:4000. How do I bind my application with Glowroot, So that I can monitor my application. Any changes in Config files...

Thanks

Srikrishna

[Trask Stalnaker]

Did you add -javaagent:path/to/glowroot.jar in the JBoss JVM args?  What does the glowroot log show?

[srikrishna a]

Yes,

Below is the log file of Glowroot jar file :

2017-02-07 07:56:46.786 INFO  org.glowroot - Glowroot version: 0.9.10, built 2017-01-30 05:38:02 +0000

2017-02-07 07:56:50.379 INFO  org.glowroot - UI listening on 127.0.0.1:4000 (to access the UI from remote machines, change the bind address to 0.0.0.0, either in the Glowroot UI under Configuration > Web, or directly in the admin.json file which then requires restart to take effect)

[srikrishna a]

Log file for glowroot-central

2017-02-07 08:01:57.367 INFO  org.glowroot - gRPC listening on 0.0.0.0:8181

2017-02-07 08:01:57.848 ERROR org.glowroot - Error binding socket to 0.0.0.0:400

0, the user interface will not be available

org.glowroot.ui.HttpServer$SocketBindException: java.net.BindException: Address

already in use: bind

        at org.glowroot.ui.HttpServer.<init>(HttpServer.java:132)

        at org.glowroot.ui.LazyHttpServer.build(LazyHttpServer.java:129)

        at org.glowroot.ui.LazyHttpServer.init(LazyHttpServer.java:78)

        at org.glowroot.ui.UiModule.createUiModule(UiModule.java:134)

        at org.glowroot.ui.CreateUiModuleBuilder.build(CreateUiModuleBuilder.jav

a:336)

        at org.glowroot.central.CentralModule.<init>(CentralModule.java:239)

        at org.glowroot.central.Bootstrap.main(Bootstrap.java:30)

Caused by: java.net.BindException: Address already in use: bind

        at sun.nio.ch.Net.bind0(Native Method)

        at sun.nio.ch.Net.bind(Unknown Source)

        at sun.nio.ch.Net.bind(Unknown Source)

        at sun.nio.ch.ServerSocketChannelImpl.bind(Unknown Source)

        at io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSo

cketChannel.java:127)

        at io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.

java:554)

        at io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChann

elPipeline.java:1258)

        at io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractCha

nnelHandlerContext.java:512)

        at io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHa

ndlerContext.java:497)

        at io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.j

ava:980)

        at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:250)

        at io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:363

)

        at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEv

entExecutor.java:163)

        at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(Single

ThreadEventExecutor.java:418)

        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:454)

        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThread

EventExecutor.java:873)

        at java.lang.Thread.run(Unknown Source)

[Trask Stalnaker]

This looks like you run using "java -jar glowroot.jar", which is incorrect.  You need to add -javaagent:path/to/glowroot.jar to your JBoss JVM args.

[Trask Stalnaker]

Looks like you have something else running on port 4000

[srikrishna a]

This is the logs after added glowroot.jar to my JBoss JVM args

===============================================================================

  JBoss Bootstrap Environment

  JBOSS_HOME: D:\Glowroot\jboss-as-web-7.0.2.Final\jboss-as-web-7.0.2.Final

  JAVA: C:\Program Files\Java\jdk1.8.0_121\bin\java

  JAVA_OPTS: -Dprogram.name=standalone.bat -Xms64M -Xmx512M -XX:MaxPermSize=256M

 -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman

 -server

===============================================================================

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256M; sup

port was removed in 8.0

2017-02-07 12:51:13.864 INFO  org.glowroot - Glowroot version: 0.9.10, built 201

7-01-30 05:38:02 +0000

2017-02-07 12:51:14.878 INFO  org.glowroot - UI listening on 127.0.0.1:4000 (to

access the UI from remote machines, change the bind address to 0.0.0.0, either i

n the Glowroot UI under Configuration > Web, or directly in the admin.json file

which then requires restart to take effect)

[Trask Stalnaker]

I don't see "-javaagent:..." in the JAVA_OPTS.

Also, glowroot log still looks like you are not running it as an agent.

[srikrishna a]

Hi Trask,

Below is the log after adding -javaagent in the JAVA_OPTS

===============================================================================

  JBoss Bootstrap Environment

  JBOSS_HOME: D:\Glowroot\jboss-as-web-7.0.2.Final

  JAVA: C:\Program Files\Java\jdk1.8.0_121\bin\java

  JAVA_OPTS: -Dprogram.name=standalone.bat -Xms64M -Xmx512M -XX:MaxPermSize=256M

 -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman

 -javaagent:D:\Glowroot\jboss-as-web-7.0.2.Final\glowroot.jar -server

===============================================================================

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256M; sup

port was removed in 8.0

2017-02-08 14:44:40.366 INFO  org.glowroot - Glowroot version: 0.9.10, built 201

7-01-30 05:38:02 +0000

2017-02-08 14:44:41.498 INFO  org.glowroot - plugins loaded: Cassandra Plugin, E

xecutor Plugin, Grails Plugin, Hibernate Plugin, HTTP Client Plugin, JAX-RS Plug

in, Jdbc Plugin, JMS Plugin, JSF Plugin, JSP Plugin, Logger Plugin, Play Plugin,

 Netty Plugin, Quartz Plugin, Redis Plugin, Servlet Plugin, Spray Plugin, Spring

 Plugin, Struts Plugin

Exception in thread "main" java.lang.NullPointerException: Property base.dir is

required when no glowroot jar file

        at org.glowroot.agent.shaded.google.common.base.Preconditions.checkNotNu

ll(Preconditions.java:228)

        at org.glowroot.agent.BaseDir.getBaseDir(BaseDir.java:33)

        at org.glowroot.agent.OfflineViewer.main(OfflineViewer.java:46)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.

java:62)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces

sorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:498)

        at org.jboss.modules.Module.run(Module.java:272)

        at org.jboss.modules.Main.main(Main.java:313)

2017-02-08 14:44:43.116 INFO  org.glowroot - UI listening on 127.0.0.1:4000 (to

access the UI from remote machines, change the bind address to 0.0.0.0, either i

n the Glowroot UI under Configuration > Web, or directly in the admin.json file

which then requires restart to take effect)

Press any key to continue . . .

[srikrishna a]

logs:

===============================================================================

  JBoss Bootstrap Environment

  JBOSS_HOME: D:\Glowroot\jboss-as-web-7.0.2.Final

  JAVA: C:\Program Files\Java\jdk1.8.0_121\bin\java

  JAVA_OPTS: -Dprogram.name=standalone.bat -Xms64M -Xmx512M -XX:MaxPermSize=256M

 -Dsun.rmi.dgc.client.gcInterval=3600000 -Dsun.rmi.dgc.server.gcInterval=3600000

 -Dorg.jboss.resolver.warning=true -Djboss.modules.system.pkgs=org.jboss.byteman

 -javaagent:D:\Glowroot\jboss-as-web-7.0.2.Final\glowroot.jar -server

===============================================================================

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256M; sup

port was removed in 8.0

2017-02-08 15:03:32.426 INFO  org.glowroot - Glowroot version: 0.9.10, built 201

7-01-30 05:38:02 +0000

2017-02-08 15:03:33.379 INFO  org.glowroot - plugins loaded: Cassandra Plugin, E

xecutor Plugin, Grails Plugin, Hibernate Plugin, HTTP Client Plugin, JAX-RS Plug

in, Jdbc Plugin, JMS Plugin, JSF Plugin, JSP Plugin, Logger Plugin, Play Plugin,

 Netty Plugin, Quartz Plugin, Redis Plugin, Servlet Plugin, Spray Plugin, Spring

 Plugin, Struts Plugin

Exception in thread "main" java.lang.NullPointerException: Property base.dir is

required when no glowroot jar file

        at org.glowroot.agent.shaded.google.common.base.Preconditions.checkNotNu

ll(Preconditions.java:228)

        at org.glowroot.agent.BaseDir.getBaseDir(BaseDir.java:33)

        at org.glowroot.agent.OfflineViewer.main(OfflineViewer.java:46)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.

java:62)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces

sorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:498)

        at org.jboss.modules.Module.run(Module.java:272)

        at org.jboss.modules.Main.main(Main.java:313)

2017-02-08 15:03:34.990 ERROR org.glowroot - Error binding socket to 127.0.0.1:4

000, the user interface will not be available

org.glowroot.agent.shaded.glowroot.ui.HttpServer$SocketBindException: java.net.B

indException: Address already in use: bind

        at org.glowroot.agent.shaded.glowroot.ui.HttpServer.<init>(HttpServer.ja

va:132)

        at org.glowroot.agent.shaded.glowroot.ui.LazyHttpServer.build(LazyHttpSe

rver.java:129)

        at org.glowroot.agent.shaded.glowroot.ui.LazyHttpServer.init(LazyHttpSer

ver.java:78)

        at org.glowroot.agent.shaded.glowroot.ui.UiModule.createUiModule(UiModul

e.java:134)

        at org.glowroot.agent.shaded.glowroot.ui.CreateUiModuleBuilder.build(Cre

ateUiModuleBuilder.java:336)

        at org.glowroot.agent.embedded.init.EmbeddedAgentModule.initEmbeddedServ

er(EmbeddedAgentModule.java:228)

        at org.glowroot.agent.embedded.init.GlowrootFatAgentInit$1.execute(Glowr

ootFatAgentInit.java:59)

        at org.glowroot.agent.init.NettyWorkaround$1.run(NettyWorkaround.java:50

)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.

java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor

.java:617)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.net.BindException: Address already in use: bind

        at sun.nio.ch.Net.bind0(Native Method)

        at sun.nio.ch.Net.bind(Net.java:433)

        at sun.nio.ch.Net.bind(Net.java:425)

        at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:

223)

        at org.glowroot.agent.shaded.netty.channel.socket.nio.NioServerSocketCha

nnel.doBind(NioServerSocketChannel.java:127)

        at org.glowroot.agent.shaded.netty.channel.AbstractChannel$AbstractUnsaf

e.bind(AbstractChannel.java:554)

        at org.glowroot.agent.shaded.netty.channel.DefaultChannelPipeline$HeadCo

ntext.bind(DefaultChannelPipeline.java:1258)

        at org.glowroot.agent.shaded.netty.channel.AbstractChannelHandlerContext

.invokeBind(AbstractChannelHandlerContext.java:512)

        at org.glowroot.agent.shaded.netty.channel.AbstractChannelHandlerContext

.bind(AbstractChannelHandlerContext.java:497)

        at org.glowroot.agent.shaded.netty.channel.DefaultChannelPipeline.bind(D

efaultChannelPipeline.java:980)

        at org.glowroot.agent.shaded.netty.channel.AbstractChannel.bind(Abstract

Channel.java:250)

        at org.glowroot.agent.shaded.netty.bootstrap.AbstractBootstrap$2.run(Abs

tractBootstrap.java:363)

        at org.glowroot.agent.shaded.netty.util.concurrent.AbstractEventExecutor

.safeExecute(AbstractEventExecutor.java:163)

        at org.glowroot.agent.shaded.netty.util.concurrent.SingleThreadEventExec

utor.runAllTasks(SingleThreadEventExecutor.java:418)

        at org.glowroot.agent.shaded.netty.channel.nio.NioEventLoop.run(NioEvent

Loop.java:454)

        at org.glowroot.agent.shaded.netty.util.concurrent.SingleThreadEventExec

utor$5.run(SingleThreadEventExecutor.java:873)

        ... 1 common frames omitted

[Trask Stalnaker]

You have the -javaagent:... JVM arg now which is good.  But it looks like you also still have "-jar .../glowroot.jar" in there though as it is trying to run org.glowroot.agent.OfflineViewer.  You need to remove that.

[srikrishna a]

Thanks Trask,

As you said , I've removed the .../glowroot.jar" from the location

I'm getting the below error once I run the run java -jar glowroot-central.jar from  inside the glowroot-central directory

I've installed Cassandra in windows & glowroot in HpUnix.

$ java -jar glowroot-central.jar

2017-02-12 11:01:16.965 INFO  org.glowroot - Glowroot version: 0.9.9, built 2017-01-11 07:11:11 +0000

2017-02-12 11:01:17.657 INFO  com.datastax.driver.core.Native - Could not load JNR C Library, native system calls through this library will not be available (set this logger level to DEBUG to see the full stack trace).

2017-02-12 11:01:17.657 INFO  c.datastax.driver.core.ClockFactory - Using java.lang.System clock to generate timestamps.

2017-02-12 11:01:17.958 INFO  com.datastax.driver.core.NettyUtil - Did not find Netty's native epoll transport in the classpath, defaulting to NIO.

2017-02-12 11:01:20.489 INFO  c.d.d.c.p.DCAwareRoundRobinPolicy - Using data-center name 'datacenter1' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)

2017-02-12 11:01:20.493 INFO  com.datastax.driver.core.Cluster - New Cassandra host /10.236.70.232:9042 added

2017-02-12 11:01:20.845 INFO  org.glowroot - upgrading cassandra schema from version 17...

2017-02-12 11:01:20.846 INFO  org.glowroot - upgraded cassandra schema to version 14

2017-02-12 11:01:30.868 ERROR org.glowroot - Undefined column name agent_rollup

com.datastax.driver.core.exceptions.InvalidQueryException: Undefined column name agent_rollup

        at com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:50)

        at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)

        at com.datastax.driver.core.AbstractSession.prepare(AbstractSession.java:104)

        at org.glowroot.central.repo.TriggeredAlertDao.<init>(TriggeredAlertDao.java:49)

        at org.glowroot.central.CentralModule.<init>(CentralModule.java:182)

        at org.glowroot.central.Bootstrap.main(Bootstrap.java:30)

Caused by: com.datastax.driver.core.exceptions.InvalidQueryException: Undefined column name agent_rollup

        at com.datastax.driver.core.Responses$Error.asException(Responses.java:136)

        at com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:220)

        at com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:196)

        at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)

        at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)

        at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)

        at com.google.common.util.concurrent.Futures$2$1.run(Futures.java:1177)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)

        at java.lang.Thread.run(Thread.java:745)

Exception in thread "main" com.datastax.driver.core.exceptions.InvalidQueryException: Undefined column name agent_rollup

        at com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:50)

        at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)

        at com.datastax.driver.core.AbstractSession.prepare(AbstractSession.java:104)

        at org.glowroot.central.repo.TriggeredAlertDao.<init>(TriggeredAlertDao.java:49)

        at org.glowroot.central.CentralModule.<init>(CentralModule.java:182)

        at org.glowroot.central.Bootstrap.main(Bootstrap.java:30)

Caused by: com.datastax.driver.core.exceptions.InvalidQueryException: Undefined column name agent_rollup

        at com.datastax.driver.core.Responses$Error.asException(Responses.java:136)

        at com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:220)

        at com.datastax.driver.core.SessionManager$4.apply(SessionManager.java:196)

        at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)

        at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)

        at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)

        at com.google.common.util.concurrent.Futures$2$1.run(Futures.java:1177)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:144)

        at java.lang.Thread.run(Thread.java:745)

Thanks

Srikrishna

[Trask Stalnaker]

Hi Srikrishna,

From glowroot central log it looks like you were running glowroot central 0.9.10 at one point, but are now running an older version (0.9.9).

Your glowroot central cassandra schema corresponds to 0.9.10, which is why the older version (0.9.9) is failing.

Is there a reason you are not still running 0.9.10?

Thanks,

Trask

[srikrishna a]

Hi Trask,

Thanks again for helping. 

Find the attached log files of the following :

glowroot-0.9.10-dist

glowroot-central

Apache cassandra.

My Appplication is not starting which being deployed in Jboss (HP-UX). Kindly help on this regard. If I remove the JVM args from conf file Application is up & running 

Thanks

Srikrishna

[Trask Stalnaker]

Can you post the glowroot log file that is inside the glowroot agent directory?

Thanks,

Trask

[srikrishna a]

2017-02-13 18:09:05.417 INFO  org.glowroot - Glowroot version: 0.9.10, built 2017-01-30 05:38:02 +0000

2017-02-13 18:09:10.541 INFO  org.glowroot - plugins loaded: Cassandra Plugin, Executor Plugin, Grails Plugin, Hibernate Plugin, HTTP Client Plugin, JAX-RS Plugin, Jdbc Plugin, JMS Plugin, JSF Plugin, JSP Plugin, Logger Plugin, Play Plugin, Netty Plugin, Quartz Plugin, Redis Plugin, Servlet Plugin, Spray Plugin, Spring Plugin, Struts Plugin

2017-02-13 18:09:22.868 INFO  org.glowroot - UI listening on 127.0.0.1:44000 (to access the UI from remote machines, change the bind address to 0.0.0.0, either in the Glowroot UI under Configuration > Web, or directly in the admin.json file which then requires restart to take effect)

2017-02-13 18:14:56.603 INFO  org.glowroot - Glowroot version: 0.9.10, built 2017-01-30 05:38:02 +0000

2017-02-13 18:15:03.615 INFO  org.glowroot - plugins loaded: Cassandra Plugin, Executor Plugin, Grails Plugin, Hibernate Plugin, HTTP Client Plugin, JAX-RS Plugin, Jdbc Plugin, JMS Plugin, JSF Plugin, JSP Plugin, Logger Plugin, Play Plugin, Netty Plugin, Quartz Plugin, Redis Plugin, Servlet Plugin, Spray Plugin, Spring Plugin, Struts Plugin

2017-02-13 18:15:14.526 INFO  org.glowroot - UI listening on 127.0.0.1:44000 (to access the UI from remote machines, change the bind address to 0.0.0.0, either in the Glowroot UI under Configuration > Web, or directly in the admin.json file which then requires restart to take effect)

Thanks

Srikrishna

[srikrishna a]

Hi Trask,

glowroot log

2017-02-14 01:14:41.548 WARN  o.g.agent.central.CentralConnection - error sending data to the central collector: UNAVAILABLE: Channel in TRANSIENT_FAILURE state (this warning will be logged at most once a minute, 19 warnings were suppressed since it was last logged)

org.glowroot.agent.shaded.grpc.StatusRuntimeException: UNAVAILABLE: Channel in TRANSIENT_FAILURE state

at org.glowroot.agent.shaded.grpc.Status.asRuntimeException(Status.java:545)

at org.glowroot.agent.shaded.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)

at org.glowroot.agent.shaded.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:481)

at org.glowroot.agent.shaded.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:398)

at org.glowroot.agent.shaded.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:513)

at org.glowroot.agent.shaded.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)

at org.glowroot.agent.shaded.grpc.internal.SerializingExecutor$TaskRunner.run(SerializingExecutor.java:154)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.glowroot.agent.shaded.grpc.StatusRuntimeException: UNAVAILABLE

at org.glowroot.agent.shaded.grpc.Status.asRuntimeException(Status.java:536)

at org.glowroot.agent.shaded.grpc.internal.DelayedClientTransport.startBackoff(DelayedClientTransport.java:330)

at org.glowroot.agent.shaded.grpc.internal.TransportSet.scheduleBackoff(TransportSet.java:236)

at org.glowroot.agent.shaded.grpc.internal.TransportSet.access$1500(TransportSet.java:62)

at org.glowroot.agent.shaded.grpc.internal.TransportSet$TransportListener.transportShutdown(TransportSet.java:480)

at org.glowroot.agent.shaded.grpc.netty.ClientTransportLifecycleManager.notifyShutdown(ClientTransportLifecycleManager.java:68)

at org.glowroot.agent.shaded.grpc.netty.ClientTransportLifecycleManager.notifyTerminated(ClientTransportLifecycleManager.java:84)

at org.glowroot.agent.shaded.grpc.netty.NettyClientTransport$4.operationComplete(NettyClientTransport.java:181)

at org.glowroot.agent.shaded.grpc.netty.NettyClientTransport$4.operationComplete(NettyClientTransport.java:175)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:514)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:488)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:427)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.setFailure(DefaultPromise.java:120)

at org.glowroot.agent.shaded.netty.channel.DefaultChannelPromise.setFailure(DefaultChannelPromise.java:87)

at org.glowroot.agent.shaded.grpc.netty.ProtocolNegotiators$AbstractBufferingHandler.fail(ProtocolNegotiators.java:523)

at org.glowroot.agent.shaded.grpc.netty.ProtocolNegotiators$AbstractBufferingHandler.exceptionCaught(ProtocolNegotiators.java:460)

at org.glowroot.agent.shaded.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:296)

at org.glowroot.agent.shaded.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:275)

at org.glowroot.agent.shaded.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:267)

at org.glowroot.agent.shaded.grpc.netty.NettyClientTransport$3.operationComplete(NettyClientTransport.java:165)

at org.glowroot.agent.shaded.grpc.netty.NettyClientTransport$3.operationComplete(NettyClientTransport.java:156)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:514)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:507)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:486)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:427)

at org.glowroot.agent.shaded.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:129)

at org.glowroot.agent.shaded.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:269)

at org.glowroot.agent.shaded.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)

at org.glowroot.agent.shaded.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)

at org.glowroot.agent.shaded.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163)

at org.glowroot.agent.shaded.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:418)

at org.glowroot.agent.shaded.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:454)

at org.glowroot.agent.shaded.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)

... 3 common frames omitted

Caused by: org.glowroot.agent.shaded.netty.channel.ConnectTimeoutException: connection timed out: 10.236.70.232/10.236.70.232:8181

at org.glowroot.agent.shaded.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:267)

... 9 common frames omitted

2017-02-14 01:15:04.838 WARN  o.g.agent.central.CentralConnection - error sending data to the central collector: UNAVAILABLE: Channel in TRANSIENT_FAILURE state (this warning will be logged at most once a minute, 12 warnings were suppressed since it was last logged)

[Trask Stalnaker]

This log looks like the agent is not able to connect to central.  Can you check that central is running at that IP address, and on that port, and that firewall is not blocking access?

Thanks,

Trask