Dr Elephant UI opens but trouble reading from RM - please help - we are working on a critical project and request assistance of all the buddies
37 views
Skip to first unread message
naturead...@gmail.com
Apr 5, 2018, 5:05:23 AM4/5/18
to dr-elephant-users
hello friends
We have high availability set up and also kerberos set up for secutity.
UI loads and all but this is the error i see in the log
can anyone please help us on this.
Please suggest how do u fix this issue =
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : The list of RM IDs are rm378,rm418
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : AnalysisProvider updating its Authenticate Token...
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Checking RM URL: http://itsusmpl00509.com:8088/ws/v1/cluster/info
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Error fetching Json for resource manager rm378 status Connection refused
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Checking RM URL: http://itsusmpl00756.com:8088/ws/v1/cluster/info
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Error fetching Json for resource manager rm418 status Connection refused
04-05-2018 04:03:05 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : Error occurred when configuring the analysis provider.
java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102)
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118)
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86)
at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109)
at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98)
at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34)
04-05-2018 04:03:05 ERROR [T04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : The list of RM IDs are rm378,rm418
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : AnalysisProvider updating its Authenticate Token...
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Checking RM URL: http://itsusmpl00509.com:8088/ws/v1/cluster/info
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Error fetching Json for resource manager rm378 status Connection refused
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Checking RM URL: http://itsusmpl00756.com:8088/ws/v1/cluster/info
04-05-2018 04:03:05 INFO [Thread-6] com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2 : Error fetching Json for resource manager rm418 status Connection refused
04-05-2018 04:03:05 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : Error occurred when configuring the analysis provider.
java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102)
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118)
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86)
at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109)
at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98)
at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34)
04-05-2018 04:03:05 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
04-05-2018 04:03:05 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:89)
at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109)
at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98)
at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34)
Caused by: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102)
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118)
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86)
... 9 more
04-05-2018 04:03:39 INFO [play-akka.actor.default-dispatcher-7] org.hibernate.validator.internal.util.Version : HV000001: Hibernate Validator 5.0.1.Final
hread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
04-05-2018 04:03:05 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:89)
at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109)
at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98)
at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34)
Caused by: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102)
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118)
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86)
... 9 more
04-05-2018 04:03:39 INFO [play-akka.actor.default-dispatcher-7] org.hibernate.validator.internal.util.Version : HV000001: Hibernate Validator 5.0.1.Final
naturead...@gmail.com
Apr 5, 2018, 5:21:24 AM4/5/18
to dr-elephant-users
also here is the problem - we do have active RM but its not picked up by the Dr elephant
What should i do so that data can be picked up by RM here
please assist.
Reply all
Reply to author
Forward
0 new messages