Dashboard is up but not showing any jobs ( yarn.resourcemanager.webapp.address issue )

38 views
Skip to first unread message

ketanm k

unread,
Mar 8, 2018, 1:06:30 AM3/8/18
to dr-elephant-users

Hello all,

Need your help in fixing this issue.
I can see that the dashboard opens but does not show any jobs

Can anyone please help us to troubleshoot this issue.


Following I can see in mysql - Server version: 5.7.21-log MySQL Community Server (GPL)


We are using cloudera and the property yarn.resourcemanager.webapp.addres is already in place in CM.
and we have also configured HADOOP_HOME as parameter before triggering Dr elephant.

Following are the parameters -

export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export PATH=$HADOOP_HOME/bin:$PATH

Now, we dont change anything on name node / data node and do all changes via CM, so how do i fix the below issue.


Error message
***********************-
03-05-2018 08:42:28 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:89)
at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103)
at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900)
at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109)
at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98)
at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34)
Caused by: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address].
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102)
at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118)
at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86)
... 9 more

Please assist us asap
we are working for a large pharma company and this is a roadblock 
Reply all
Reply to author
Forward
0 new messages