Hello all, Need your help in fixing this issue. I can see that the dashboard opens but does not show any jobs Can anyone please help us to troubleshoot this issue.
Following I can see in mysql - Server version: 5.7.21-log MySQL Community Server (GPL)
We are using cloudera and the property yarn.resourcemanager.webapp.addres is already in place in CM. and we have also configured HADOOP_HOME as parameter before triggering Dr elephant. Following are the parameters - export HADOOP_HOME=/opt/cloudera/parcels/CDH/lib/hadoop export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop export PATH=$HADOOP_HOME/bin:$PATH Now, we dont change anything on name node / data node and do all changes via CM, so how do i fix the below issue.
Error message ***********************- 03-05-2018 08:42:28 ERROR [Thread-6] com.linkedin.drelephant.ElephantRunner : java.lang.RuntimeException: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address]. at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:89) at com.linkedin.drelephant.ElephantRunner.access$100(ElephantRunner.java:50) at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:103) at com.linkedin.drelephant.ElephantRunner$1.run(ElephantRunner.java:98) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1900) at com.linkedin.drelephant.security.HadoopSecurity.doAs(HadoopSecurity.java:109) at com.linkedin.drelephant.ElephantRunner.run(ElephantRunner.java:98) at com.linkedin.drelephant.DrElephant.run(DrElephant.java:34) Caused by: java.lang.RuntimeException: Cannot get YARN resource manager address from Hadoop Configuration property: [yarn.resourcemanager.webapp.address]. at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.updateResourceManagerAddresses(AnalyticJobGeneratorHadoop2.java:102) at com.linkedin.drelephant.analysis.AnalyticJobGeneratorHadoop2.configure(AnalyticJobGeneratorHadoop2.java:118) at com.linkedin.drelephant.ElephantRunner.loadAnalyticJobGenerator(ElephantRunner.java:86) ... 9 more |