Log Type: syslog
Log Upload Time: Mon May 29 03:00:47 +0000 2017
Log Length: 5942
2017-05-29 03:00:38,859 [INFO] [main] |app.DAGAppMaster|: Creating DAGAppMaster for applicationId=application_1495997160588_0033, attemptNum=1, AMContainerId=container_e14_1495997160588_0033_01_000001, jvmPid=9610, userFromEnv=hdfs, cliSessionOption=true, pwd=/hadoop/yarn/local/usercache/hdfs/appcache/application_1495997160588_0033/container_e14_1495997160588_0033_01_000001, localDirs=/hadoop/yarn/local/usercache/hdfs/appcache/application_1495997160588_0033, logDirs=/hadoop/yarn/log/application_1495997160588_0033/container_e14_1495997160588_0033_01_000001 2017-05-29 03:00:39,286 [INFO] [main] |app.DAGAppMaster|: Created DAGAppMaster for application appattempt_1495997160588_0033_000001, versionInfo=[ component=tez-dag, version=0.7.0.2.3.4.0-3485, revision=1054117556c7c24127c7d0c768323a59a537f6da, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20151216-0351 ] 2017-05-29 03:00:39,297 [INFO] [main] |app.DAGAppMaster|: Comparing client version with AM version, clientVersion=0.7.0.2.3.4.0-3485, AMVersion=0.7.0.2.3.4.0-3485 2017-05-29 03:00:39,412 [INFO] [main] |service.AbstractService|: Service org.apache.tez.dag.app.DAGAppMaster failed in state INITED; cause: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class alluxio.hadoop.FileSystem not found java.lang.RuntimeException: java.lang.ClassNotFoundException: Class alluxio.hadoop.FileSystem not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2195) at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2638) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:86) at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:145) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:407) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.tez.dag.app.DAGAppMaster$6.run(DAGAppMaster.java:2274) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2271) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2086) Caused by: java.lang.ClassNotFoundException: Class alluxio.hadoop.FileSystem not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193) ... 17 more 2017-05-29 03:00:39,418 [WARN] [main] |service.AbstractService|: When stopping the service org.apache.tez.dag.app.DAGAppMaster : java.lang.NullPointerException java.lang.NullPointerException at org.apache.tez.dag.app.DAGAppMaster.initiateStop(DAGAppMaster.java:1842) at org.apache.tez.dag.app.DAGAppMaster.serviceStop(DAGAppMaster.java:1855) at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221) at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52) at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:171) at org.apache.tez.dag.app.DAGAppMaster$6.run(DAGAppMaster.java:2274) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2271) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2086) 2017-05-29 03:00:39,419 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster java.lang.RuntimeException: java.lang.ClassNotFoundException: Class alluxio.hadoop.FileSystem not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2195) at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2638) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295) at org.apache.tez.common.TezCommonUtils.getTezBaseStagingPath(TezCommonUtils.java:86) at org.apache.tez.common.TezCommonUtils.getTezSystemStagingPath(TezCommonUtils.java:145) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:407) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.tez.dag.app.DAGAppMaster$6.run(DAGAppMaster.java:2274) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2271) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2086) Caused by: java.lang.ClassNotFoundException: Class alluxio.hadoop.FileSystem not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193) ... 17 more 2017-05-29 03:00:39,421 [INFO] [Thread-3] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-users+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Actually, it was class alluxio.hadoop.FileSystem not found. I have placed the jar in HADOOP_CLASSPATH as well as in HIVE_AUX_JARS_PATH as well as in tez library paths. Hadoop apis are working fine with alluxio Uri and i am able to create an external hive table as well on the top of uri pointing to alluxio. However, whenever i run any query which requires MR or TEZ in hive, it failes with this issue. What am i missing here ? I am able to run the map reduce word count example using -libjars option as well. Only in hive MR/TEZ gives this error.
--
You received this message because you are subscribed to a topic in the Google Groups "Alluxio Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/alluxio-users/uhNjxo_wNew/unsubscribe.
To unsubscribe from this group and all its topics, send an email to alluxio-user...@googlegroups.com.
--
Actually, it was class alluxio.hadoop.FileSystem not found. I have placed the jar in HADOOP_CLASSPATH as well as in HIVE_AUX_JARS_PATH as well as in tez library paths. Hadoop apis are working fine with alluxio Uri and i am able to create an external hive table as well on the top of uri pointing to alluxio. However, whenever i run any query which requires MR or TEZ in hive, it failes with this issue. What am i missing here ? I am able to run the map reduce word count example using -libjars option as well. Only in hive MR/TEZ gives this error.
--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to alluxio-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Hi Bin,