Error Initializing SparkContext

[qizhong...@gmail.com]

Hi, 

I'm getting this error when I try to use the analysis-tool to test my UR engine. Please help. 

16/12/15 12:06:31 INFO SparkDeploySchedulerBackend: Granted executor ID app-20161215120631-0001/0 on hostPort 192.168.0.4:62110 with 4 cores, 1024.0 MB RAM

16/12/15 12:06:31 INFO AppClient$ClientEndpoint: Executor updated: app-20161215120631-0001/0 is now RUNNING

16/12/15 12:06:31 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 62219.

16/12/15 12:06:31 INFO NettyBlockTransferService: Server created on 62219

16/12/15 12:06:31 INFO BlockManagerMaster: Trying to register BlockManager

16/12/15 12:06:31 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.0.4:62219 with 3.4 GB RAM, BlockManagerId(driver, 192.168.0.4, 62219)

16/12/15 12:06:31 INFO BlockManagerMaster: Registered BlockManager

16/12/15 12:06:32 ERROR SparkContext: Error initializing SparkContext.

java.lang.IllegalArgumentException: java.net.UnknownHostException: namenode

at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)

at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:312)

at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:178)

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:665)

at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:601)

at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)

at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)

at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)

at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)

at org.apache.spark.util.Utils$.getHadoopFileSystem(Utils.scala:1686)

at org.apache.spark.scheduler.EventLoggingListener.<init>(EventLoggingListener.scala:66)

at org.apache.spark.SparkContext.<init>(SparkContext.scala:547)

at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:59)

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)

at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)

at py4j.Gateway.invoke(Gateway.java:214)

at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)

[Pat Ferrel]

The analysis tools are as-is with no support. You must read the code. I will say that “namenode” is a term that applies to what acts like a master for HDFS so some config is bad.

-- 
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-use...@googlegroups.com.
To post to this group, send email to action...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/adaa2549-eba2-4b6c-ba38-8141194b4b96%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.