Exception in thread "Thread-2" java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:167) Caused by: java.lang.RuntimeException: java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:578) at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:363) at org.apache.hadoop.mapred.FileInputFormat.setInputPaths(FileInputFormat.java:336) at spark.SparkContext.hadoopFile(SparkContext.scala:252) at spark.SparkContext.textFile(SparkContext.scala:224) at SvmPrimal$.main(SvmPrimal.scala:33) at SvmPrimal.main(SvmPrimal.scala) ... 5 more Caused by: java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2250) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2257) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:86) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2296) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2278) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:316) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:162) at org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:574) ... 11 more
This could be due to some configuration issue with CDH4.2.0. Can somebody help on resolving this.
Thanks,
Laxman
You received this message because you are subscribed to a topic in the Google Groups "Spark Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/spark-users/7Rca1ZlJ17M/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to spark-users...@googlegroups.com.