Thanks, Kevin. I did a ./sbt "project spark" assembly and referenced the
resulting jar in your script. I have the Cassandra running, KEYSPACE
created and SPARK_HOME set/exported.
I get a stack trace:
[akmoch@acer1 geotrellis-cassandra]$ ./casingest.sh
zip warning: name not matched: META-INF/ECLIPSEF.RSA
zip error: Nothing to do!
(/home/akmoch/dev/build/geotrellis-cassandra/spark/target/scala-2.10/geotrellis-spark-assembly-0.10.0-SNAPSHOT.jar)
zip warning: name not matched: META-INF/ECLIPSEF.SF
zip error: Nothing to do!
(/home/akmoch/dev/build/geotrellis-cassandra/spark/target/scala-2.10/geotrellis-spark-assembly-0.10.0-SNAPSHOT.jar)
11:55:26 Slf4jLogger: Slf4jLogger started
11:55:26 Remoting: Starting remoting
11:55:26 Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkDriver@acer1:45240]
11:55:29 Cluster: New Cassandra host /
127.0.0.1:9042 added
11:55:29 CassandraConnector: Connected to Cassandra cluster: Test Cluster
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.mapreduce.Job.getInstance(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/mapreduce/Job;
at
geotrellis.spark.io.hadoop.HdfsUtils$.putFilesInConf(HdfsUtils.scala:57)
at
geotrellis.spark.io.hadoop.package$HadoopConfigurationWrapper.withInputDirectory(package.scala:55)
at
geotrellis.spark.io.hadoop.HadoopSparkContextMethods$class.hadoopGeoTiffRDD(HadoopSparkContextMethods.scala:29)
at
geotrellis.spark.io.hadoop.package$HadoopSparkContextMethodsWrapper.hadoopGeoTiffRDD(package.scala:43)
at
geotrellis.spark.ingest.CassandraIngestCommand$$anonfun$main$1.apply(CassandraIngestCommand.scala:41)
at
geotrellis.spark.ingest.CassandraIngestCommand$$anonfun$main$1.apply(CassandraIngestCommand.scala:40)
at
geotrellis.spark.io.cassandra.Cassandra$.withSession(Cassandra.scala:19)
at
geotrellis.spark.ingest.CassandraIngestCommand$.main(CassandraIngestCommand.scala:40)
at
geotrellis.spark.ingest.CassandraIngestCommand$.main(CassandraIngestCommand.scala:29)
at com.quantifind.sumac.ArgMain$class.mainHelper(ArgApp.scala:45)
at com.quantifind.sumac.ArgMain$class.main(ArgApp.scala:34)
at
geotrellis.spark.ingest.CassandraIngestCommand$.main(CassandraIngestCommand.scala:29)
at
geotrellis.spark.ingest.CassandraIngestCommand.main(CassandraIngestCommand.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
11:55:29 CassandraConnector: Disconnected from Cassandra cluster: Test
Cluster
Ideas?
Cheers,
Alex
> <mailto:
geotrellis-us...@googlegroups.com>.
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "geotrellis-user" group.
> To unsubscribe from this topic, visit
>
https://groups.google.com/d/topic/geotrellis-user/OPRJy8FBzxU/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
>
geotrellis-us...@googlegroups.com
> <mailto:
geotrellis-us...@googlegroups.com>.