Hi Brian,
I've been looking for a Maven pom.xml that I could use to build my Spark-Scala app.
When I first packaged my Scala app using your pom-scala.xml file, it was 7MB. After adding <scope>provided</scope> to the scala-library artifact, the resulting jar was less than 10k. (So you might want to add that to your tutorial.)
I'm stuck on Spark 1.5.2 (Scala 2.10) right now. I'm getting this warning from the build:
[INFO] --- scala-maven-plugin:3.2.2:compile (default) @ test-spark-maven ---
[WARNING] Expected all dependencies to require Scala version: 2.10.4
[WARNING] com.att.flood:test-spark-maven:0.0.1 requires scala version: 2.10.4
[WARNING] com.twitter:chill_2.10:0.5.0 requires scala version: 2.10.4
[WARNING] com.typesafe.akka:akka-remote_2.10:2.3.11 requires scala version: 2.10.4
[WARNING] com.typesafe.akka:akka-actor_2.10:2.3.11 requires scala version: 2.10.4
[WARNING] com.typesafe.akka:akka-slf4j_2.10:2.3.11 requires scala version: 2.10.4
[WARNING] org.apache.spark:spark-core_2.10:1.5.2 requires scala version: 2.10.4
[WARNING] org.json4s:json4s-jackson_2.10:3.2.10 requires scala version: 2.10.0
[WARNING] Multiple versions of scala libraries detected!
Any ideas how to fix that?
-- Mark