can't get spark-yarn-assembly-{{site.SPARK_VERSION}}.jar after build spark on yarn

47 views
Skip to first unread message

聪樊

unread,
Sep 4, 2013, 5:44:59 AM9/4/13
to spark...@googlegroups.com
Hi All

   I am a newbie in spark. And try to build spark on yarn for our project. I build 0.8 branch based on the instruction on https://github.com/mesos/spark/blob/master/docs/running-on-yarn.md, there is no spark-yarn-assembly-{{site.SPARK_VERSION}}.jar generated in yarn/target folder. I also tried spark-assembly-{{site.SPARK_VERSION}}.jar, it shows an error: can't find class org.apache.spark.deploy.yarn.Client. Could anyone point me what's missed here? Thanks a lot!

-Lucas


Jey Kottalam

unread,
Sep 4, 2013, 3:10:07 PM9/4/13
to spark...@googlegroups.com
Hi Lucas,

Thanks for catching this problem. I just submitted a pull request with a proposed fix: https://github.com/mesos/spark/pull/892

-Jey


--
You received this message because you are subscribed to the Google Groups "Spark Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-users...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Reply all
Reply to author
Forward
0 new messages