Trying to build SimpleMlp

[Timothy Curry]

Hi,

I cloned the BigDL repo to try and get a basic NN working. My plan is to use a NN in a Scala / Spark program. I have searched this user group for any info on this problem, but haven't found any.

I navigate to BigDL/apps/SimpleMlp in the cloned repo and try to build with sbt.

I get the following error:

not found: https://repo1.maven.org/maven2/com/eed3si9n/sbt-assembly_2.12_1.0/0.14.4/sbt-assembly-0.14.4.pom

Sure enough, there is no "0.14.4" directory under "sbt-assembly_2.12_1.0"

So how do I fix this?

Thank you in advance,

Tim

[Jason Dai]

The latest BigDL version is 2.3.0; see the download link: https://bigdl.readthedocs.io/en/latest/doc/release.html

Thanks,

-Jason

--
You received this message because you are subscribed to the Google Groups "User Group for BigDL" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bigdl-user-gro...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bigdl-user-group/81bf299c-c56e-424e-8d7b-0c44b27d9e6an%40googlegroups.com.

[Timothy Curry]

Hi Jason,

And thank you for your reply. I've only been coding with Scala for about two years now and

the most confounding thing about it is the library system. It is very frustrating to try to use.

That said, I'm not sure what to do with the information that you sent. I'm using sbt to build

and I'm using what came in the BigDL repo which contains:

libraryDependencies ++= Seq(

"org.apache.spark" % "spark-core_2.11" % "2.4.3" % "compile",
"org.apache.spark" % "spark-mllib_2.11" % "2.4.3" % "compile",
"com.intel.analytics.bigdl" % "bigdl-dllib-spark_2.4.6" % "0.14.0-SNAPSHOT"
)

I tried "bigdl-assembly-spark_2.4.6" % "2.4.0-SNAPSHOT" which is the link of the latest version,

but sbt did not like that.

I've looked for documentation for weeks trying to get BigDL to work before even posting here

but nothing seems to work.

Can you (or someone) tell me what I'm missing?

Thanks again,

Tim

[Phuong LE-HONG]

Dear Timothy,

Here is an excerpt of my sbt file. It should work. I have not used the latest version of BigDL. However, I think that replacing 2.1.0 with 2.3.0 still works. 

Best,

Phuong

==
val sparkVersion = "3.1.2"
val bigdlVersion = "2.1.0"

libraryDependencies ++= Seq(
  "org.apache.spark" %% "spark-core" % sparkVersion % "provided",
  "org.apache.spark" %% "spark-sql" % sparkVersion % "provided",
  "org.apache.spark" %% "spark-mllib" % sparkVersion % "provided",
  "com.intel.analytics.bigdl" % "bigdl-dllib-spark_3.1.2" % bigdlVersion

)

==

To view this discussion on the web visit https://groups.google.com/d/msgid/bigdl-user-group/81331acc-d790-414a-a230-d7aff29a2e3bn%40googlegroups.com.

[emimartin...@gmail.com]

Take a look to this repo. 

[Timothy Curry]

Thanks everyone for your help. The main problem seems to be that it can't find the eed3si9n package in Maven.
I don't know of a way to fix this. Besides the GitHub repo for it, all I can find is this:
https://central.sonatype.com/artifact/com.eed3si9n/sbt-assembly/2.1.1/overview

To view this discussion on the web visit https://groups.google.com/d/msgid/bigdl-user-group/d1c26ee0-65d7-4868-ab8b-f7737d5e6d2dn%40googlegroups.com.

[Phuong LE-HONG]

Dear Timothy,

You need to add a repo for your sbt-assembly plugin. Something like this:

addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "1.1.0")

Phuong

To view this discussion on the web visit https://groups.google.com/d/msgid/bigdl-user-group/CAPc6u1GJMPxRusnFn8eU4KSfx6xYn2R0dZkwa5Vcg7C%2BNX6J-A%40mail.gmail.com.