Spark-Notebook Build for Spark Stand Alone Cluster

[Nashe Chiu]

All the builds assume you are using Hadoop. I have a Spark stand alone cluster without HDFS. Which build do I specify?

Best regards,

Nashe

[andy petrella]

in this case you don't care, just use the default 2.2.0 I'd say.
hth

--
You received this message because you are subscribed to the Google Groups "spark-notebook-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to spark-notebook-...@googlegroups.com.
To post to this group, send email to spark-not...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/spark-notebook-user/d520e2e5-17ba-466f-b8e8-13fe6c0c8b65%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

andy

[Nashe Chiu]

Andy,

I really like the Spark Notebook and I have been using it for a week from Docker. How do I get it to run from with my own Spark Clusters ?

Are you open sourcing the Spark Notebook?  From my experience having used Zeppelin I believe its much more advanced with more functionality.

Best regards,

Nashe

[Nashe Chiu]

Andy,

Sorry I only meant to ask about the open sourcing question. I have it running already.

Best regards,

Nashe

[andy petrella]

Hey man,

Sure thing, the Spark Notebook has always been open sourced: https://github.com/andypetrella/spark-notebook/

And we're really open to any contributions, we also eager to have recurrent contributors, we've got some PRs to review already :-P.

Thanks for the kind words! Can I ask you a question regarding your comparison with Zeppelin, many people told me the same, I'd like to have more specific information about that because, it'll help when facing this question with customers (and investors).

Thanks for everything!

cheers

--

andy

[Nashe Chiu]

Andy,

I'm working a detailed comparison between Spark Notebook and Zeppelin. Will email it to you soon.

Cheers,

Nashe

[Nashe Chiu]

Andy,

I'm trying to create a DataFrame from data which is in PostgreSQL using Spark SQL. 

val myPostgresqlDF = sqlContext.read.format("jdbc").options(
     Map("url" -> "jdbc:postgresql://mypostgres:5432/databsename?user=username&password=password",
         "dbtable" -> "mysqltable")).load()

I'm getting the following error below:

java.sql.SQLException: No suitable driver found for jdbc:postgresql://mypostgres:5432/databsename?user=username&password=password
  at java.sql.DriverManager.getConnection(DriverManager.java:596)
  at java.sql.DriverManager.getConnection(DriverManager.java:187)
  at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$$anonfun$getConnector$1.apply(JDBCRDD.scala:188)
  at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$$anonfun$getConnector$1.apply(JDBCRDD.scala:181)
  at org.apache.spark.sql.execution.datasources.jdbc.JDBCRDD$.resolveTable(JDBCRDD.scala:121)
  at org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation.<init>(JDBCRelation.scala:91)
  at org.apache.spark.sql.execution.datasources.jdbc.DefaultSource.createRelation(DefaultSource.scala:60)
  at org.apache.spark.sql.execution.datasources.ResolvedDataSource$.apply(ResolvedDataSource.scala:158)
  at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:119)
  ... 33 elided

How do I get this to work with work? Can you please help?

Best regards,

Nashe