Help running pySparkling in Jupyter/Python2

333 views
Skip to first unread message

Joe Codeswell

unread,
Sep 16, 2016, 12:12:39 PM9/16/16
to H2O Open Source Scalable Machine Learning - h2ostream
Dear h2ostream,

I am very new to H2O, Spark, etc..

I am TRYING to run pySparkling in Jupyter/Python2.

I can import h2o. However when I try to import pysparkling, it gets found, but throws an error saying, "... ImportError: No module named pyspark.context". I'll put a screenshot below my signature.

So I have 2 questions:

  • Am i barking up the wrong tree; can pysparkling be used in this way?
  • If it's "the RIGHT TREE" :), what do i need to do to make this work?

Thanks.

Love and peace,

Joe

Here's the screenshot.




mat...@0xdata.com

unread,
Sep 19, 2016, 1:03:35 AM9/19/16
to H2O Open Source Scalable Machine Learning - h2ostream
Hey Joe,

How did you start the notebook? Have you followed our instructions from the download page (http://www.h2o.ai/download/sparkling-water/spark16#pysparkling)?

Should be working fine, here are some example notebooks we tested it with https://github.com/h2oai/sparkling-water/tree/master/py/examples/notebooks

If, even after following the above steps, it doesn't work we might need to some details about your work env to try and reproduce it.

Mateusz

On Saturday, September 17, 2016 at 1:12:39 AM UTC+9, Joe Codeswell wrote:
> Dear h2ostream,
>
>
> I am very new to H2O, Spark, etc..
>
>
> I am TRYING to run pySparkling in Jupyter/Python2.
>
>
> I can import h2o. However when I try to import pysparkling, it gets found, but throws an error saying, "... ImportError: No module named pyspark.context". I'll put a screenshot below my signature.
>
>
> So I have 2 questions:
>
>
> Am i barking up the wrong tree; can pysparkling be used in this way?If it's "the RIGHT TREE" :), what do i need to do to make this work?

Joe Codeswell

unread,
Sep 19, 2016, 11:11:35 AM9/19/16
to H2O Open Source Scalable Machine Learning - h2ostream, mat...@0xdata.com
Dear Mateusz,

Thanks for the reply.

How did you start the notebook?
 
i made a shortcut:
  target: C:\Python35\Scripts\jupyter-joe.cmd
  start in: C:\Python35\Scripts
  content of jupyter-joe.cmd:

cd C:\Users\joeco\Jupyter
jupyter notebook

Have you followed our instructions from...

I don't think I did. i just looked at them and they don't look familiar. 
I'll go over them and see if they shed light on the matter. 
I'll report back here with my results.

Thanks for the sample notebooks as well, Mateusz

Love and peace,

Joe

Joe Codeswell

unread,
Sep 19, 2016, 11:25:50 AM9/19/16
to H2O Open Source Scalable Machine Learning - h2ostream, mat...@0xdata.com
This is a immediate follow-on to my just posted response to Mateusz.

I just noticed that i am using Python 35 to fire up Jupyter. 
Although i know i am running pySparkling in a Jupyter Python 2 Kernel.
I do run both Python 35 and Python 27 on my machine. 

I wonder if that makes a difference?

Thanks again, Mateusz.

Love and peace,
Joe

Joe Codeswell

unread,
Sep 19, 2016, 11:43:27 AM9/19/16
to H2O Open Source Scalable Machine Learning - h2ostream, mat...@0xdata.com
2nd immediate follow-up

WHATEVER download instructions i WAS following, i DID download spark-1.6.2-bin-hadoop2.6.
HOWEVER i downloaded the wrong, -1.3.6 sparkling-water.

Love and peace,
Joe
Reply all
Reply to author
Forward
0 new messages