Error while running SparkR example in Mac OS X

52 views
Skip to first unread message

Tanmoy Datta Choudhury

unread,
Mar 25, 2015, 10:20:46 PM3/25/15
to spark...@googlegroups.com

Hi,

I am trying to run sparkR examples from the build (pi.R) as per https://github.com/amplab-extras/SparkR-pkg/wiki/SparkR-Quick-Start

./sparkR examples/pi.R local[2]

I am getting below error -

Loading required package: methods
[SparkR] Initializing with classpath    
 /Library/Frameworks/R.framework/Versions/3.1/Resources/library/SparkR/lib/SparkR/sparkr-assembly-0.1.jar

Launching java with command  java   -Xmx512m -cp 
'/Library/Frameworks/R.framework/Versions/3.1/Resources/library/SparkR/lib/Spark R/sparkr-assembly-0.1.jar:' edu.berkeley.cs.amplab.sparkr.SparkRBackend  
/var/folders/ln/tcj6cdjd6ss5bq460m7rxwh8fq9k4s/T//RtmpFRUeDo/backend_porta9916915855d 

15/03/25 20:31:47 INFO Slf4jLogger: Slf4jLogger started
15/03/25 20:31:49 WARN TaskSetManager: Stage 0 contains a task of very large    
size (391 KB). The maximum recommended task size is 100 KB.
15/03/25 20:32:49 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)

ultimately my connection is getting timed out. I was able to execute other instruction in the page referred above. Appreciate any direction to resolve this ?

Thanks

Tanmoy


Shivaram Venkataraman

unread,
Apr 6, 2015, 3:09:18 PM4/6/15
to Tanmoy Datta Choudhury, spark...@googlegroups.com
Does the SparkR shell work for you or do you see similar errors in that ? It'll be useful to get a full stack trace you see to help debug this better.

--
You received this message because you are subscribed to the Google Groups "SparkR Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sparkr-dev+...@googlegroups.com.
To post to this group, send email to spark...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sparkr-dev/c2dcb569-28e5-426d-bcc3-356b09d2bce6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages