Hi I have installed CDH 5.7.1 using a local repo using cloudera manager
After having everything installed I am trying to deploy the spark notepad view in hue
Spark version is 1.6.1 and hue 3.9.0
So when I try to run the basic examples given the first application is never run and when I am trying to run the next one I am getting the following error
· java.lang.IllegalStateException: Session is in state error (error 500)
· The following Is the screen shot of hue notepad
The following is the screenshot of metrics of livy server
The below is what appears in the terminal when I run livy server and the spark application in the notebook
127.0.0.1 - - - 14/Jun/2016:15:06:45 -0400 "GET /sessions HTTP/1.1" 200 34
127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17
127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17
127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/1 HTTP/1.1" 404 17
127.0.0.1 - - - 14/Jun/2016:15:10:10 -0400 "POST /sessions/-1/statements HTTP/1.1" 404 17
127.0.0.1 - - - 14/Jun/2016:15:10:10 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17
127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "POST /sessions HTTP/1.1" 201 74
127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "GET /sessions/0 HTTP/1.1" 200 74
127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "GET /sessions/0 HTTP/1.1" 200 74
127.0.0.1 - - - 14/Jun/2016:15:10:13 -0400 "GET /sessions/0 HTTP/1.1" 200 74
127.0.0.1 - - - 14/Jun/2016:15:10:14 -0400 "GET /sessions/0 HTTP/1.1" 200 992
10.50.1.11 - - - 14/Jun/2016:15:10:14 -0400 "POST /sessions/0/callback HTTP/1.1" 200 0
127.0.0.1 - - - 14/Jun/2016:15:10:15 -0400 "GET /sessions/0 HTTP/1.1" 200 988
127.0.0.1 - - - 14/Jun/2016:15:10:23 -0400 "POST /sessions/0/statements HTTP/1.1" 201 40
127.0.0.1 - - - 14/Jun/2016:15:10:27 -0400 "GET /sessions/0/statements/0 HTTP/1.1" 200 256
127.0.0.1 - - - 14/Jun/2016:15:10:29 -0400 "GET /sessions/0/log?from=0 HTTP/1.1" 200 3994
127.0.0.1 - - - 14/Jun/2016:15:10:29 -0400 "GET /sessions/0/log?from=0&size=100 HTTP/1.1" 200 3994
127.0.0.1 - - - 14/Jun/2016:15:10:33 -0400 "GET /sessions/0/statements/0 HTTP/1.1" 200 256
127.0.0.1 - - - 14/Jun/2016:15:10:50 -0400 "POST /sessions/0/statements HTTP/1.1" 500 58
10.50.1.100 - - - 14/Jun/2016:15:11:33 -0400 "GET /threads HTTP/1.1" 200 42027
Below is the error log of hue
[14/Jun/2016 12:10:50 -0700] decorators ERROR error running <function execute at 0x7f2c81429cf8>
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/decorators.py", line 78, in decorator
return func(*args, **kwargs)
File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/api.py", line 83, in execute
response['handle'] = get_api(request, snippet).execute(notebook, snippet)
File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/connectors/spark_shell.py", line 107, in execute
raise e
RestException: java.lang.IllegalStateException: Session is in state error (error 500)
In addition to this when I run test after buliding livy server it fails
Below is how i installed the livy server
Export SPARK_HOME=/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/spark
Export HADOOP_CONF_DIR=/etc/hadoop/conf
cd hue/apps/spark/java/
mvn -DskipTests -Dspark.version=1.6.1 clean package
I have set the following in hue.ini
[desktop]
app_blacklist=
[spark]
# URL of the REST Spark Job Server.
#server_url=http://localhost:8090/
# List of available types of snippets
languages='[{"name": "Scala", "type": "scala"},{"name": "Python", "type": "python"},{"name": "Impala SQL", "type": "impala"},{"name": "Hive SQL", "type": "hive"},{"name": "Text", "type": "text"}]'
# Uncomment to use the YARN mode
livy_server_session_kind=yarn
--
You received this message because you are subscribed to a topic in the Google Groups "Hue-Users" group.
To unsubscribe from this topic, visit https://groups.google.com/a/cloudera.org/d/topic/hue-user/Ysa-lFKbkQw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to hue-user+u...@cloudera.org.
--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+unsubscribe@cloudera.org.