java.lang.IllegalStateException: Session is in state error (error 500)

172 views
Skip to first unread message

Sai Kireety

unread,
Jun 14, 2016, 4:15:05 PM6/14/16
to Hue-Users

Hi I have installed CDH 5.7.1 using a local repo using cloudera manager

After having everything installed I am trying to deploy the spark notepad view in hue

Spark version is 1.6.1 and hue 3.9.0

So when I try to run the basic examples given the first application is never run and when I am trying to run the next one I am getting the following error

 

·         java.lang.IllegalStateException: Session is in state error (error 500)

·         The following Is the screen shot of hue notepad

 

The following is the screenshot of metrics of livy server

The below is what appears in the terminal when I run livy server and the spark application in the notebook

127.0.0.1 - - - 14/Jun/2016:15:06:45 -0400 "GET /sessions HTTP/1.1" 200 34

127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17

127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17

127.0.0.1 - - - 14/Jun/2016:15:08:34 -0400 "DELETE /sessions/1 HTTP/1.1" 404 17

127.0.0.1 - - - 14/Jun/2016:15:10:10 -0400 "POST /sessions/-1/statements HTTP/1.1" 404 17

127.0.0.1 - - - 14/Jun/2016:15:10:10 -0400 "DELETE /sessions/-1 HTTP/1.1" 404 17

127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "POST /sessions HTTP/1.1" 201 74

127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "GET /sessions/0 HTTP/1.1" 200 74

127.0.0.1 - - - 14/Jun/2016:15:10:12 -0400 "GET /sessions/0 HTTP/1.1" 200 74

127.0.0.1 - - - 14/Jun/2016:15:10:13 -0400 "GET /sessions/0 HTTP/1.1" 200 74

127.0.0.1 - - - 14/Jun/2016:15:10:14 -0400 "GET /sessions/0 HTTP/1.1" 200 992

10.50.1.11 - - - 14/Jun/2016:15:10:14 -0400 "POST /sessions/0/callback HTTP/1.1" 200 0

127.0.0.1 - - - 14/Jun/2016:15:10:15 -0400 "GET /sessions/0 HTTP/1.1" 200 988

127.0.0.1 - - - 14/Jun/2016:15:10:23 -0400 "POST /sessions/0/statements HTTP/1.1" 201 40

127.0.0.1 - - - 14/Jun/2016:15:10:27 -0400 "GET /sessions/0/statements/0 HTTP/1.1" 200 256

127.0.0.1 - - - 14/Jun/2016:15:10:29 -0400 "GET /sessions/0/log?from=0 HTTP/1.1" 200 3994

127.0.0.1 - - - 14/Jun/2016:15:10:29 -0400 "GET /sessions/0/log?from=0&size=100 HTTP/1.1" 200 3994

127.0.0.1 - - - 14/Jun/2016:15:10:33 -0400 "GET /sessions/0/statements/0 HTTP/1.1" 200 256

127.0.0.1 - - - 14/Jun/2016:15:10:50 -0400 "POST /sessions/0/statements HTTP/1.1" 500 58

10.50.1.100 - - - 14/Jun/2016:15:11:33 -0400 "GET /threads HTTP/1.1" 200 42027

 

 

Below is the error log of hue

[14/Jun/2016 12:10:50 -0700] decorators   ERROR    error running <function execute at 0x7f2c81429cf8>

Traceback (most recent call last):

  File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/decorators.py", line 78, in decorator

    return func(*args, **kwargs)

  File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/api.py", line 83, in execute

    response['handle'] = get_api(request, snippet).execute(notebook, snippet)

  File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/hue/desktop/libs/notebook/src/notebook/connectors/spark_shell.py", line 107, in execute

    raise e

RestException: java.lang.IllegalStateException: Session is in state error (error 500)

 

In addition to this when I run test after buliding livy server it fails

 

Below is how i installed the livy server


Export SPARK_HOME=/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p0.11/lib/spark

Export HADOOP_CONF_DIR=/etc/hadoop/conf

cd hue/apps/spark/java/

mvn -DskipTests -Dspark.version=1.6.1 clean package


I have set the following in hue.ini


[desktop] 

app_blacklist=


[spark]

# URL of the REST Spark Job Server.

#server_url=http://localhost:8090/

 

# List of available types of snippets

languages='[{"name": "Scala", "type": "scala"},{"name": "Python", "type": "python"},{"name": "Impala SQL", "type": "impala"},{"name": "Hive SQL", "type": "hive"},{"name": "Text", "type": "text"}]'


# Uncomment to use the YARN mode

livy_server_session_kind=yarn

Sai Kireety

unread,
Jun 14, 2016, 4:17:12 PM6/14/16
to Hue-Users
Sorry for the missing images

the screen shot of spark notebook
Inline image 1


livy server metrics
Inline image 2

--
You received this message because you are subscribed to a topic in the Google Groups "Hue-Users" group.
To unsubscribe from this topic, visit https://groups.google.com/a/cloudera.org/d/topic/hue-user/Ysa-lFKbkQw/unsubscribe.
To unsubscribe from this group and all its topics, send an email to hue-user+u...@cloudera.org.

Aleks Rapoport

unread,
Oct 12, 2016, 8:09:36 AM10/12/16
to Hue-Users
Hallo Sai,

did you find a solution? I have the same problem. :(

Romain Rigaux

unread,
Oct 14, 2016, 5:09:35 PM10/14/16
to Aleks Rapoport, Hue-Users
Usually this means the session in Livy crashed, would recommend to follow up with Livy 0.2 and the list http://livy.io/

--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+unsubscribe@cloudera.org.

Reply all
Reply to author
Forward
0 new messages