[bug report]Hue UI:left_side_bar->SQL->SparkSql only show one "default" databse, nothing else

[zhen Wang]

There is only one database named "default" on left side menu when i choose sqarksql,see picture above, when I exec "show databases;" in sparksql query, there are many databases return, and any other normal sql all works fine except "use database xxx". 

The backend thrift server is org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, not the hiveserver2

hue version: 4.1

spark version: spark-2.1.0-bin-hadoop2.6

scala version: scala-2.11.8

hadoop version: hadoop-2.6.0-cdh5.13.0

By the way, if i use hiveserver2 as backend thrift server, the left side bar shows all databases normally.

Neeeeed help

[Romain Rigaux]

Last time we tried SparkSQL API was incomplete https://issues.cloudera.org/browse/HUE-2985

You could look on the Hue logs for what SparkSQL server returns on the GetSchemas() call.

--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+unsubscribe@cloudera.org.

[zhen Wang]

Thank u for response, if hue doesn't support sparksql completely yet, I'll leave this problem temporarily.

Below are the logs of hue when I refresh the database in left side bar.Is it the reason of "get_table_chema" unsupported?

[19/Dec/2017 16:56:20 +0000] access       INFO     192.168.199.11 hadoop - "POST /notebook/api/autocomplete/ HTTP/1.1"

[19/Dec/2017 16:56:20 +0000] dbms         DEBUG    Query Server: {'server_name': 'sparksql', 'transport_mode': 'socket', 'server_host': 'bd-1', 'server_port': 11000, 'auth_password_used': False, 'http_url': 'http://bd-1:10001/cliservice', 'auth_username': 'hue', 'principal': None}

[19/Dec/2017 16:56:20 +0000] thrift_util  DEBUG    Thrift call: <class 'TCLIService.TCLIService.Client'>.GetSchemas(args=(TGetSchemasReq(schemaName='*', sessionHandle=TSessionHandle(sessionId=THandleIdentifier(secret=1e4d24263b45cdbd:ac4e76485f05b89c, guid=8742a9b12f95a6dc:928bc20a56b7b4be)), catalogName=None),), kwargs={})

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call <class 'TCLIService.TCLIService.Client'>.GetSchemas returned in 2ms: TGetSchemasResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret=83471958b9511b58:c886e9ade8a54d88, guid=10406be2a26f91d1:15b6d93850b07984)))

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call: <class 'TCLIService.TCLIService.Client'>.FetchResults(args=(TFetchResultsReq(fetchType=0, operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret=83471958b9511b58:c886e9ade8a54d88, guid=10406be2a26f91d1:15b6d93850b07984)), orientation=0, maxRows=5000),), kwargs={})

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call <class 'TCLIService.TCLIService.Client'>.FetchResults returned in 0ms: TFetchResultsResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), results=TRowSet(rows=[], columns=[TColumn(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringColumn(nulls='\x00', values=['default']), boolVal=None, doubleVal=None, binaryVal=None), TColumn(i32Val=None, byteVal=None, i16Val=None, i64Val=None, stringVal=TStringColumn(nulls='\x00', values=['']), boolVal=None, doubleVal=None, binaryVal=None)], startRowOffset=0), hasMoreRows=False)

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call: <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata(args=(TGetResultSetMetadataReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret=83471958b9511b58:c886e9ade8a54d88, guid=10406be2a26f91d1:15b6d93850b07984))),), kwargs={})

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call <class 'TCLIService.TCLIService.Client'>.GetResultSetMetadata returned in 1ms: TGetResultSetMetadataResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0), schema=TTableSchema(columns=[TColumnDesc(comment='Schema name.', columnName='TABLE_SCHEM', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=1), TColumnDesc(comment='Catalog name.', columnName='TABLE_CATALOG', typeDesc=TTypeDesc(types=[TTypeEntry(mapEntry=None, unionEntry=None, arrayEntry=None, userDefinedTypeEntry=None, structEntry=None, primitiveEntry=TPrimitiveTypeEntry(typeQualifiers=None, type=7))]), position=2)]))

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call: <class 'TCLIService.TCLIService.Client'>.CloseOperation(args=(TCloseOperationReq(operationHandle=TOperationHandle(hasResultSet=True, modifiedRowCount=None, operationType=3, operationId=THandleIdentifier(secret=83471958b9511b58:c886e9ade8a54d88, guid=10406be2a26f91d1:15b6d93850b07984))),), kwargs={})

[19/Dec/2017 16:56:21 +0000] thrift_util  DEBUG    Thrift call <class 'TCLIService.TCLIService.Client'>.CloseOperation returned in 0ms: TCloseOperationResp(status=TStatus(errorCode=None, errorMessage=None, sqlState=None, infoMessages=None, statusCode=0))

在 2017年12月19日星期二 UTC+8上午2:15:26，Romain Rigaux写道：

To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+u...@cloudera.org.