Hue 3.10.0 is not stable, occasionally will not be able to use

BinZhang

unread,

Sep 17, 2016, 11:09:20 PM9/17/16

to Hue-Users

Hi,all:

We use the version of Hue is 3.10.0,is not stable, occasionally will not be able to use.In addition we also use the sentry1.6.0 hive1.1.0, MariaDB - 10.0.22.

This phenomenon is can't query the metastore information, that is,can not query table information through the hue until timeout.

There are two strange phenomenon:

1、netstat -aln|grep 10000

There are many closed_wait connection

2、when query avro table through the hue so many sentry logs print and very crazy,as following:

INFO DataNucleus.Query: Reading in results for query "SELECT FROM org.apache.sentry.provider.db.service.model.MSentryPrivilege WHERE roles.contains(role) && (role.roleName == "") && serverName == "" && ((dbName == "") || (dbName == "__NULL__")) && (URI == "__NULL__") && ((tableName == "") || (tableName == "__NULL__")) && (URI == "__NULL__") && ((columnName == "") || (columnName == "__NULL__")) && (URI == "__NULL__") VARIABLES org.apache.sentry.provider.db.service.model.MSentryRole role" since the connection used is closing

When this happens, restart the hiveserver2 service just fine.The thing puzzled me for a long time.Have you encountered this kind of situation?If so how did you resolve it ?Thanks !!!

Chriss Vincelette

unread,

Sep 18, 2016, 3:26:14 PM9/18/16

to BinZhang, Hue-Users

We are experiencing the exact same problem.

This can happen for a variety of reasons. All seem to be hiveserver2 problems.

Especially if you use a bad (wrongly formatted) partition key. It will scan the entire metadata store then launch a map reduce job only to ultimately return no results (because the partition key was bad to begin with.)

During this entire time the query compiler thread is completely blocked so no other queries can be compiled.

We have found no hue or hiveserver2 settings that can be tweaked to compensate for this other than turning query optimization off completely. But then that means every query will result in a map reduce.

Sorry this doesn't help, but hopefully it at least provides some insight.

-Chriss-

--
You received this message because you are subscribed to the Google Groups "Hue-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hue-user+u...@cloudera.org.

BinZhang

unread,

Sep 18, 2016, 11:45:09 PM9/18/16

to Hue-Users

Thank you very much

在 2016年9月19日星期一 UTC+8上午3:26:14，Chriss Vincelette写道：

Reply all

Reply to author

Forward