Presto Installation

[nira...@googlemail.com]

Hi, I have a cluster of 20 node running CDH 5, I installed Presto 0.117 using below config

Presto is on server : ***.***.**.120 Java Version : 1.8

Hive Meta Store running on server : ***.***.**.121 Java Version : 1.7

node.properties
==================
node.environment=boomshot_test
node.id=ffffffff-ffff-ffff-ffff-ffffffffffff
node.data-dir=/home/boom_user/presto/presto-server-0.117/data

config.properties
==================
coordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8080
query.max-memory=5GB
query.max-memory-per-node=1GB
discovery-server.enabled=true
discovery.uri=http://***.***.**.120:8080

cat hive.properties
==========================
connector.name=hive-cdh5
hive.metastore.uri=thrift://***.***.**.121:9083

1. Presto is getting started without any error but in Hive metastore log getting below error while starting Presto Client

./presto --server ***.***.**.120:8080 --catalog hive --schema default

Error in Hive Metasote log
=========================
2015-09-11 14:46:53,582 ERROR org.apache.thrift.server.TThreadPoolServer: Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:724)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:721)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1622)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:721)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:227)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.thrift.transport.TTransportException: Invalid status -128
at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:230)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:262)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more

Issue: Not able to query Hive default database database

Please can anybody help

[Anton Petrov]

Hi -- your config and setup look fine to me. Looking at the stack trace it seems like the exception is being thrown in the authentication section of the Metastore code. Do you have any kind of security setup on Hive? I believe authentication is done through the various user/authentication related options of the CLI jar so it may be worthwhile for you to play around with those. Sorry I can't be more helpful but I've never seen this error or anything similar. Maybe someone more experienced with Hive authentication can chime in.

--
You received this message because you are subscribed to the Google Groups "Presto" group.
To unsubscribe from this group and stop receiving emails from it, send an email to presto-users...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[nira...@googlemail.com]

[nira...@googlemail.com]

Yes, Hive is fenced with Kerbrose. Any Idea , if I need to enable kerbrose for Presto also ?

[Anton Petrov]

I don't think there's anything to enable. The CLI has a bunch of options related to kerberos. You can see those options if you run the CLI with --help. I'm afraid that's the extend of my knowledge.

[David Phillips]

Presto does not support Kerberos for the Hive metastore.