Spark-Hive | Delegation Token can be issued only with kerberos or web authentication

[Sumit]

Hi,

We are trying to create hive table using spark action on secured hdp cluster but its failing with below error.

Caused by: org.apache.hadoop.ipc.RemoteException: Delegation Token can be issued only with kerberos or web authentication

at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getDelegationToken(FSNamesystem.java:7130)

at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getDelegationToken(NameNodeRpcServer.java:676)

at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getDelegationToken(ClientNamenodeProtocolServerSideTranslatorPB.java:1011)

If we change "hive.execution.engine" to 'mr' it works fine. But we need to keep it to tez and here it fails.

We tried adding hive.metastore.token.signature as well but it still fails with above error and below warning.

[Driver:o.a.h.h.c.HiveConf@2763] - HiveConf of name hive.metastore.token.signature does not exist

hdp - 2.6.5

cdap - 4.3.3

tez - 0.7.0

hive - 1.2.1000

Full error logs attached with sample pipeline.

Thanks

Sumit

[Ali Anwar]

Hi Sumit.

As a preliminary check, have you done the setup as required in the Hive on Tez documentation?
Specifically, TEZ_HOME and TEZ_CONF_DIR need to be set in cdap-env.sh.

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To post to this group, send email to cdap...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/ecd741e4-a216-4afe-b4c3-9003b42ad115%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Sumit]

Hi Ali,

We used ambari to set up so it is as per the documentation.

Thanks

Sumit