Create External Hive Table on Delta Table in HDFS

[Logan Boyd]

Delta.io version 0.8.0

Delta Connector 0.2.0

Hive version 3.1.3

Cloudera CDP 7.1.4

I can create a Delta table and persist the files to HDFS but when I attempt to create a Hive external table and point it to the hdfs data I get the following error:

Is this because we are using Hive 3.x? Any workarounds or known releases to Hive 3.x to be supported with Delta Connector?

INFO  : Starting task [Stage-0:DDL] in serial mode

ERROR : Failed

java.lang.NoClassDefFoundError: org/apache/hadoop/hive/metastore/MetaStoreUtils

        at io.delta.hive.DeltaStorageHandler.preCreateTable(DeltaStorageHandler.scala:173) ~[delta-hive-assembly_2.11-0.2.0.jar:0.2.0]

        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:1047) ~[hive-exec-3.1.3000.7.1.4.0-203.jar:3.1.3000.7.1.4.0-203]

        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:1037) ~[hive-exec-3.1.3000.7.1.4.0-203.jar:3.1.3000.7.1.4.0-203]

[Shixiong(Ryan) Zhu]

The Hive connector doesn't support Hive 3. Although I have not tried, you may be able to make it work by changing some codes (such as replace removed APIs with alternative ones) in https://github.com/delta-io/connectors .

Best Regards,

Ryan

--
You received this message because you are subscribed to the Google Groups "Delta Lake Users and Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email to delta-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/delta-users/4bbdc752-8a4a-497a-bbdc-9e8795486004n%40googlegroups.com.

[Logan Boyd]

Thanks Ryan, I'm going to work with one of my Java developers to see. It's failing on some Scala code that checks to see if it's an External table.

Logan