We have found that Hive 3 on MR3 1.3 shows abnormal behavior caused by two Hive patches (HIVE-20703 and HIVE-16100) backported in the previous release of MR3 1.3. We also reproduced the same problem in HDP 3.1.4 which backports the same patches to Hive 3.1.2.
The problem is that you may fail to create managed ORC tables from external tables with error messages like:
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:
java.io.IOException:
Could not get block locations. Source file "/warehouse/tablespace/managed/hive/tpcds_bin_partitioned_orc_3000.db/catalog_returns/.hive-staging_hive_2019-10-21_14-21-14_582_5604866022752660637-1/_task_tmp.-ext-10000/cr_returned_date_sk=2451970/_tmp.000123_0/base_0000001/_orc_acid_version"
- Aborting...block==null
As a hotfix release, we have repackaged Hive 3 on MR3 1.3 with the two patches removed. We have removed the previous release and reuse the same version.
Cheers,
--- Sungwoo