MR3 1.3 hotfix released

22 views
Skip to first unread message

Sungwoo Park

unread,
Nov 3, 2021, 9:27:43 AM11/3/21
to MR3
We have found that Hive 3 on MR3 1.3 shows abnormal behavior caused by two Hive patches (HIVE-20703 and HIVE-16100) backported in the previous release of MR3 1.3. We also reproduced the same problem in HDP 3.1.4 which backports the same patches to Hive 3.1.2.

The problem is that you may fail to create managed ORC tables from external tables with error messages like:

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: Could not get block locations. Source file "/warehouse/tablespace/managed/hive/tpcds_bin_partitioned_orc_3000.db/catalog_returns/.hive-staging_hive_2019-10-21_14-21-14_582_5604866022752660637-1/_task_tmp.-ext-10000/cr_returned_date_sk=2451970/_tmp.000123_0/base_0000001/_orc_acid_version" - Aborting...block==null

As a hotfix release, we have repackaged Hive 3 on MR3 1.3 with the two patches removed. We have removed the previous release and reuse the same version.

Cheers,

--- Sungwoo
Reply all
Reply to author
Forward
0 new messages