Groups
Conversations
All groups and messages
Send feedback to Google
Help
Sign in
Groups
MR3
Conversations
Labels
About
MR3
1–30 of 165
This Google Group is about MR3, Hive on MR3, and Spark on MR3.
Mark all as read
Report abusive group
0 selected
Carol Chapman
,
Sungwoo Park
6
Aug 25
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
This will be fixed in MR3 1.8. --- Sungwoo On Wednesday, October 12, 2022 at 1:24:06 AM UTC+9
unread,
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
This will be fixed in MR3 1.8. --- Sungwoo On Wednesday, October 12, 2022 at 1:24:06 AM UTC+9
Aug 25
Sungwoo Park
,
Ill
3
Jun 5
MR3 Slack channel,
I think it's better to add slack entry on the home page of MR3. Sungwoo Park <glapark@gmail.
unread,
MR3 Slack channel,
I think it's better to add slack entry on the home page of MR3. Sungwoo Park <glapark@gmail.
Jun 5
Sungwoo Park
May 31
Performance Evaluation of Trino, Spark, and Hive on MR3
With the release of MR3 1.7, I published a blog article where we compare Trino, Spark, and Hive on
unread,
Performance Evaluation of Trino, Spark, and Hive on MR3
With the release of MR3 1.7, I published a blog article where we compare Trino, Spark, and Hive on
May 31
Sungwoo Park
May 29
hive.auto.convert.join.noconditionaltask.size and tez.runtime.pipelined.sorter.lazy-allocate.memory in MR3 1.7
In MR3 1.7, we have changed the values for hive.auto.convert.join.noconditionaltask.size and tez.
unread,
hive.auto.convert.join.noconditionaltask.size and tez.runtime.pipelined.sorter.lazy-allocate.memory in MR3 1.7
In MR3 1.7, we have changed the values for hive.auto.convert.join.noconditionaltask.size and tez.
May 29
Sungwoo Park
,
Ill
5
May 29
MR3 1.7
MR3 1.7 has been released. I have updated the binary releases at Github and the Docker image at
unread,
MR3 1.7
MR3 1.7 has been released. I have updated the binary releases at Github and the Docker image at
May 29
Ill
,
Sungwoo Park
2
May 2
MR3 can fail to request resources under high load
Alright, sounds good. I suspect it is a problem with Hadoop, however, because the logic for
unread,
MR3 can fail to request resources under high load
Alright, sounds good. I suspect it is a problem with Hadoop, however, because the logic for
May 2
Ill
,
Sungwoo Park
2
May 2
Does MR3 support specifying job priority for YARN?
No. Currently MR3 can specify only a job queue (with the config key mr3.queue.name). It's easy to
unread,
Does MR3 support specifying job priority for YARN?
No. Currently MR3 can specify only a job queue (with the config key mr3.queue.name). It's easy to
May 2
Sungwoo Park
,
Ill
3
May 2
tez.runtime.compress and tez.runtime.compress.codec
On Hadoop, Java command is controlled by Hadoop, so running MR3 with its own Java 11 environments is
unread,
tez.runtime.compress and tez.runtime.compress.codec
On Hadoop, Java command is controlled by Hadoop, so running MR3 with its own Java 11 environments is
May 2
Subhasmita Swain
,
Sungwoo Park
3
Apr 5
hivemr3-metastore & hivemr3-hiveserver2 is crashlooping and mr3master pod not turning up
If you should use a different MySQL connector, please check out this page and the link to
unread,
hivemr3-metastore & hivemr3-hiveserver2 is crashlooping and mr3master pod not turning up
If you should use a different MySQL connector, please check out this page and the link to
Apr 5
Ill
,
Sungwoo Park
2
Mar 6
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
unread,
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
Mar 6
Sungwoo Park
Feb 20
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
unread,
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
Feb 20
Sungwoo Park
, …
Ill
8
Jan 31
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
unread,
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
Jan 31
Ill
,
Sungwoo Park
2
Jan 14
Compare the performance test results of MR3-HIVE and APACHE KYUUBI
If Kyuubi can accelerate the execution of Spark workloads, you could ask the Kyuubi community for the
unread,
Compare the performance test results of MR3-HIVE and APACHE KYUUBI
If Kyuubi can accelerate the execution of Spark workloads, you could ask the Kyuubi community for the
Jan 14
Carol Chapman
, …
Sungwoo Park
19
Jan 9
USING UDTF ON MR3 WITH NPE
If we add UDF to “hive.aux.jars.path”, it will cause a serious problem: The JAR package added by the
unread,
USING UDTF ON MR3 WITH NPE
If we add UDF to “hive.aux.jars.path”, it will cause a serious problem: The JAR package added by the
Jan 9
Ill
,
Sungwoo Park
3
12/15/22
Configuration item hive.default.fileformat does not take effect
Thanks On Thursday, December 15, 2022 at 7:48:58 PM UTC+8 Sungwoo Park wrote: You want to use hive.
unread,
Configuration item hive.default.fileformat does not take effect
Thanks On Thursday, December 15, 2022 at 7:48:58 PM UTC+8 Sungwoo Park wrote: You want to use hive.
12/15/22
Sungwoo Park
,
Ill
3
12/14/22
MR3 1.6
For evaluating Hive-MR3 before deploying it in production, we provide a custom release without a
unread,
MR3 1.6
For evaluating Hive-MR3 before deploying it in production, we provide a custom release without a
12/14/22
Sungwoo Park
, …
Ill
11
12/9/22
Bug in Hive-MR3: tblproperties with "skip.header.line.count" does not work on compressed text files
I have released hivemr3-1.6-SNAPSHOT-hive3.1.3-k8s.tar.gz which is built using the latest source code
unread,
Bug in Hive-MR3: tblproperties with "skip.header.line.count" does not work on compressed text files
I have released hivemr3-1.6-SNAPSHOT-hive3.1.3-k8s.tar.gz which is built using the latest source code
12/9/22
David Engel
,
Sungwoo Park
6
11/19/22
Python transform causing worker disk to fill up
From your log, worker Pods executing tasks of Reducer 2 fail and get deleted. We see usual symptoms
unread,
Python transform causing worker disk to fill up
From your log, worker Pods executing tasks of Reducer 2 fail and get deleted. We see usual symptoms
11/19/22
David Engel
,
Sungwoo Park
21
11/17/22
ORC File Concatenation
On Wed, Nov 16, 2022 at 10:53:23AM +0900, Sungwoo Park wrote: > > > > The S3 support is a
unread,
ORC File Concatenation
On Wed, Nov 16, 2022 at 10:53:23AM +0900, Sungwoo Park wrote: > > > > The S3 support is a
11/17/22
Carol Chapman
,
Sungwoo Park
18
11/2/22
HIVE MR3 can not use JdbcStorageHandler
Hi. I compared the codes of JdbcStorageHandler between HIVE ON MR3 and APACHE HIVE There is no
unread,
HIVE MR3 can not use JdbcStorageHandler
Hi. I compared the codes of JdbcStorageHandler between HIVE ON MR3 and APACHE HIVE There is no
11/2/22
Carol Chapman
,
Sungwoo Park
15
11/2/22
hive on mr3 map task Initializing slower than apache hive
However, I found that in APACHE HIVE , the default value of 'hive.exec.orc.split.strategy '
unread,
hive on mr3 map task Initializing slower than apache hive
However, I found that in APACHE HIVE , the default value of 'hive.exec.orc.split.strategy '
11/2/22
Carol Chapman
,
Sungwoo Park
2
10/25/22
Problems with MR3 memory setup
Thanks a lot for the analysis. 1. By memory allocated to MR3, do you mean memory allocated to each
unread,
Problems with MR3 memory setup
Thanks a lot for the analysis. 1. By memory allocated to MR3, do you mean memory allocated to each
10/25/22
Carol Chapman
,
Sungwoo Park
8
10/12/22
After the latest version of the program is deployed, MR3 often exits abnormally
OK, I will tracking the issue for a period of time On Wednesday, 12 October 2022 at 13:44:23 UTC+8
unread,
After the latest version of the program is deployed, MR3 often exits abnormally
OK, I will tracking the issue for a period of time On Wednesday, 12 October 2022 at 13:44:23 UTC+8
10/12/22
David Engel
,
Sungwoo Park
4
10/12/22
Missing jar and UDFs
On Wed, Oct 12, 2022 at 11:10:45AM +0900, Sungwoo Park wrote: > 1. For the error (java.io.
unread,
Missing jar and UDFs
On Wed, Oct 12, 2022 at 11:10:45AM +0900, Sungwoo Park wrote: > 1. For the error (java.io.
10/12/22
David Engel
,
Sungwoo Park
26
9/27/22
Help Configuring Hive/Spark Using Typescript
On Wed, Sep 28, 2022 at 12:36:54AM +0900, Sungwoo Park wrote: > > > > > For using
unread,
Help Configuring Hive/Spark Using Typescript
On Wed, Sep 28, 2022 at 12:36:54AM +0900, Sungwoo Park wrote: > > > > > For using
9/27/22
Sungwoo Park
, …
Carol Chapman
16
9/25/22
MR3 1.5
ThankYou! On Monday, 26 September 2022 at 00:22:59 UTC+8 Sungwoo Park wrote:
unread,
MR3 1.5
ThankYou! On Monday, 26 September 2022 at 00:22:59 UTC+8 Sungwoo Park wrote:
9/25/22
Carol Chapman
8/16/22
Upgrade Orc version to above 1.6.3 to support zstd compression algorithm
We hope to use zstd compression algorithm on orc, but Orc only supports zstd compression after
unread,
Upgrade Orc version to above 1.6.3 to support zstd compression algorithm
We hope to use zstd compression algorithm on orc, but Orc only supports zstd compression after
8/16/22
Carol Chapman
,
Sungwoo Park
6
8/2/22
A failed move file operation in Hive may result in data loss
Figuring out what patches to merge is the main problem. Besides, backporting a patch is not always
unread,
A failed move file operation in Hive may result in data loss
Figuring out what patches to merge is the main problem. Besides, backporting a patch is not always
8/2/22
David Engel
,
Sungwoo Park
37
7/29/22
Hive on MR3 on Kubernetes Eval Questions
Thanks. I've got MR3 1.5 running now using a configuration that is about as close to your quick
unread,
Hive on MR3 on Kubernetes Eval Questions
Thanks. I've got MR3 1.5 running now using a configuration that is about as close to your quick
7/29/22
Carol Chapman
,
Sungwoo Park
3
7/27/22
Some problems caused by hive using asynchronous thread pool to delete tables
However, the current situation is that hive will not notify the user if deleting the table fails,
unread,
Some problems caused by hive using asynchronous thread pool to delete tables
However, the current situation is that hive will not notify the user if deleting the table fails,
7/27/22