Groups
Conversations
All groups and messages
Send feedback to Google
Help
Sign in
Groups
MR3
Conversations
Labels
About
MR3
1–30 of 157
This Google Group is about MR3, Hive on MR3, and Spark on MR3.
Mark all as read
Report abusive group
0 selected
Ill
,
Sungwoo Park
2
Mar 6
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
unread,
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
Mar 6
Sungwoo Park
Feb 20
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
unread,
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
Feb 20
Sungwoo Park
, …
Ill
8
Jan 31
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
unread,
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
Jan 31
Ill
,
Sungwoo Park
2
Jan 14
Compare the performance test results of MR3-HIVE and APACHE KYUUBI
If Kyuubi can accelerate the execution of Spark workloads, you could ask the Kyuubi community for the
unread,
Compare the performance test results of MR3-HIVE and APACHE KYUUBI
If Kyuubi can accelerate the execution of Spark workloads, you could ask the Kyuubi community for the
Jan 14
Carol Chapman
, …
Sungwoo Park
19
Jan 9
USING UDTF ON MR3 WITH NPE
If we add UDF to “hive.aux.jars.path”, it will cause a serious problem: The JAR package added by the
unread,
USING UDTF ON MR3 WITH NPE
If we add UDF to “hive.aux.jars.path”, it will cause a serious problem: The JAR package added by the
Jan 9
Ill
,
Sungwoo Park
3
12/15/22
Configuration item hive.default.fileformat does not take effect
Thanks On Thursday, December 15, 2022 at 7:48:58 PM UTC+8 Sungwoo Park wrote: You want to use hive.
unread,
Configuration item hive.default.fileformat does not take effect
Thanks On Thursday, December 15, 2022 at 7:48:58 PM UTC+8 Sungwoo Park wrote: You want to use hive.
12/15/22
Sungwoo Park
,
Ill
3
12/14/22
MR3 1.6
For evaluating Hive-MR3 before deploying it in production, we provide a custom release without a
unread,
MR3 1.6
For evaluating Hive-MR3 before deploying it in production, we provide a custom release without a
12/14/22
Sungwoo Park
, …
Ill
11
12/9/22
Bug in Hive-MR3: tblproperties with "skip.header.line.count" does not work on compressed text files
I have released hivemr3-1.6-SNAPSHOT-hive3.1.3-k8s.tar.gz which is built using the latest source code
unread,
Bug in Hive-MR3: tblproperties with "skip.header.line.count" does not work on compressed text files
I have released hivemr3-1.6-SNAPSHOT-hive3.1.3-k8s.tar.gz which is built using the latest source code
12/9/22
David Engel
,
Sungwoo Park
6
11/19/22
Python transform causing worker disk to fill up
From your log, worker Pods executing tasks of Reducer 2 fail and get deleted. We see usual symptoms
unread,
Python transform causing worker disk to fill up
From your log, worker Pods executing tasks of Reducer 2 fail and get deleted. We see usual symptoms
11/19/22
David Engel
,
Sungwoo Park
21
11/17/22
ORC File Concatenation
On Wed, Nov 16, 2022 at 10:53:23AM +0900, Sungwoo Park wrote: > > > > The S3 support is a
unread,
ORC File Concatenation
On Wed, Nov 16, 2022 at 10:53:23AM +0900, Sungwoo Park wrote: > > > > The S3 support is a
11/17/22
Carol Chapman
,
Sungwoo Park
18
11/2/22
HIVE MR3 can not use JdbcStorageHandler
Hi. I compared the codes of JdbcStorageHandler between HIVE ON MR3 and APACHE HIVE There is no
unread,
HIVE MR3 can not use JdbcStorageHandler
Hi. I compared the codes of JdbcStorageHandler between HIVE ON MR3 and APACHE HIVE There is no
11/2/22
Carol Chapman
,
Sungwoo Park
15
11/2/22
hive on mr3 map task Initializing slower than apache hive
However, I found that in APACHE HIVE , the default value of 'hive.exec.orc.split.strategy '
unread,
hive on mr3 map task Initializing slower than apache hive
However, I found that in APACHE HIVE , the default value of 'hive.exec.orc.split.strategy '
11/2/22
Carol Chapman
,
Sungwoo Park
2
10/25/22
Problems with MR3 memory setup
Thanks a lot for the analysis. 1. By memory allocated to MR3, do you mean memory allocated to each
unread,
Problems with MR3 memory setup
Thanks a lot for the analysis. 1. By memory allocated to MR3, do you mean memory allocated to each
10/25/22
Carol Chapman
,
Sungwoo Park
8
10/12/22
After the latest version of the program is deployed, MR3 often exits abnormally
OK, I will tracking the issue for a period of time On Wednesday, 12 October 2022 at 13:44:23 UTC+8
unread,
After the latest version of the program is deployed, MR3 often exits abnormally
OK, I will tracking the issue for a period of time On Wednesday, 12 October 2022 at 13:44:23 UTC+8
10/12/22
David Engel
,
Sungwoo Park
4
10/12/22
Missing jar and UDFs
On Wed, Oct 12, 2022 at 11:10:45AM +0900, Sungwoo Park wrote: > 1. For the error (java.io.
unread,
Missing jar and UDFs
On Wed, Oct 12, 2022 at 11:10:45AM +0900, Sungwoo Park wrote: > 1. For the error (java.io.
10/12/22
Carol Chapman
,
Sungwoo Park
5
10/11/22
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
Ok,i try. On Tuesday, 11 October 2022 at 22:55:58 UTC+8 Sungwoo Park wrote: Another suggestion I
unread,
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
Ok,i try. On Tuesday, 11 October 2022 at 22:55:58 UTC+8 Sungwoo Park wrote: Another suggestion I
10/11/22
David Engel
,
Sungwoo Park
26
9/27/22
Help Configuring Hive/Spark Using Typescript
On Wed, Sep 28, 2022 at 12:36:54AM +0900, Sungwoo Park wrote: > > > > > For using
unread,
Help Configuring Hive/Spark Using Typescript
On Wed, Sep 28, 2022 at 12:36:54AM +0900, Sungwoo Park wrote: > > > > > For using
9/27/22
Sungwoo Park
, …
Carol Chapman
16
9/25/22
MR3 1.5
ThankYou! On Monday, 26 September 2022 at 00:22:59 UTC+8 Sungwoo Park wrote:
unread,
MR3 1.5
ThankYou! On Monday, 26 September 2022 at 00:22:59 UTC+8 Sungwoo Park wrote:
9/25/22
Carol Chapman
8/16/22
Upgrade Orc version to above 1.6.3 to support zstd compression algorithm
We hope to use zstd compression algorithm on orc, but Orc only supports zstd compression after
unread,
Upgrade Orc version to above 1.6.3 to support zstd compression algorithm
We hope to use zstd compression algorithm on orc, but Orc only supports zstd compression after
8/16/22
Carol Chapman
,
Sungwoo Park
6
8/2/22
A failed move file operation in Hive may result in data loss
Figuring out what patches to merge is the main problem. Besides, backporting a patch is not always
unread,
A failed move file operation in Hive may result in data loss
Figuring out what patches to merge is the main problem. Besides, backporting a patch is not always
8/2/22
David Engel
,
Sungwoo Park
37
7/29/22
Hive on MR3 on Kubernetes Eval Questions
Thanks. I've got MR3 1.5 running now using a configuration that is about as close to your quick
unread,
Hive on MR3 on Kubernetes Eval Questions
Thanks. I've got MR3 1.5 running now using a configuration that is about as close to your quick
7/29/22
Carol Chapman
,
Sungwoo Park
3
7/27/22
Some problems caused by hive using asynchronous thread pool to delete tables
However, the current situation is that hive will not notify the user if deleting the table fails,
unread,
Some problems caused by hive using asynchronous thread pool to delete tables
However, the current situation is that hive will not notify the user if deleting the table fails,
7/27/22
Carol Chapman
,
Sungwoo Park
6
7/27/22
Hive always loses some permissions created in Ranger
Okay, I'll first solve the error I encountered in my startup, and then observe it for a period of
unread,
Hive always loses some permissions created in Ranger
Okay, I'll first solve the error I encountered in my startup, and then observe it for a period of
7/27/22
Sungwoo Park
,
xiang chen
5
6/6/22
MR3 App demo
It has been replaced with MR3 Cloud, which is a web interface for running Hive on public clouds as
unread,
MR3 App demo
It has been replaced with MR3 Cloud, which is a web interface for running Hive on public clouds as
6/6/22
Carol Chapman
,
Sungwoo Park
4
5/4/22
Hive on mr3 on yarn always use the minimum value of resources configured with yarn queue
Could you try Hive-MR3 with autoscaling enabled? With autoscaling, MR3 assume infinite resources on
unread,
Hive on mr3 on yarn always use the minimum value of resources configured with yarn queue
Could you try Hive-MR3 with autoscaling enabled? With autoscaling, MR3 assume infinite resources on
5/4/22
Sungwoo Park
,
Carol Chapman
2
4/8/22
Performance Evaluation of Spark 2.3.8, Spark 3.2.1, Hive-LLAP, and Hive on MR3
great. On Sunday, 3 April 2022 at 16:40:52 UTC+8 Sungwoo Park wrote: A new blog article is available:
unread,
Performance Evaluation of Spark 2.3.8, Spark 3.2.1, Hive-LLAP, and Hive on MR3
great. On Sunday, 3 April 2022 at 16:40:52 UTC+8 Sungwoo Park wrote: A new blog article is available:
4/8/22
Carol Chapman
,
Sungwoo Park
3
2/22/22
Enhanced support for apache spark
We are planning to use SPARK ON MR3, Because we want to use the features of mr3 to optimize resource
unread,
Enhanced support for apache spark
We are planning to use SPARK ON MR3, Because we want to use the features of mr3 to optimize resource
2/22/22
Sungwoo Park
,
Carol Chapman
3
2/17/22
MR3 1.4 and MR3 App
I have a small question. Why can't the FAQs page be found on the homepage of datamonad? Do you
unread,
MR3 1.4 and MR3 App
I have a small question. Why can't the FAQs page be found on the homepage of datamonad? Do you
2/17/22
Carol Chapman
,
Sungwoo Park
3
2/17/22
Enhanced support for iceberg
That sounds great! I'm looking forward to it. On Thursday, 17 February 2022 at 15:01:39 UTC+8
unread,
Enhanced support for iceberg
That sounds great! I'm looking forward to it. On Thursday, 17 February 2022 at 15:01:39 UTC+8
2/17/22
Carol Chapman
,
Sungwoo Park
6
1/28/22
MR3ApplicationMaster can not allocated container
Through experiments, I have determined that the reason why am cannot allocate resources is : Can mr3
unread,
MR3ApplicationMaster can not allocated container
Through experiments, I have determined that the reason why am cannot allocate resources is : Can mr3
1/28/22