Groups
Conversations
All groups and messages
Send feedback to Google
Help
Training
Sign in
Groups
MR3
Conversations
Labels
About
MR3
Contact owners and managers
1–30 of 183
This Google Group is about MR3, Hive on MR3, and Spark on MR3.
Mark all as read
Report group
0 selected
Sungwoo Park
3
Aug 3
MR3 1.11 Release
For the performance of Hive 4 on MR3, see this blog article: https://www.datamonad.com/post/2024-08-
unread,
MR3 1.11 Release
For the performance of Hive 4 on MR3, see this blog article: https://www.datamonad.com/post/2024-08-
Aug 3
Sungwoo Park
3
Jul 11
Hive 4.0.0 on MR3
We are quite close to releasing Hive 4 on MR3 1.11, along with the least release of Hive 3.1.3 on MR3
unread,
Hive 4.0.0 on MR3
We are quite close to releasing Hive 4 on MR3 1.11, along with the least release of Hive 3.1.3 on MR3
Jul 11
Joaquim Ceballos Casals
,
Sungwoo Park
2
Jun 1
Critial Error License has expired in MR3 Master
Could you try MR3 1.9 or MR3 1.10 Docker image for now? For MR3 1.10, there were reports of the
unread,
Critial Error License has expired in MR3 Master
Could you try MR3 1.9 or MR3 1.10 Docker image for now? For MR3 1.10, there were reports of the
Jun 1
Sungwoo Park
3
Mar 17
MR3 1.10 Release
Here is a quick summary of performance comparison between MR3 1.9 and MR3 1.10 on the original TPC-DS
unread,
MR3 1.10 Release
Here is a quick summary of performance comparison between MR3 1.9 and MR3 1.10 on the original TPC-DS
Mar 17
David Engel
,
Sungwoo Park
4
Feb 27
Error in ALTER TABLE ... CONCATENATE
1. For the NPE error, we don't have test cases other that q tests included in Hive. If you know
unread,
Error in ALTER TABLE ... CONCATENATE
1. For the NPE error, we don't have test cases other that q tests included in Hive. If you know
Feb 27
Sungwoo Park
Jan 10
Upgrade to MR3 1.9 on Kubernetes,
Hello, If you use MR3 1.7 on Kubernetes, please update mr3-run-k8s scripts and switch to MR3 1.9. The
unread,
Upgrade to MR3 1.9 on Kubernetes,
Hello, If you use MR3 1.7 on Kubernetes, please update mr3-run-k8s scripts and switch to MR3 1.9. The
Jan 10
Sungwoo Park
,
David Engel
3
Jan 9
MR3 1.9
I updated the mr3-run-k8s repo to fix a couple of problems: 1) Java 17 options; 2) running superset
unread,
MR3 1.9
I updated the mr3-run-k8s repo to fix a couple of problems: 1) Java 17 options; 2) running superset
Jan 9
Sungwoo Park
12/23/23
Blog article on performance tuning for BI queries,
Hello, I have published a new blog article 'Performance Tuning for Single-table Queries'. It
unread,
Blog article on performance tuning for BI queries,
Hello, I have published a new blog article 'Performance Tuning for Single-table Queries'. It
12/23/23
Sungwoo Park
12/15/23
Hive-MR3 in HiDataPlus.
Hive-MR3 is now shipped in HiDataPlus. For the latest announcement of HiDataPlus, please see: https:/
unread,
Hive-MR3 in HiDataPlus.
Hive-MR3 is now shipped in HiDataPlus. For the latest announcement of HiDataPlus, please see: https:/
12/15/23
Sungwoo Park
2
12/9/23
MR3 1.8 release
MR3 1.8 has been released. For changes, see the release notes: https://mr3docs.datamonad.com/docs/
unread,
MR3 1.8 release
MR3 1.8 has been released. For changes, see the release notes: https://mr3docs.datamonad.com/docs/
12/9/23
Fiorella Piriz
, …
Sungwoo Park
5
11/22/23
Performance issue with Hive Mr3 on kubernetes (and s3)
Is there a chance that this slow S3 access is due to the use of Avro files? For example, do you see
unread,
Performance issue with Hive Mr3 on kubernetes (and s3)
Is there a chance that this slow S3 access is due to the use of Avro files? For example, do you see
11/22/23
Sungwoo Park
11/15/23
Performance issue and Hive-MR3 with Java 17
Some users reported Hive-MR3 getting slower after running for a while. We reproduced this problem by
unread,
Performance issue and Hive-MR3 with Java 17
Some users reported Hive-MR3 getting slower after running for a while. We reproduced this problem by
11/15/23
Ill
,
Sungwoo Park
2
11/12/23
slow query little case
Thank you for sharing the story. I would like add that with the Tez runtime (in HDP and Hive-MR3),
unread,
slow query little case
Thank you for sharing the story. I would like add that with the Tez runtime (in HDP and Hive-MR3),
11/12/23
Sungwoo Park
11/3/23
MR3 1.8 release candidate
We have uploaded MR3 1.8 release candidate. https://github.com/mr3project/mr3-release/releases/tag/v1
unread,
MR3 1.8 release candidate
We have uploaded MR3 1.8 release candidate. https://github.com/mr3project/mr3-release/releases/tag/v1
11/3/23
Sungwoo Park
10/31/23
Fwd: Hive stuck without workers
For those interested in Hive-MR3-Celeborn (with K8s) I know we had to bump the local storage on the
unread,
Fwd: Hive stuck without workers
For those interested in Hive-MR3-Celeborn (with K8s) I know we had to bump the local storage on the
10/31/23
Sungwoo Park
2
10/25/23
Comparison between Hive-Tez and Hive-MR3
Continuing the comparison between Hive-Tez and Hive-MR3, here is the result of concurrent tests. We
unread,
Comparison between Hive-Tez and Hive-MR3
Continuing the comparison between Hive-Tez and Hive-MR3, here is the result of concurrent tests. We
10/25/23
Sungwoo Park
10/24/23
Hive-MR3 with Celeborn,
Before the impending release of MR3 1.8, we would like to announce the release of Hive-MR3 with
unread,
Hive-MR3 with Celeborn,
Before the impending release of MR3 1.8, we would like to announce the release of Hive-MR3 with
10/24/23
David Engel
,
Sungwoo Park
6
10/19/23
Apache Ozone
Okay. I'll try to put together a list of things we've had to customize or do differnently. I
unread,
Apache Ozone
Okay. I'll try to put together a list of things we've had to customize or do differnently. I
10/19/23
Carol Chapman
,
Sungwoo Park
6
8/25/23
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
This will be fixed in MR3 1.8. --- Sungwoo On Wednesday, October 12, 2022 at 1:24:06 AM UTC+9
unread,
HIVE ON MR3 cannot execute statements repeatedly with EsStorageHandler
This will be fixed in MR3 1.8. --- Sungwoo On Wednesday, October 12, 2022 at 1:24:06 AM UTC+9
8/25/23
Sungwoo Park
,
Ill
3
6/5/23
MR3 Slack channel,
I think it's better to add slack entry on the home page of MR3. Sungwoo Park <glapark@gmail.
unread,
MR3 Slack channel,
I think it's better to add slack entry on the home page of MR3. Sungwoo Park <glapark@gmail.
6/5/23
Sungwoo Park
5/31/23
Performance Evaluation of Trino, Spark, and Hive on MR3
With the release of MR3 1.7, I published a blog article where we compare Trino, Spark, and Hive on
unread,
Performance Evaluation of Trino, Spark, and Hive on MR3
With the release of MR3 1.7, I published a blog article where we compare Trino, Spark, and Hive on
5/31/23
Sungwoo Park
5/29/23
hive.auto.convert.join.noconditionaltask.size and tez.runtime.pipelined.sorter.lazy-allocate.memory in MR3 1.7
In MR3 1.7, we have changed the values for hive.auto.convert.join.noconditionaltask.size and tez.
unread,
hive.auto.convert.join.noconditionaltask.size and tez.runtime.pipelined.sorter.lazy-allocate.memory in MR3 1.7
In MR3 1.7, we have changed the values for hive.auto.convert.join.noconditionaltask.size and tez.
5/29/23
Sungwoo Park
,
Ill
5
5/29/23
MR3 1.7
MR3 1.7 has been released. I have updated the binary releases at Github and the Docker image at
unread,
MR3 1.7
MR3 1.7 has been released. I have updated the binary releases at Github and the Docker image at
5/29/23
Ill
,
Sungwoo Park
2
5/2/23
MR3 can fail to request resources under high load
Alright, sounds good. I suspect it is a problem with Hadoop, however, because the logic for
unread,
MR3 can fail to request resources under high load
Alright, sounds good. I suspect it is a problem with Hadoop, however, because the logic for
5/2/23
Ill
,
Sungwoo Park
2
5/2/23
Does MR3 support specifying job priority for YARN?
No. Currently MR3 can specify only a job queue (with the config key mr3.queue.name). It's easy to
unread,
Does MR3 support specifying job priority for YARN?
No. Currently MR3 can specify only a job queue (with the config key mr3.queue.name). It's easy to
5/2/23
Sungwoo Park
,
Ill
3
5/2/23
tez.runtime.compress and tez.runtime.compress.codec
On Hadoop, Java command is controlled by Hadoop, so running MR3 with its own Java 11 environments is
unread,
tez.runtime.compress and tez.runtime.compress.codec
On Hadoop, Java command is controlled by Hadoop, so running MR3 with its own Java 11 environments is
5/2/23
Subhasmita Swain
,
Sungwoo Park
3
4/5/23
hivemr3-metastore & hivemr3-hiveserver2 is crashlooping and mr3master pod not turning up
If you should use a different MySQL connector, please check out this page and the link to
unread,
hivemr3-metastore & hivemr3-hiveserver2 is crashlooping and mr3master pod not turning up
If you should use a different MySQL connector, please check out this page and the link to
4/5/23
Ill
,
Sungwoo Park
2
3/6/23
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
unread,
MR3 has some performance issues
Hello, Perhaps Spark 3.3.2 is faster than Hive 3 on your query. I think this is an issue with
3/6/23
Sungwoo Park
2/20/23
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
unread,
Quick start guide - expanded
Quick start guide for running Hive on MR3 on Kubernetes has been expanded. https://mr3docs.datamonad.
2/20/23
Sungwoo Park
, …
Ill
8
1/31/23
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
unread,
Hive 4 and Iceberg
Great On Tuesday, January 31, 2023 at 10:14:59 AM UTC+8 da...@istwok.net wrote: Thanks for the
1/31/23