Groups
Conversations
All groups and messages
Send feedback to Google
Help
Sign in
Groups
MR3
Conversations
Labels
About
MR3
1–30 of 137
This Google Group is about MR3, Hive on MR3, and Hive on Kubernetes.
--- Sungwoo Park
Mark all as read
Report abusive group
0 selected
David Engel
,
Sungwoo Park
7
Jul 1
Hive on MR3 on Kubernetes Eval Questions
1. Could you share the logs of HiveServer2 and Metastore when you execute 'show databases'?
unread,
Hive on MR3 on Kubernetes Eval Questions
1. Could you share the logs of HiveServer2 and Metastore when you execute 'show databases'?
Jul 1
Sungwoo Park
,
xiang chen
5
Jun 6
MR3 App demo
It has been replaced with MR3 Cloud, which is a web interface for running Hive on public clouds as
unread,
MR3 App demo
It has been replaced with MR3 Cloud, which is a web interface for running Hive on public clouds as
Jun 6
Carol Chapman
,
Sungwoo Park
17
May 17
HIVE MR3 can not use JdbcStorageHandler
Alright, we will try to update JDBC storage handler in Hive-MR3. You are welcome to submit PRs to the
unread,
HIVE MR3 can not use JdbcStorageHandler
Alright, we will try to update JDBC storage handler in Hive-MR3. You are welcome to submit PRs to the
May 17
Carol Chapman
,
Sungwoo Park
4
May 4
Hive on mr3 on yarn always use the minimum value of resources configured with yarn queue
Could you try Hive-MR3 with autoscaling enabled? With autoscaling, MR3 assume infinite resources on
unread,
Hive on mr3 on yarn always use the minimum value of resources configured with yarn queue
Could you try Hive-MR3 with autoscaling enabled? With autoscaling, MR3 assume infinite resources on
May 4
Sungwoo Park
,
Carol Chapman
2
Apr 8
Performance Evaluation of Spark 2.3.8, Spark 3.2.1, Hive-LLAP, and Hive on MR3
great. On Sunday, 3 April 2022 at 16:40:52 UTC+8 Sungwoo Park wrote: A new blog article is available:
unread,
Performance Evaluation of Spark 2.3.8, Spark 3.2.1, Hive-LLAP, and Hive on MR3
great. On Sunday, 3 April 2022 at 16:40:52 UTC+8 Sungwoo Park wrote: A new blog article is available:
Apr 8
Carol Chapman
,
Sungwoo Park
3
Feb 22
Enhanced support for apache spark
We are planning to use SPARK ON MR3, Because we want to use the features of mr3 to optimize resource
unread,
Enhanced support for apache spark
We are planning to use SPARK ON MR3, Because we want to use the features of mr3 to optimize resource
Feb 22
Sungwoo Park
,
Carol Chapman
3
Feb 17
MR3 1.4 and MR3 App
I have a small question. Why can't the FAQs page be found on the homepage of datamonad? Do you
unread,
MR3 1.4 and MR3 App
I have a small question. Why can't the FAQs page be found on the homepage of datamonad? Do you
Feb 17
Carol Chapman
,
Sungwoo Park
4
Feb 17
hive on mr3 map task Initializing slower than apache hive
I found that when there are a large number of small files in HDFS, the initialization speed of mr3 is
unread,
hive on mr3 map task Initializing slower than apache hive
I found that when there are a large number of small files in HDFS, the initialization speed of mr3 is
Feb 17
Carol Chapman
,
Sungwoo Park
3
Feb 17
Enhanced support for iceberg
That sounds great! I'm looking forward to it. On Thursday, 17 February 2022 at 15:01:39 UTC+8
unread,
Enhanced support for iceberg
That sounds great! I'm looking forward to it. On Thursday, 17 February 2022 at 15:01:39 UTC+8
Feb 17
Carol Chapman
,
Sungwoo Park
6
Jan 28
MR3ApplicationMaster can not allocated container
Through experiments, I have determined that the reason why am cannot allocate resources is : Can mr3
unread,
MR3ApplicationMaster can not allocated container
Through experiments, I have determined that the reason why am cannot allocate resources is : Can mr3
Jan 28
Carol Chapman
,
Sungwoo Park
7
Jan 19
Can mr3 support yarn label scheduling?
Thanks! On Tuesday, 18 January 2022 at 23:52:48 UTC+8 Sungwoo Park wrote: I uploaded a pre-release of
unread,
Can mr3 support yarn label scheduling?
Thanks! On Tuesday, 18 January 2022 at 23:52:48 UTC+8 Sungwoo Park wrote: I uploaded a pre-release of
Jan 19
Carol Chapman
,
Sungwoo Park
5
Jan 18
MR3 Using Prometheus
Thank you! On Friday, 14 January 2022 at 18:04:18 UTC+8 Sungwoo Park wrote: Attached is mr3.json
unread,
MR3 Using Prometheus
Thank you! On Friday, 14 January 2022 at 18:04:18 UTC+8 Sungwoo Park wrote: Attached is mr3.json
Jan 18
Carol Chapman
,
Sungwoo Park
2
Jan 11
The configurations tez.grouping.max-size and tez.grouping.min-size are not effective
Hello, Hive-MR3 reads tez-site.xml, but it does not create tez-conf.pb because all configuration
unread,
The configurations tez.grouping.max-size and tez.grouping.min-size are not effective
Hello, Hive-MR3 reads tez-site.xml, but it does not create tez-conf.pb because all configuration
Jan 11
xiang chen
,
Sungwoo Park
2
12/20/21
Hive3 log4j2 version
Currently there is a problem with upgrading Log4j 2 to 2.15.0, so you could use a quickfix by adding
unread,
Hive3 log4j2 version
Currently there is a problem with upgrading Log4j 2 to 2.15.0, so you could use a quickfix by adding
12/20/21
Carol Chapman
,
Sungwoo Park
5
12/15/21
Getting Tez LimitExceededException after dag execution on large query
Limits.setConfiguration() is called in MR3 DAGAppMaster (and MR3 ContainerWorker), so it is not the
unread,
Getting Tez LimitExceededException after dag execution on large query
Limits.setConfiguration() is called in MR3 DAGAppMaster (and MR3 ContainerWorker), so it is not the
12/15/21
xiang chen
,
Sungwoo Park
3
11/7/21
Hive 3.1.2 metastore client can not connect to MR3 1.3
Actually there is no official release of Hive 3.1.3, and there is no additional Hive dependencies.
unread,
Hive 3.1.2 metastore client can not connect to MR3 1.3
Actually there is no official release of Hive 3.1.3, and there is no additional Hive dependencies.
11/7/21
Sungwoo Park
11/3/21
MR3 1.3 hotfix released
We have found that Hive 3 on MR3 1.3 shows abnormal behavior caused by two Hive patches (HIVE-20703
unread,
MR3 1.3 hotfix released
We have found that Hive 3 on MR3 1.3 shows abnormal behavior caused by two Hive patches (HIVE-20703
11/3/21
pk.4...@gmail.com
,
Sungwoo Park
9
9/21/21
DiskErrorException: Could not find any valid local directory for dag
Hi Sungwoo, Thank you. That was the issue. MR3 doc : https://mr3docs.datamonad.com/docs/k8s/advanced/
unread,
DiskErrorException: Could not find any valid local directory for dag
Hi Sungwoo, Thank you. That was the issue. MR3 doc : https://mr3docs.datamonad.com/docs/k8s/advanced/
9/21/21
Sungwoo Park
8/18/21
MR3 1.3 released
We are pleased to announce the release of MR3 1.3. Highlights in this release are: 1) MR3 On both
unread,
MR3 1.3 released
We are pleased to announce the release of MR3 1.3. Highlights in this release are: 1) MR3 On both
8/18/21
Sungwoo Park
8/12/21
Preview of MR3 1.3
MR3 1.3 will be released soon, and for those who want to try Hive 3 on MR3 1.3 on Kubernetes, we have
unread,
Preview of MR3 1.3
MR3 1.3 will be released soon, and for those who want to try Hive 3 on MR3 1.3 on Kubernetes, we have
8/12/21
Bartek Siudeja
,
Sungwoo Park
9
8/12/21
create external s3 table
This issue has been fixed in MR3 1.3. It turns out that the fix shown above is a complete solution (
unread,
create external s3 table
This issue has been fixed in MR3 1.3. It turns out that the fix shown above is a complete solution (
8/12/21
kouts shukla
,
Sungwoo Park
2
6/3/21
mr3worker-abd2-3 is in pending state for a long
In the current implementation of MR3, you cannot specify node affinity rules for master and worker
unread,
mr3worker-abd2-3 is in pending state for a long
In the current implementation of MR3, you cannot specify node affinity rules for master and worker
6/3/21
Sungwoo Park
,
xiang chen
3
3/25/21
MR3 1.3 SNAPSHOT
You can use the new Docker image (mr3project/hive3:1.3) without changing anything in your scripts. Or
unread,
MR3 1.3 SNAPSHOT
You can use the new Docker image (mr3project/hive3:1.3) without changing anything in your scripts. Or
3/25/21
xiang chen
,
Sungwoo Park
7
3/11/21
MR3-UI shows wrong time
By the way, my email is cdmikechen@hotmail.com . If you can provide the working version, you can send
unread,
MR3-UI shows wrong time
By the way, my email is cdmikechen@hotmail.com . If you can provide the working version, you can send
3/11/21
Shafi Rasulov
,
Sungwoo Park
3
1/28/21
Initial worker pods
In MR3 1.3, we will introduce `mr3.auto.scale.out.num.initial.containers` which specifies the number
unread,
Initial worker pods
In MR3 1.3, we will introduce `mr3.auto.scale.out.num.initial.containers` which specifies the number
1/28/21
weiji...@gmail.com
,
Sungwoo Park
5
1/28/21
I want to use all the k8 resource
Actually, from MR3 1.3 (to be released next month), there will be no limit in the aggregate memory of
unread,
I want to use all the k8 resource
Actually, from MR3 1.3 (to be released next month), there will be no limit in the aggregate memory of
1/28/21
pk.4...@gmail.com
,
Sungwoo Park
42
1/20/21
Transportation mode : binary and http mode
Thank you, Sungwoo. The issue was with the security group for LB. Added port 443 to the allowed list
unread,
Transportation mode : binary and http mode
Thank you, Sungwoo. The issue was with the security group for LB. Added port 443 to the allowed list
1/20/21
weiji...@gmail.com
,
Sungwoo Park
2
12/20/20
I can run where k8s cluster only on node
This is probably because the label node-role.kubernetes.io/master is attached to the node. From https
unread,
I can run where k8s cluster only on node
This is probably because the label node-role.kubernetes.io/master is attached to the node. From https
12/20/20
weiji...@gmail.com
,
Sungwoo Park
2
12/8/20
Java Heap space
MR3 does its best to avoid OOM in PipelinedSorter and reduce delays in (by trying to reuse existing
unread,
Java Heap space
MR3 does its best to avoid OOM in PipelinedSorter and reduce delays in (by trying to reuse existing
12/8/20
ranaivoson...@gmail.com
,
Sungwoo Park
2
12/2/20
Hiveserver2 turns off after queries
Hi, This error says that another process is using the port for Web UI. 2020-12-02T10:53:00336 ERROR [
unread,
Hiveserver2 turns off after queries
Hi, This error says that another process is using the port for Web UI. 2020-12-02T10:53:00336 ERROR [
12/2/20