MR3 1.6

[Sungwoo Park]

A release candidate of Hive 3 on MR3 1.6 is available now:

https://github.com/mr3project/mr3-release/releases/tag/v1.6

See the release notes for news patches backported to Hive 3 and the license:

https://mr3docs.datamonad.com/docs/release/

https://mr3docs.datamonad.com/docs/license/

Cheers,

--- Sungwoo

[Ill]

Hi.

i found MR3 release has a limit of 256 gigabytes on the aggregate memory of ContainerWorkers on Kubernetes and a limit of 512 gigabytes on Hadoop.

Can this limit be increased to 1TB?

In a production environment, we often need to use more than 10 terabytes of resources. I believe this is a common scenario for most companies that use Apache Hive. If the upper memory limit of MR3 is too low, it may not meet our pressure test conditions. If users want to stress test and compare the performance of MR3 on large datasets, they usually need 1TB of memory.

On the other hand, 1TB of memory is not large enough to affect the commercial license charges of MR3.

So, dear developer team, what do you think of this proposal?

Look forward to your reply.

[Sungwoo Park]

For evaluating Hive-MR3 before deploying it in production, we provide a custom release without a limit on worker resources. So, please contact us and let us know your resource requirement for evaluating Hive-MR3. For quickly testing Hive-MR3, you could use the MR3 release.

Cheers,

--- Sungwoo

 

--
You received this message because you are subscribed to the Google Groups "MR3" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hive-mr3+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hive-mr3/c80f0bde-9a36-4b10-9b39-ff15f2ca9efan%40googlegroups.com.