Emr-6.10.0

1 view

Skip to first unread message

Dominik Ransom

unread,

Aug 3, 2024, 3:28:38 PM8/3/24

to locabulco

Configuration classifications allow you to customize applications. These often correspond to a configuration XML file for the application, such as spark-hive-site.xml. For more information, see Configure Applications.

Spark operator - With Amazon EMR on EKS 6.10.0 and higher, you can use the Kubernetes operator for Apache Spark, or the Spark operator, to deploy and manage Spark applications with the Amazon EMR release runtime on your own Amazon EKS clusters. For more information, see Running Spark jobs with the Spark operator.

Java 11 - With Amazon EMR on EKS 6.10 and higher, you can launch Spark with Java 11 runtime. To do this, pass emr-6.10.0-java11-latest as a release label. We recommend that you validate and run performance tests before you move your production workloads from the Java 8 image to the Java 11 image.

For the Amazon Redshift integration for Apache Spark, Amazon EMR on EKS 6.10.0 removes the dependency on minimal-json.jar, and automatically adds the required spark-redshift related jars to the executor class path for Spark: spark-redshift.jar, spark-avro.jar, and RedshiftJDBC.jar.