Delta Lake 3.1.0 Announcement

[Venki Korukanti]

Hi everyone,

We are happy to announce the release of Delta Lake 3.1.0.

• Delta-Spark: Support for merge with deletion vectors to reduce the write overhead for merge operations. This feature improves the performance of merge by several folds.

• Delta-Spark: Support for optimizing min/max aggregation queries using the table metadata which improves the performance of simple aggregations queries (e.g SELECT min(x) FROM deltaTable) by up to 100x.

• Delta-Spark: Support for querying tables shared through Delta Sharing protocol.

• Kernel: Support for data skipping for given query predicates to reduce the number of files read during the table scan.

• Uniform: Enhanced Iceberg support for Delta tables that enables MAP and LIST types and ease of use improvements to enable Uniform on a Delta table.

• Delta-Flink: Flink write job startup time latency improvement using Kernel.

Please refer to the release notes for a complete list of fixes and improvements.

Thanks

Venki