[ANNOUNCE] CDAP 6.11.0 Release

15 views
Skip to first unread message

Aakash Nayak

unread,
Mar 24, 2025, 3:23:38 AMMar 24
to cdap...@googlegroups.com

Hi everyone,


We are happy to announce the general availability of CDAP platform version 6.11.0. This release includes new features, enhancements, bug fixes, security fixes and deprecation. Here are a few highlights:


  • When a pipeline run fails, you can now retrieve detailed error information in the UI. 

  • Improved scalability and availability of App Fabric service by splitting it into stateless App Fabric server and stateful App Fabric processor. 

  • Added support for using Cloud Spanner as metadata storage.

  • Added support for using Cloud Spanner as message storage provider, to improve scalability and availability of message processing in CDAP services.

  • The maximum concurrent runs limit for triggers is displayed in the console.

  • Hadoop version for CDAP has been upgraded to 3.3.6.

  • The ProgramHeartbeatTable now gets cleaned up periodically.

  • Added support for destination table write preference in the BigQuery Execute plugin.

  • Dataproc 2.2 is the default version starting 6.11.0 for when dataproc provisioner is used.

  • Fixed a null pointer exception in the BigQuery multi-sink plugin when used without a reference name.

  • Fixed Joiner plugin failures observed on Dataproc 2.2 instances.

  • Fixed an issue that prevented pipelines from accepting empty input in Amazon S3 and Google Cloud Storage batch source plugins.

  • Fixed an issue in CDAP instances where internal authentication is enabled and pipeline details API returned an incorrect author name.

  • The ability to list applications without providing pageSize is deprecated in 6.11.0.


For more information:


Thanks,
Aakash
Reply all
Reply to author
Forward
0 new messages