Hi everyone,
We are happy to announce the general availability of CDAP platform version 6.11.0. This release includes new features, enhancements, bug fixes, security fixes and deprecation. Here are a few highlights:
When a pipeline run fails, you can now retrieve detailed error information in the UI.
Improved scalability and availability of App Fabric service by splitting it into stateless App Fabric server and stateful App Fabric processor.
Added support for using Cloud Spanner as metadata storage.
Added support for using Cloud Spanner as message storage provider, to improve scalability and availability of message processing in CDAP services.
The maximum concurrent runs limit for triggers is displayed in the console.
Hadoop version for CDAP has been upgraded to 3.3.6.
The ProgramHeartbeatTable now gets cleaned up periodically.
Added support for destination table write preference in the BigQuery Execute plugin.
Dataproc 2.2 is the default version starting 6.11.0 for when dataproc provisioner is used.
Fixed a null pointer exception in the BigQuery multi-sink plugin when used without a reference name.
Fixed Joiner plugin failures observed on Dataproc 2.2 instances.
Fixed an issue that prevented pipelines from accepting empty input in Amazon S3 and Google Cloud Storage batch source plugins.
Fixed an issue in CDAP instances where internal authentication is enabled and pipeline details API returned an incorrect author name.
The ability to list applications without providing pageSize is deprecated in 6.11.0.
For more information:
Check out our CDAP OSS site for more details and downloads: https://cdap.io/
Release artifacts are available at https://github.com/cdapio/cdap/releases/tag/v6.11.0
Release notes are available at https://cdap.atlassian.net/wiki/spaces/DOCS/pages/2549284865/CDAP+Release+6.11.0
Maven artifacts can be found on Maven Central https://search.maven.org/search?q=cdap
CDAP documentation is available at https://cdap.atlassian.net/wiki/spaces/DOCS/overview