[ANNOUNCE] CDAP 6.11.1 Release
Priyanshu Bhardwaj
Hi everyone,
We are happy to announce the general availability of CDAP platform version 6.11.1. This release includes new features, enhancements, bug fixes, security fixes and deprecation. Here are a few highlights:
Added support for HTTP access tokens (Bearer authentication) in Bitbucket Server for source control management.
A new API is available to retrieve the application count for each namespace.
To create ephemeral Dataproc clusters, CDAP uses the Dataproc 2.3 image by default.
The pipeline JSON size limit for creating new pipelines and importing pipelines as JSON is increased to 5MB (previously 2MB).
On the Pipeline details page, the inbound triggers sidebar features a paginated list of pipelines where you can select the pipelines you want to add to the trigger. Additionally, a refresh button is added to update the existing list of triggers and pipelines.
Optimized the storage of application specification (ApplicationSpecification) by eliminating redundant plugin data from the database for spanner storage provider.
Added support for startupProbe in Router for CDAP deployed on k8s.
Added support for startupProbe in user interface container for CDAP deployed on k8s
To prevent storage issues on static Dataproc clusters, temporary pipeline data is automatically deleted after a successful run.
Fixed an issue that prevented Expression Language (EL) from being used within user-defined directives.
Fixed an issue where a pipeline would fail when reading an encrypted file from Cloud Storage using Tink.
A previous issue with Database sink plugins has been fixed, where data mismatch would leave behind records from a Spark task. We've now implemented a rollback to prevent this.
When Source Bucket does not exist for GCS, instead of failing the pipeline with NPE, a proper error message gets displayed now.
Dataproc 2.1 is no longer supported in CDAP version 6.11.1 and later
For more information:
Check out our CDAP OSS site for more details and downloads: https://cdap.io/
Release artifacts are available at https://github.com/cdapio/cdap/releases/tag/v6.11.1
Release notes are available at https://cdap.atlassian.net/wiki/spaces/DOCS/pages/2776662017/CDAP+Release+6.11.1
Maven artifacts can be found on Maven Central https://search.maven.org/search?q=cdap
CDAP documentation is available at https://cdap.atlassian.net/wiki/spaces/DOCS/overview