[ANNOUNCE] CDAP 6.9.2 Release

27 views
Skip to first unread message

Dennis Li

unread,
Sep 2, 2023, 11:11:03 AM9/2/23
to cdap...@googlegroups.com
Hi everyone,

We are happy to announce the general availability of CDAP platform version 6.9.2. This release includes improvements and bug fixes. Here are a few highlights:

    • Added support for setting custom scopes when creating a Dataproc cluster.

    • Added support for setting labels for the Dataproc jobs using the Common Labels property in the Ephemeral and Existing Dataproc compute profiles. Additionally, added support for setting a pipeline runtime argument with the key system.profile.properties.labels and a value representing the labels in the following format: key1|value1;key2|value2. This setting overrides the common labels set in the compute profile for pipeline runs
    • Added support for using Dataproc temp buckets in compute profiles.
    • Added retry for Pub/Sub snapshot creation and deletion in real-time pipeline with a Pub/Sub source when a retryable internal error is thrown.

    • Fixed a bug causing the Dynamic Spark plugins to fail when running on Dataproc 1.5.
    • Fixed a discrepancy in warning and error counts reported between the pipeline summary tab and system logs.
    • Fixed a problem when, in rare cases, a cluster couldn't be found with Cluster Reuse.

    • Fixed a bug causing the JavaScript transform to fail on Dataproc 2.1.

    For more information:


    Best Regards,
    Dennis

    --

    Reply all
    Reply to author
    Forward
    0 new messages