CDAP User

Contact owners and managers

1–30 of 1927

Welcome to CDAP OSS User Discussions.

The CDAP User list will engage with members of the CDAP User Community on feature discussions, announcements etc. Join to keep yourself informed of everything that is happening with CDAP! Come on in, read, search for questions you may have about CDAP, and feel free to hop into the conversations.

Please note: This list is not open to posts from vendors who are promoting their products or spamming recruiters.

Resources

Issues
Builds
Slack (Chat)
CDAP, CDAP Security Extensions, CDAP Cloudera Manager CSD, CDAP Ambari, Netty HTTP, Data Integrations [1][2]

0 selected

Nicholas Ray Herman

Nov 25

GOOGLE_APPLICATION_CREDENTIALS

I recently installed CDAP 6.10.1 on Linux, I set it all up like the drivers, connections, etc. until

unread,

GOOGLE_APPLICATION_CREDENTIALS

I recently installed CDAP 6.10.1 on Linux, I set it all up like the drivers, connections, etc. until

Nov 25

Parthipan Sundharesan

Nov 12

Mysql dynamic query execution updation (CRUD)

Hi everyone, I am working on a pipeline in CDAP where I need to dynamically construct and execute SQL

unread,

Mysql dynamic query execution updation (CRUD)

Hi everyone, I am working on a pipeline in CDAP where I need to dynamically construct and execute SQL

Nov 12

Jun 3

[ANNOUNCE] CDAP 6.10.1 Release

Hi everyone, We are happy to announce the general availability of CDAP platform version 6.10.1. This

unread,

[ANNOUNCE] CDAP 6.10.1 Release

Hi everyone, We are happy to announce the general availability of CDAP platform version 6.10.1. This

Jun 3

May 27

message.key.columns is not working

Hi Guys, We are using Data Fusion to replicate a MySQL table to BigQuery. Our requirement is to use a

unread,

message.key.columns is not working

Hi Guys, We are using Data Fusion to replicate a MySQL table to BigQuery. Our requirement is to use a

May 27

kader Ben Mati, … Sanket Sahu3

Apr 29

Passing filename being processed in the context

Hi, If in GCS Source you have the PATH (Filepath/*) Then you can just use the same PATH in gcs move.

unread,

Passing filename being processed in the context

Hi, If in GCS Source you have the PATH (Filepath/*) Then you can just use the same PATH in gcs move.

Apr 29

Solutions Larroude, Hederson Pereira dos Santos3

Apr 12

Dataproc job does not exist in project

Hey guys, Problem solved, I contacted Google support, the problem caused was due to lack of cache

unread,

Dataproc job does not exist in project

Hey guys, Problem solved, I contacted Google support, the problem caused was due to lack of cache

Apr 12

Hederson Pereira dos Santos2

Apr 8

CDC Replication is locking SQL Server Table

I am using the version of Data Fusion 6.6.0 On Monday, April 8, 2024 at 10:46:51 AM UTC-3 Hederson

unread,

CDC Replication is locking SQL Server Table

I am using the version of Data Fusion 6.6.0 On Monday, April 8, 2024 at 10:46:51 AM UTC-3 Hederson

Apr 8

Vinod Shankar K, Solutions Larroude3

Mar 15

How can I feed last successful run timestamp into next job ?

Sorry. This request was resolved. Thank On Thu, Feb 15, 2024 at 1:53 PM 'Vinod Shankar K' via

unread,

How can I feed last successful run timestamp into next job ?

Sorry. This request was resolved. Thank On Thu, Feb 15, 2024 at 1:53 PM 'Vinod Shankar K' via

Mar 15

shreyasi misra, Solutions Larroude2

Mar 11

Pipeline stuck at 'Stopping' status

Hello I have the same error, the duration of my pipeline is 4 days 14 hours and 17 minutes. I can

unread,

Pipeline stuck at 'Stopping' status

Hello I have the same error, the duration of my pipeline is 4 days 14 hours and 17 minutes. I can

Mar 11

Pranav Jituri, Ankit Jain3

Feb 27

Added support for Named Databases for Firestore & other fixes

Thank you so much Ankit for your support and helping me with the PR review! Thanks, Pranav On Tue,

unread,

Added support for Named Databases for Firestore & other fixes

Thank you so much Ankit for your support and helping me with the PR review! Thanks, Pranav On Tue,

Feb 27

Feb 23

Overwrite files with GCS sink plug in

Hi, I'm trying to build a pipeline that outputs json to cloud storage, and I would like the

unread,

Overwrite files with GCS sink plug in

Hi, I'm trying to build a pipeline that outputs json to cloud storage, and I would like the

Feb 23

Vinod Shankar K

Feb 20

Copy data from Big Query or GCS to SFTP

Helli, I came across SFTP plugin but I have been trying to copy data from GCS or Big Query to SFTP

unread,

Copy data from Big Query or GCS to SFTP

Helli, I came across SFTP plugin but I have been trying to copy data from GCS or Big Query to SFTP

Feb 20

Solutions Larroude, Ankit Jain2

Jan 22

Gsheets spreadsheet connections with Data Fusion

Hi, Step-by-step guide is mentioned in the CDAP documentation on how to connect with Google Sheets

unread,

Gsheets spreadsheet connections with Data Fusion

Hi, Step-by-step guide is mentioned in the CDAP documentation on how to connect with Google Sheets

Jan 22

Samik Gupta, Toni Suhendar3

Jan 17

[ANNOUNCE] CDAP 6.10.0 Release

And solved with version 6.10.0 Thanks On Thursday, January 18, 2024 at 8:48:07 AM UTC+7 Toni Suhendar

unread,

[ANNOUNCE] CDAP 6.10.0 Release

And solved with version 6.10.0 Thanks On Thursday, January 18, 2024 at 8:48:07 AM UTC+7 Toni Suhendar

Jan 17

Jan 12

Can't get CDAP Sandbox (docker) 6.9.2 working

My goal is to get CDAP Sandbox v6.9.2 running in a Google Cloud Debian Linux Compute Engine.

unread,

Can't get CDAP Sandbox (docker) 6.9.2 working

My goal is to get CDAP Sandbox v6.9.2 running in a Google Cloud Debian Linux Compute Engine.

Jan 12

Rubendra Narayanappa

Jan 10

Wrangle file in UTF-16 LE format

Hi Team, Can some please let me know how to wrangle the file encoded in UTF-16 LE format ? By default

unread,

Wrangle file in UTF-16 LE format

Hi Team, Can some please let me know how to wrangle the file encoded in UTF-16 LE format ? By default

Jan 10

Raj Roy, Amit Virmani2

11/7/23

How do i get max() of a column

You could use the GroupBy plugin which can group by given fields and then perform aggregate function

unread,

How do i get max() of a column

You could use the GroupBy plugin which can group by given fields and then perform aggregate function

11/7/23

10/30/23

Pyspark integration

Hello im new to cdap and i was wondering if someone has any documentacion on running pyspark code in

unread,

Pyspark integration

Hello im new to cdap and i was wondering if someone has any documentacion on running pyspark code in

10/30/23

Gustavo Ruckert

10/30/23

How can I extract nested fields

Hi guys, I am using CDAP to do some ETL work, when I execute in preview mode, it works and returns

unread,

How can I extract nested fields

Hi guys, I am using CDAP to do some ETL work, when I execute in preview mode, it works and returns

10/30/23

Everett Berry, Vitalii Tymchyshyn2

10/24/23

Slack Message on Pipeline Failure

I would recommend checking if pipeline logs has any cues. On Friday, September 8, 2023 at 7:52:52 AM

unread,

Slack Message on Pipeline Failure

I would recommend checking if pipeline logs has any cues. On Friday, September 8, 2023 at 7:52:52 AM

10/24/23

Tuomas D, Prashant Jaikumar2

10/24/23

Hadoop configurations to Spark pods for pipeline runs

Hi Tuomas, fs.defaultFS is set by the cdap operator to the value of the locationURI config in the

unread,

Hadoop configurations to Spark pods for pipeline runs

Hi Tuomas, fs.defaultFS is set by the cdap operator to the value of the locationURI config in the

10/24/23

Nezar Oussama, Vitalii Tymchyshyn2

10/24/23

Extract data from mongo collection using aggregation ( $project )

CDAP uses Mongo Hadoop support to read big data from MongoDB. The Mongo Hadoop driver is using "

unread,

Extract data from mongo collection using aggregation ( $project )

CDAP uses Mongo Hadoop support to read big data from MongoDB. The Mongo Hadoop driver is using "

10/24/23

Gracy Kelly Silva, Ankit Jain3

9/26/23

[HELP] Connections Cdap Data fusion with Google Gsheets

Thank you very much Ankit I will see and test Em terça-feira, 26 de setembro de 2023 às 09:46:36 UTC-

unread,

[HELP] Connections Cdap Data fusion with Google Gsheets

Thank you very much Ankit I will see and test Em terça-feira, 26 de setembro de 2023 às 09:46:36 UTC-

9/26/23

9/2/23

[ANNOUNCE] CDAP 6.9.2 Release

Hi everyone, We are happy to announce the general availability of CDAP platform version 6.9.2. This

unread,

[ANNOUNCE] CDAP 6.9.2 Release

Hi everyone, We are happy to announce the general availability of CDAP platform version 6.9.2. This

9/2/23

Daniel SA, … Albert Shau17

9/1/23

Teradata source plugin

Hi guys, thanks for that info! The ticket you've mentioned seems to be 7 yo. Do you know if the

unread,

Teradata source plugin

Hi guys, thanks for that info! The ticket you've mentioned seems to be 7 yo. Do you know if the

9/1/23

Bishwadeep Gupta, Prashant Jaikumar2

8/28/23

[CDAP on k8s] Mount configmap as volume on spark driver & executor pods

I don't think this is supported. From https://spark.apache.org/docs/latest/running-on-kubernetes.

unread,

[CDAP on k8s] Mount configmap as volume on spark driver & executor pods

I don't think this is supported. From https://spark.apache.org/docs/latest/running-on-kubernetes.

8/28/23

Bill Sekhon, … Pratap Majumder4

7/29/23

error message: Files\java\jdk1.8.0_60] was unexpected at this time.

it worked, thanks for the guidance On Tuesday, June 14, 2016 at 2:05:57 AM UTC+5:30 Rohit Sinha wrote

unread,

error message: Files\java\jdk1.8.0_60] was unexpected at this time.

it worked, thanks for the guidance On Tuesday, June 14, 2016 at 2:05:57 AM UTC+5:30 Rohit Sinha wrote

7/29/23

Sumati Jain, … viann bono4

7/21/23

The data fusion stuck in provisioning state while running the pipeline and not deleting later.

Experiencing the same, apparently 2 pipelines have been stuck in provisioning mode since early April.

unread,

The data fusion stuck in provisioning state while running the pipeline and not deleting later.

Experiencing the same, apparently 2 pipelines have been stuck in provisioning mode since early April.

7/21/23

Daniel SA, Sean Zhou4

7/20/23

Retrieve resources from pipeline-run

Hi Sean, thanks for your reply and clearing the second question. Do you know if there's a chance

unread,

Retrieve resources from pipeline-run

Hi Sean, thanks for your reply and clearing the second question. Do you know if there's a chance

7/20/23

Ravi, Sean Zhou2

7/19/23

CDAP as a managed service in AWS and Azure

Hi, Ravi The only managed solution we support currently is Google Cloud Data Fusion. thanks, Sean On

unread,

CDAP as a managed service in AWS and Azure

Hi, Ravi The only managed solution we support currently is Google Cloud Data Fusion. thanks, Sean On

7/19/23

Search

Clear search

Close search

Google apps

Main menu