CDAP deploy pipeline without source or sink

[shreyasi misra]

I have attached a screenshot of my pipeline.

Brief description of pipeline:

The pipeline starts with a pyspark action plugin which performs data manipulation on a Dataframe, updates it to a MySQL DB, updates the status as 'COMPLETE' or 'FAILED' on another DB Table

The database argument setter takes the status of this process as a argument value.

The conditional plugin directs the pipeline to update another database based on status of the process given by the Database argument setter

Both the plugins in the end of the pipeline are Database update action plugins which update a row in a db table.

The issue is that, for me, it is a complete pipeline. However, an error appears when I try to deploy this pipeline saying, "Missing sink, source or actions in the pipeline". How could I deploy the as is or is there a minimal workaround?

[Albert Shau]

This is supposed to be an allowed pipeline structure. I don't think this message is coming from the backend, it is likely a UI issue. Can you try exporting the pipeline and using it as the request body to the deploy API (https://cdap.atlassian.net/wiki/spaces/DOCS/pages/477560983/Lifecycle+Microservices#Create-an-Application)? 

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/2192cc43-fdd7-4af2-bfde-a0fff66663cen%40googlegroups.com.

[shreyasi misra]

Hi,

Deploying was successful through HTTP call.

Should I switch to another version of cdap? I did want to use UI for all processes.

Thanks.

[Albert Shau]

I found an open jira for this issue (https://cdap.atlassian.net/jira/software/c/projects/CDAP/issues/CDAP-17894). Unfortunately it looks like it hasn't been fixed yet and hasn't been assigned to any of the upcoming releases either. Contributions are always welcome, but it looks like there isn't a later CDAP version with this fixed.

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/80484156-a0ee-4aff-bcb9-cd3a0bb0cef7n%40googlegroups.com.

[shreyasi misra]

Hi Albert,

Thank you for your response. I'll keep track on the Jira issue. Thanks.