example of using combining ETL app with workflow

18 views
Skip to first unread message

Norbert Burger

unread,
Dec 3, 2015, 3:54:28 PM12/3/15
to CDAP User
Hi CDAP team - are there any docs readily available on combing ETL apps with workflows?  We have built out a custom ETL transform/sink and would like to combine it with an email action.

Norbert

Rohit Sinha

unread,
Dec 3, 2015, 5:07:12 PM12/3/15
to CDAP User
Hello Norbert,

Is your ETL app a batch pipeline or realtime ?

A batch ETL pipeline is a Workflow in which there is support for adding email action 
after the MapReduce job to send Workflow token as the message. We don't have
documentation for this right now but I have opened a Jira issue to add the docs for this:


If you need any help with this please get back to us and we can guide you to do 
this. Although, if you want to add some thing to this message from your ETL plugin it 
wouldn't be possible in our current release. To support this we need to add a way to
allow Plugins to add Workflow tokens. We have an open Jira for this:


Thanks,
Rohit
Reply all
Reply to author
Forward
0 new messages