email-postaction plugin in data fusion

[Jatin Dutta]

Hi,

I am trying to setup alerting in data fusion pipeline by sending email in case of failures. I read that email-postaction plugin is built for that and in order import this plugin into the data fusion, it should be converted to a .jar file.

I am using below commands to convert it to jar file ( in command line):

1) Git clone https://github.com/cdapio/hydrator-plugins

2) cd hydrator-plugins\core-plugins

3) mvn clean package -D maven.test.skip=true

After this, there is target folder created with .jar and ..json file.

Next step, I uploaded both the files in data fusion and it throws below error:

Artifact artifact:default.core-plugins.2.5.0-SNAPSHOT extends artifacts 'system:cdap-data-pipeline[6.2.0-SNAPSHOT,7.0.0-SNAPSHOT)/system:cdap-data-streams[6.2.0-SNAPSHOT,7.0.0-SNAPSHOT)' that do not exist

I checked in pom.xml file, the cdap version is 6.2.0 and the data fusion verison which I am using is 6.1.2. Is the issue related to different cdap versions?

Thanks in advance.

Jatin

[Bhooshan Mogal]

Hi Jatin,

You shouldn't need to build this plugin. It is already available under Studio -> Configure -> Pipeline Alert.

However, in Data Fusion, this plugin needs complicated set up: You have to set up an SMTP server on a long-running Dataproc cluster, and use that for your pipeline.

Instead, there is an alternate plugin in the Hub to do email notifications using Sendgrid that will work much more seamlessly. The caveat is that Sendgrid requires a paid subscription (although it has a free tier).

Thanks,

Bhooshan

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/5edc82bd-bc20-4dda-ad64-1a9ffa482e62%40googlegroups.com.

--

-Bhooshan

[Flavia]

Hi, 

Why do users need to set up SMTP server, can they use the gmail SMTP server instead?

Thanks,

Flavia