Macro enabled password for data fusion pipeline

[jdu...@rodanandfields.com]

Hi,

I am using data fusion Microsoft SQL Server Plugin to load the data in BQ. 

I do not want to expose the user name and password in the pipeline so instead of hard coding , I added macros for both.

After deploying the pipeline, I passed the parameters as run time arguments but it failed saying Connection Time out.

When I tried without macros and hard coded the user name and password in the pipeline , it worked.

Is this expected or I am doing something wrong.

Thanks

Jatin

[Tony Long]

Have you tried secure store? Does that fulfill your use case?

https://docs.cdap.io/cdap/6.0.0/en/developer-manual/pipelines/creating-pipelines.html#secure-function

[Mani Prakash]

Hi All,

Is this resolved? Im not able to deploy pipeline with DB Plugin Password as Macro from Secure key store. its throwing error saying, Username or password cannot be null. I verified the secure key store for the same, other keys like sftp password, private keys are working fine. 

Could you please help me on the same issue?

[Richard Nemeth]

It should deploy with no issues, we have all of our 80+ pipelines using it.

 

You cannot import schema or validate any plugin that have macros, but they will deploy and run successfully.

At least for us it works.

 

Rich

--
You received this message because you are subscribed to the Google Groups "CDAP User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cdap-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/350cb7b3-0370-43ca-8ca9-fdcf39d7cbadn%40googlegroups.com.

---

This electronic message contains information from American Eagle Outfitters, Inc. that may be privileged and/or confidential. If you are not the intended recipient, any disclosure, copy, distribution or use of the contents of this message is prohibited. If you have received this email in error, please contact the sender immediately and destroy this message. Thank you.

[Mani Prakash]

Great, Could you please share the Database Plugin version? I'm using 6.1.1 v Standalone CDAP operating over Apace Hadoop(2.7.2). Planning to switch over to 6.3 shortly.  

[Richard Nemeth]

We are on CDAP Data Fusion v 6.2.2

My source plug-in v is 2.4.2

 

Example of my macro

 

 

 

At runtime this is what is passed\substituted

To view this discussion on the web visit https://groups.google.com/d/msgid/cdap-user/4e539f50-31f9-4c93-adf1-ce7fcc2b87d8n%40googlegroups.com.

[Mani Prakash]

Thanks a lot. I found that if table name isnt parameterized, i couldnt deploy a pipeline. It was keep on throwing error. 

So I parameterized the Table name & it was working like charm. 

Regards,

Maniprakash