GOOGLE_APPLICATION_CREDENTIALS

[Nicholas Ray Herman]

I recently installed CDAP 6.10.1 on Linux, I set it all up like the drivers, connections, etc. until it works and reach to a point where I able to successfully preview and deploy a simple pipeline (1 source -> 1 sink). The source is from MySQL then the destination is Bigquery. All went well until I try to run the pipeline it failed after 24 seconds, the log message as follows:

Spark program 'phase-1' failed with error: The Application Default Credentials are not available. They are available if running in Google Compute Engine. Otherwise, the environment variable GOOGLE_APPLICATION_CREDENTIALS must be defined pointing to a file defining the credentials. See https://developers.google.com/accounts/docs/application-default-credentials for more information.. Please check the system logs for more details.

I have another system having CDAP 6.8.1 which is running but never had this error before. Tried to put the GOOGLE_APPLICATION_CREDENTIALS onto the OS itself but doesn't seems to fix it. I can't seem to find any solution, does anyone had this problem before?

Thanks in advance