Alternate for GOOGLE_APPLICATION_CREDENTIALS=/path/to/service_account_keyfile

[Suprabhat]

Hi Team,

https://druid.apache.org/docs/25.0.0/development/extensions-core/google.html#required-configuration

To configure connectivity to google cloud, we are supposed to run druid processes with GOOGLE_APPLICATION_CREDENTIALS=/path/to/service_account_keyfile in the environment.

Our usecase is to avoid storage of any file containing credentials in the VMs. We want to connect to GCS without storing creds in file. Is there any other way by which we could read the GCS creds without storing it in a file?

We tried using the file for starting our VMs and then deleting it once VMs start working but the issue is Middlemanagers' tasks are failing post deletion of GCS creds file.

Thanks

[Suprabhat]

Could anyone help me with this?

[gi...@imply.io]

Where do you want the credentials to be? It's possible that if you skip GOOGLE_APPLICATION_CREDENTIALS then you can use one of the other mechanisms on https://cloud.google.com/java/docs/reference/google-auth-library/latest/com.google.auth.oauth2.GoogleCredentials. Such as "Google Compute Engine built-in credentials", perhaps.

Gian