Dataproc initialization action for git cloning a private github repository?

266 views
Skip to first unread message

Russell Jurney

unread,
Mar 15, 2021, 3:17:08 PM3/15/21
to Google Cloud Dataproc Discussions
Hello Dataprocistas, I have what must be a very common task - I need to clone my pricate Github repository onto a Dataproc cluster and... I can't find a recipe for doing this. It surprised me that it isn't in the initialization actions repo. It involves copying over a deployment key and so it isn't obvious how to do this correctly. I assume it involves GCP Secrets Manager, but I'd rather not figure it out from first principles and Google comes up short.

Many people already do this, right? An existing script or recipe would be greatly appreciated! I need to clone my repository, install data version control and pull the right version of the code and models I will use in my jobs.

Thanks,
Russell Jurney

Mich Talebzadeh

unread,
Mar 15, 2021, 3:21:46 PM3/15/21
to Google Cloud Dataproc Discussions
Hi Russell,


Can you access Chrome from your Dataproc master node?

Reply all
Reply to author
Forward
0 new messages