Automated deployment of Kubeflow Pipelines in GKE and cluster creation using Terraform ?

447 views
Skip to first unread message

Bibin Varghese

unread,
May 26, 2021, 12:33:12 PM5/26/21
to kubeflow-discuss
Hi,

Does anyone have Terraform templates for automated deployment of Kubeflow Pipelines in GKE and  the GKE cluster creation with required settings of KFP.

Thanks,
Bibin

Yuan Gong

unread,
May 26, 2021, 11:13:23 PM5/26/21
to Bibin Varghese, kubeflow-discuss
Hi Bibin,
I don't know any, but the requirements for Kubeflow Pipelines standalone is minimum.
The major decision you need is which permission mode you want (choose from compute default service account, separate nodepool default service account or workload identity)
All other configurations are your own specific preferences.


--
You received this message because you are subscribed to the Google Groups "kubeflow-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubeflow-discu...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubeflow-discuss/52f5fb5e-c767-44b1-86f2-f67ca8789f2en%40googlegroups.com.


--
GONG Yuan

David Aronchick

unread,
May 27, 2021, 3:45:46 PM5/27/21
to Yuan Gong, Luke Marsden, Bibin Varghese, kubeflow-discuss
@Luke Marsden is working on some interesting ideas around this - i'll let him weigh in :)

Karthik Ramachandran

unread,
May 27, 2021, 4:53:49 PM5/27/21
to David Aronchick, Yuri Chernikov, Yuan Gong, Luke Marsden, Bibin Varghese, kubeflow-discuss
@Yuri Chernikov  - is also interested in this. 



--

Karthik Ramachandran

ramach...@google.com

Product Manager

Mobile: 650-214-5905

This email may be confidential or privileged. If you received this communication by mistake, please don't forward it to anyone else, please erase all copies and attachments, and please let me know that it went to the wrong person. Thanks. 

Keshi Dai

unread,
Jun 2, 2021, 10:49:23 PM6/2/21
to Karthik Ramachandran, David Aronchick, Yuri Chernikov, Yuan Gong, Luke Marsden, Bibin Varghese, kubeflow-discuss
Hi Bibin, 

We open-sourced our Kubeblow terraform template (https://github.com/spotify/terraform-gke-kubeflow-cluster) a while back. It's based on our internal engineering stack and fully relies on GCP. 

We haven't been actively maintaining it, but hope you can find some inspiration there. We are thinking about reviving this repo and will share more Kubeflow stuff we have done internally with the community soon. 

Cheers, 
Keshi Dai

Reply all
Reply to author
Forward
0 new messages