Federation Cluster Questions

[Ma,Wentao(BP&IT)]

Hi All,

 

Nice to meet you. This is mike from Baidu company in china,  I am trying to build the Federated kubernetes on my k8s cluster. I got the Federated Kubernetes Tutorial from this page.

https://github.com/kelseyhightower/kubernetes-cluster-federation it is very clear step to build Federated Kubernetes on GKE cluster.

But my kubernetes clusters are not in GKE, I install k8s at ubuntu14.04 on bare metal by manual, and our system can’t directly access the outside network. So I need download all of the image from google cloud or docker hub, then put them into our private docker repository. Then Use them to install k8s clusters.

Now I want to install Federation Cluster on my k8s clusters. But I notice all of the scripts and tutorial are for building the Federation Cluster on GCE or aws.

So I meet a lot of trouble to deploy Federation api, secure and control manager deployment by these default scripts https://github.com/kubernetes/kubernetes/blob/master/federation/deploy/deploy.sh  and https://github.com/kubernetes/kubernetes/blob/master/federation/cluster/common.sh .

Especially I don’t know how to setup cluster configuration about cluster config and kubeconfig for my local clusters like these steps. https://github.com/kelseyhightower/kubernetes-cluster-federation/blob/master/labs/create-cluster-secrets-and-manifests.md . By the way. My local cluster didn’t enable the certificate configuration. So minion node and mater can directly access.

Can you tell me if I can build the federation cluster for my local k8s clusters. And can you show some steps about how to create cluster secrets for federation api and controller manager components.

Thanks very much.

Regards

Mike

mawen...@baidu.com

[David Oppenheimer]

You might want to send your question to the federation SIG mailing list

https://groups.google.com/forum/#!forum/kubernetes-sig-federation

--
You received this message because you are subscribed to the Google Groups "Kubernetes user discussion and Q&A" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-users+unsubscribe@googlegroups.com.
To post to this group, send email to kubernetes-users@googlegroups.com.
Visit this group at https://groups.google.com/group/kubernetes-users.
For more options, visit https://groups.google.com/d/optout.

[Madhusudan C.S.]

I replied to the private email that Mike sent. But I am also pasting the reply here for posterity.

On Saturday, December 3, 2016 at 4:22:57 PM UTC-8, David Oppenheimer wrote:

You might want to send your question to the federation SIG mailing list

https://groups.google.com/forum/#!forum/kubernetes-sig-federation

Hi Mike,

You can indeed setup federation on a bare metal environment. However, here are a couple of caveats to be aware of:

1. We only have DNS provider implementations for AWS Route53 and Google Cloud DNS. This means, you can setup federation on your local cluster, but if you want to have Federated Services working your cluster/federation needs to be able to access the APIs for these providers. To reemphasize, if your bare metal cluster can talk to one of these API endpoints everything should work. Otherwise Federated Services won't work, other API resources will. But having said that CoreDNS implementation of DNS provider is in the works and once that is in the release, you could get Federated Services running completely on bare-metal/on-prem.

2. Federated Ingress is only implemented for GCP (GKE and Kubernetes clusters in GCE). 

Except these two resources, everything in federation works in complete on-prem/bare metal environments. 

On Fri, Dec 2, 2016 at 1:26 AM, Ma,Wentao(BP&IT) <mawen...@baidu.com> wrote:

Hi All,

 

Nice to meet you. This is mike from Baidu company in china,  I am trying to build the Federated kubernetes on my k8s cluster. I got the Federated Kubernetes Tutorial from this page.

https://github.com/kelseyhightower/kubernetes-cluster-federation it is very clear step to build Federated Kubernetes on GKE cluster.

But my kubernetes clusters are not in GKE, I install k8s at ubuntu14.04 on bare metal by manual, and our system can’t directly access the outside network. So I need download all of the image from google cloud or docker hub, then put them into our private docker repository. Then Use them to install k8s clusters.

Now I want to install Federation Cluster on my k8s clusters. But I notice all of the scripts and tutorial are for building the Federation Cluster on GCE or aws.

So I meet a lot of trouble to deploy Federation api, secure and control manager deployment by these default scripts https://github.com/kubernetes/kubernetes/blob/master/federation/deploy/deploy.sh  and https://github.com/kubernetes/kubernetes/blob/master/federation/cluster/common.sh .

Especially I don’t know how to setup cluster configuration about cluster config and kubeconfig for my local clusters like these steps. https://github.com/kelseyhightower/kubernetes-cluster-federation/blob/master/labs/create-cluster-secrets-and-manifests.md . By the way. My local cluster didn’t enable the certificate configuration. So minion node and mater can directly access.

Can you tell me if I can build the federation cluster for my local k8s clusters. And can you show some steps about how to create cluster secrets for federation api and controller manager components.

You said you are setting up your cluster manually. Could you please elaborate on how you are doing that? For example, how does your kubelet reach your API server? What credentials does it use? The reason why I ask is, you could use the same credentials in your kubeconfig the steps discussed in the linked tutorial above.

(I wrote the above line in my original email, but after reading this again I am kind of guessing what's going on here. Are you running all the nodes on a single machine? If that's the case, then read below)

I think if you are going this manual, you need to use Kelsey's manual :P The differences are:

1. In the "Provision Kubernetes Clusters" step - https://github.com/kelseyhightower/kubernetes-cluster-federation/blob/master/labs/cluster-bootstrap.md, you follow your own steps to bootstrap your Kubernetes Cluster instead of what is described in that tutorial.

2. After that, in the "Create Cluster Secrets and Manifests" step - https://github.com/kelseyhightower/kubernetes-cluster-federation/blob/master/labs/create-cluster-secrets-and-manifests.md, you skip the first parts and then in the step where you need to create clusters/<cluster-name>.yaml files, you need to replace `serverAddress` lines as such as these `serverAddress: "${US_CENTRAL_SERVER_ADDRESS}"` with `serverAddress: "http://localhost:8080"` or whatever is your cluster's local address.

 

Thanks very much.

Regards

Mike

mawen...@baidu.com

--
You received this message because you are subscribed to the Google Groups "Kubernetes user discussion and Q&A" group.

To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-use...@googlegroups.com.
To post to this group, send email to kubernet...@googlegroups.com.