making a cluster-api control plane provider out of the helm chart would be very interesting.
And utilizing the kubevirt machine controller could allow an under k8s to subdivide into hard multitenant clusters.
Could be quite interesting.
Thanks,
Kevin
________________________________________
From:
kubernetes-sig-c...@googlegroups.com <
kubernetes-sig-c...@googlegroups.com> on behalf of Lubomir I. Ivanov <
neol...@gmail.com>
Sent: Tuesday, November 10, 2020 11:08 AM
To: kvaps
Cc: kubernetes-sig-cluster-lifecycle; Justin Santa Barbara; Tim St. Clair;
m...@chrishein.com
Subject: Re: SIG: Kubernetes-helm-chart
Check twice before you click! This email originated from outside PNNL.
thank you for the details, Andrey! this does indeed look quite interesting.
you might also want to have a look at this related Cluster API provider that was added no so long ago:
https://github.com/kubernetes-sigs/cluster-api-provider-nested<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkubernetes-sigs%2Fcluster-api-provider-nested&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657032114%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=roD%2FPN8xK9dF2uKzJ7GQLsi1KYD35e5GwzhOd59aRTs%3D&reserved=0>
it originated in SIG Multitenancy as a solution for nesting Kubernetes clusters.
https://github.com/kubernetes-sigs/multi-tenancy<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkubernetes-sigs%2Fmulti-tenancy&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657042135%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ExytPq3983tLv8ixV4HR0gvwuWJp96wPqMUXta5LMlM%3D&reserved=0>
CC Chris Hein, who is one of the maintainers.
lubomir
--
On Tue, 10 Nov 2020 at 20:32, kvaps <
kva...@gmail.com<mailto:
kva...@gmail.com>> wrote:
Hi Lubomir,
I understand your point of view and fully agree on this. I will return later, if my request will not be satisfied for now.
As for the benefits, I probably didn't fully reflect them.
My bad, I can try to disclose some of them here:
Kubernetes is a well-written application, so putting it into Kubernetes is not a big deal, the most important question might be why to do that?
1. As for any other application you're putting into Kubernetes, you're expecting universality and repeatability for it's deployment.
The main reason for this project is to provide such a simple and repeatable method for the Kubernetes installation as for any other application in it.
2. While this chart is providing just a control-plane with no compute nodes, it can be used as a library for various purposes.
And I was developing it as a separate project exactly for this reason.
For example I have another project kubefarm<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkvaps%2Fkubefarm&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657042135%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=44gZzZOWV5SpHBtwaSQp7AYSTQtkKg9SuiyJ5qB9rK0%3D&reserved=0>, which fully relies on it. We have already hundreds of pxe-bootable servers deployed using kubefarm.
I believe that there will be other projects, which will be interesting to use this chart to deploy a control-plane for their own purposes.
For Example GKE on-prem<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcloud.google.com%2Fanthos%2Fgke%2Fdocs%2Fon-prem%2F1.5%2Foverview&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657052027%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Q3wD8MwG%2FlhEHoOMus3D6U90KxUcPgp51uJs8OXL8S0%3D&reserved=0> and Gardener<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgardener.cloud%2F&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657052027%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=lScPKHD6%2BM5XS%2FujUvT04yt%2Fvw8FZcKoAg0fMCnJTi0%3D&reserved=0> are doing the same by deploying Kubernetes control-plane in other Kubernetes-clusters.
I just want to say that we need some standardized method to describe Kubernetes components declaratively in simple YAML form. I choose the Helm, because the Helm-charts are widely used, they can be rendered into simple YAML-manifests and inspected. You don't need cluster-wide privileges to deploy and actually you can deploy it anywhere, where there is a working Kubernetes.
3. Kubernetes is a single-tenant solution, so deploying multiple clusters is quite a common task for it.
Thus a question: which platform would you choose to deploy multiple similar applications and orchestrate them? Right, Kubernetes.
In addition I'll provide a screenshot from my presentation:
[kubefarm.png]
4. Sometimes containerized might be really useful for testing environments, e.g. for developing webhooks<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkubernetes.io%2Fdocs%2Freference%2Faccess-authn-authz%2Fwebhook%2F&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657061979%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=jq0FvFxu%2Bo6n88o4H%2Bu82VpZq%2F%2BMtHdVAj9vJ6NIALU%3D&reserved=0>, api aggregation<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkubernetes.io%2Fdocs%2Fconcepts%2Fextend-kubernetes%2Fapi-extension%2Fapiserver-aggregation%2F&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657061979%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=qcNoArmLsI01wYNCbJlRIX3Ra998q4p8BlyupEJAwKI%3D&reserved=0>, virtual-kubelet<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fvirtual-kubelet%2Fvirtual-kubelet&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657061979%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=oRtxzWUtyGuXUmxCXGIYXZ7DrNXr8c1%2FwPwa5nxrP2I%3D&reserved=0> and simulating real kubernetes clusters.
Thank you for your attention
Best Regards,
Andrei Kvapil
On Tue, Nov 10, 2020 at 6:15 PM Lubomir I. Ivanov <
neol...@gmail.com<mailto:
neol...@gmail.com>> wrote:
hi, Andrey
thank you for getting this new project to the attention of the SIG.
my personal opinion is that we should host / include projects under
SIG CL that would benefit a certain volume of a user base. as of its
current state, it's not clear to me how this project can satisfy such
a volume. if one day the project gains sufficient traction and if the
use case of deploying Kubernetes in Kubernetes using Help becomes
something that is needed by the wider community i can see myself
giving a +1 to the idea to host it under k-sigs. until then, my vote
would be to hold on that action.
i'm adding Justin and Tim on CC for their opinion.
thank you!
lubomir
--
On Tue, 10 Nov 2020 at 15:12, Andrey Kvapil <
kva...@gmail.com<mailto:
kva...@gmail.com>> wrote:
>
> Hey, I'm having a cool project to install Kubernetes in Kubernetes using a Helm chart:
>
>
https://github.com/kvaps/kubernetes-in-kubernetes<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkvaps%2Fkubernetes-in-kubernetes&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657071945%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=n0up%2B6iQBQMUidx7V2hQ%2BSg%2FTwRzZvsMWPGuLVVpF0I%3D&reserved=0>
>
> Currently it has no many contributors, but I'm going to make a speech about it soon.
> I would like to share it with the community and if possible to continue development as kubernetes-sigs/kubernetes-helm-chart.
> It would be nice to have independent development and possibly more people interested in this project.
>
> In continue to this conversation on steering mailing list @dims let me know that I need to find a SIG that wants to sponsor this effort.
> I would like to suggest @kubernetes/sig-cluster-lifecycle on this role since you are already having kubespray and bootkube projects under your wing.
>
> Cheers!
>
> Best Regards,
> Andrei Kvapil
>
> --
> You received this message because you are subscribed to the Google Groups "kubernetes-sig-cluster-lifecycle" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
kubernetes-sig-cluster...@googlegroups.com<mailto:
kubernetes-sig-cluster-lifecycle%2Bunsu...@googlegroups.com>.
> To view this discussion on the web visit
https://groups.google.com/d/msgid/kubernetes-sig-cluster-lifecycle/630b4af2-9ef3-410d-a067-b322c5a3f7efn%40googlegroups.com<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fkubernetes-sig-cluster-lifecycle%2F630b4af2-9ef3-410d-a067-b322c5a3f7efn%2540googlegroups.com&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657071945%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=gBeGKzEf2i82yj6iIse6tenrwJ6te%2BKLE%2BeWmZDhawM%3D&reserved=0>.
--
You received this message because you are subscribed to the Google Groups "kubernetes-sig-cluster-lifecycle" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
kubernetes-sig-cluster...@googlegroups.com<mailto:
kubernetes-sig-cluster...@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/kubernetes-sig-cluster-lifecycle/CAGDbWi_rmB3zyauERcafN_yooctv8tVmQZfAsbiCRSv5ZXOfcQ%40mail.gmail.com<
https://gcc02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fkubernetes-sig-cluster-lifecycle%2FCAGDbWi_rmB3zyauERcafN_yooctv8tVmQZfAsbiCRSv5ZXOfcQ%2540mail.gmail.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=04%7C01%7CKevin.Fox%40pnnl.gov%7Cdecf3ffd95a641279f9c08d885ac233b%7Cd6faa5f90ae240338c0130048a38deeb%7C0%7C0%7C637406321657081900%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=fZCRBBnFYQW7zYpcZj78YkSJbrHEcHMwWZSLqFtKcL0%3D&reserved=0>.