hydrophone - lightweight runner for tests including conformance

[Davanum Srinivas]

Folks,

We have the conformance image we include in our release artifacts, we have scripts to use / ensure the image works (examples [1][2]). On the other hand, sonobuoy is the primary way end users run conformance tests [3] and report results. Also sonobuoy gets updated *AFTER* we make a release and often lags behind ([4]).

So it feels like we need something in between that we can own/control. With this in mind a few of us (Aniruddha, Ricky, myself) worked on:

https://github.com/dims/hydrophone

Please take a look and see what you think. Happy for this to land in kubernetes-sigs and (co-?)owned by SIG(s). 

thanks,

Dims

[1] https://gist.github.com/aojea/097b5a8418fbbcb2b55e72a4cf6e62f7 

[2] https://github.com/kubernetes/kubernetes/blob/master/test/conformance/image/conformance-e2e.sh 

[3] https://github.com/search?q=repo%3Acncf%2Fk8s-conformance%20sonobuoy&type=code 

[4] https://github.com/vmware-tanzu/sonobuoy/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Frequired 

--

Davanum Srinivas :: https://twitter.com/dims

[Antonio Ojea]

+1 for sig-testing as co-owner

--
You received this message because you are subscribed to the Google Groups "kubernetes-sig-release" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-sig-re...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-release/CANw6fcG281Ljt%3Dm965f_WjdHg0CWk8g-MQa0ifoor9Sytv1gHw%40mail.gmail.com.

[John Belamaric]

+1

You received this message because you are subscribed to the Google Groups "kubernetes-sig-architecture" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-sig-arch...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-architecture/CABhP%3DtZ5etbdk2rTw4ROpUqMFpDYWL837%3D-kGpYYk7KFOQS8DQ%40mail.gmail.com.

[Benjamin Elder]

+1 as SIG Testing Lead :-)

Thanks for working on this!

To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-architecture/CAC_RkjzYj26DeE-c9GU4bS%3D_3tw4hwW4mOBDk_n4HBWb9A1GFw%40mail.gmail.com.

[Davanum Srinivas]

okeydokey opened an issue to move the repo.

sig-testing and sig-release folks, please cast your vote there as well!

-- Dims

On Wed, Jan 3, 2024 at 5:52 AM Marko Mudrinić <mudrin...@gmail.com> wrote:

+1

To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-release/CAOZRXm-ZkRUOHP-DrkVEExW9SbTetH-DebE-0A29%2BVaJ7sEc3A%40mail.gmail.com.

[Davanum Srinivas]

whoops https://github.com/kubernetes/org/issues/4654

[Derek Carr]

+1

To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-architecture/CANw6fcG1BEVF50NezsGJKTy3skhf4AFoNOoRUddO5WSFFeAE-w%40mail.gmail.com.