Re: [kubernetes-sig-testing] PodUtils are now included Metrics

[Cole Wagner]

Thanks for all the work on this Grant and Aaron! This is awesome to finally have!

Anyone interested in switching their jobs to use the PodUtils (sometimes referred to as prowjob or pod decoration) should check out the pod utility docs or the complete job cookbook for examples.

- Cole Wagner

On Fri, Jan 15, 2021 at 3:00 PM 'Grant Mccloskey' via kubernetes-sig-testing <kubernetes-...@googlegroups.com> wrote:

Hello All, Happy Friday

TL;DR

- PodUtil jobs were previously excluded from Kettle/Metrics (Bootstrap.py jobs were the only ones counted)

- These jobs are now included in Flake Data as of #20500

- Everyone should be free to migrate jobs to PodUtils without fear of losing metrics

Previously we only had metrics for Bootstrap jobs as a result of how kettle collected job metadata and how our queries collected data. As of #20500 the requisite Kettle and Metric changes have been added to support PodUtils. The Flakes query has been updated in #20500 though there are some other queries that still might be outstanding (See Open Issue).

If you see an issue in the results, please create an issue and assign me. Thanks All! 

Have a great weekend,

      Grant on behalf of Sig-Testing

--
You received this message because you are subscribed to the Google Groups "kubernetes-sig-testing" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-sig-te...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-testing/CA%2BoAT0YVLrrq4fX%2Bu_ENSZCQD%2BfEvBK8mR5tvbQkz39-4CMhvA%40mail.gmail.com.

[Grant Mccloskey]

[Grant Mccloskey]

Quick followup, the Flake Metric query was updated to reflect the PodUtil job changes and also now includes both CI jobs and Periodics. See flakes-latest.json

Some show a significant amount of flakes and low consistency over the last week:

"pr:pull-kubernetes-e2e-gce-ubuntu-containerd": {
"consistency": 0.869,
"flakes": 56,

 

"ci-kubernetes-cached-make-test": {
"consistency": 0.131, 
"flakes": 53, 

"ci-kubernetes-e2e-gci-gce-ip-alias": {
"consistency": 0.589, 
"flakes": 23, 

It might be nice for different SIGs to track flakes they care about and for consumers to have some nicer UI/UX around metrics so I created an ISSUE around building some static site around the metrics. 

[Ricardo Katz]

Just to add a bit more and help those wanting to migrate, Dims also put a nice migration docs here:

https://gist.github.com/dims/c1296f8ed42238baea0a5fcae45f4cf4

I’ve migrated two jobs that run manually as a test (thanks Antonio and Chao for the patience!) using this “script” and works fine. 

Best,

--
You received this message because you are subscribed to the Google Groups "Kubernetes developer/contributor discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-dev/CA%2BoAT0YThGp4BuWKpThuizRyfSEEf0se_xw2iBeWr_BbpDVmuw%40mail.gmail.com.

[Benjamin Elder]

Thank you all for your hard work on this! This is great to finally have :-)

You received this message because you are subscribed to the Google Groups "kubernetes-sig-testing" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-sig-te...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubernetes-sig-testing/CAG3fPQ6HtU3zdjacrCr8J2q03W5JmqhvSwwHxSvsTaDjSp9%3D1Q%40mail.gmail.com.