2024-11-27 sig-ci quarantine catch-up - meeting notes

[Daniel Hiller]

2024-11-27 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Attendees: omisan, brianmcarey, dhiller, ffossemo

Topics:

• [urgent]

• 
  

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• VSOCK test: https://github.com/kubevirt/kubevirt/issues/12930

• fix PR merged: https://github.com/kubevirt/kubevirt/pull/13330

• [non-urgent]

• we are seeing batch merges even in the release branch now 🎉
  https://prow.ci.kubevirt.io/tide-history?action=MERGE_BATCH
  

• overall we see more and more batch merges happening (maybe we should think about collecting data about this)

• merge queue length metric seems to be broken?
  
  https://github.com/kubevirt/ci-health/#kubevirtkubevirt

• q: in which calendar are the sig-ci meetings stored?

• kv community calender: https://calendar.google.com/calendar/u/0/embed?src=kube...@cncf.io

• the kv community calendar was moved a while ago under the cncf.io umbrella, maybe that’s why some people don’t find the new meetings

• Look at flakes

• flake stats - create issues accordingly

• operator lane clustered failure: 

• https://prow.ci.kubevirt.io/view/gcs/kubevirt-prow/pr-logs/pull/kubevirt_kubevirt/12724/pull-kubevirt-e2e-k8s-1.29-sig-operator/1861413054181281792

• https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flakefinder-2024-11-26-024h.html#row11

• ffossemo to take a look or assign

• https://github.com/kubevirt/kubevirt/issues/13364

• [Serial][sig-compute]Infrastructure [rfe_id:3187][crit:medium][vendor:cnv...@redhat.com][level:component]Prometheus Endpoints should include VMI infos for a running VM [test_id:6241] by IPv6

• https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flake-stats-14days-2024-11-27.html#%5bSerial%5d%5bsig-compute%5dInfrastructure%20%5brfe_id%3a3187%5d%5bcrit%3amedium%5d%5bvendor%3acnv-qe%40redhat.com%5d%5blevel%3acomponent%5dPrometheus%20Endpoints%20should%20include%20VMI%20infos%20for%20a%20running%20VM%20%5btest_id%3a6241%5d%20by%20IPv6

• https://github.com/kubevirt/kubevirt/issues/13142

• probably fixed by https://github.com/kubevirt/kubevirt/issues/13142

• sig-compute-migrations clustered failure

• https://prow.ci.kubevirt.io/view/gcs/kubevirt-prow/pr-logs/pull/kubevirt_kubevirt/13339/pull-kubevirt-e2e-k8s-1.31-sig-compute-migrations/1861368140949098496

• https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flakefinder-2024-11-26-024h.html#row54

• https://github.com/kubevirt/kubevirt/issues/12932

• ffossemo to take it and assign

• sig-storage-root (still a concern?)

• virtiofs

• https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flakefinder-2024-11-26-024h.html#row4

• https://github.com/kubevirt/kubevirt/issues/13141

• [xpivarc] there’s one user still interested in the root feature

• [dhiller] we might need to seek that user and give the opportunity of supporting the root feature to them?

• dequarantine tests:

• look at list of quarantined tests

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• quarantined export tests

• https://github.com/kubevirt/kubevirt/issues/13316

• partial fix PR: https://github.com/kubevirt/kubevirt/pull/13326/files

• see whether we can dequarantine tests 

• no improvements since last week, some PRs in the works though. let’s wait for them to land and check next week again

Action items

• 

  Daniel Hiller issue: flakefinder report - add ad hoc lanes filter to remove noise of clustered failures
  https://github.com/kubevirt/project-infra/issues/3786

• 

  Daniel Hiller q: is there a way to extend the search.ci timerange? currently limited to two weeks?

• 

  update/create issues with latest flakes spotted

• 

  communication

• send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Senior Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner-von-Siemens-Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht München/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Michael O'Neill, Amy Ross