2026-08-05 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2026-08-05 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dhiller, dollierp, Ananya Banerjee, dywhite, fossedihelm

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• 
  

• ci-health

• 

• 

• review and merge the quarantine PRs in 2 working days without SIG lgtm. 

• is:pr is:open quarantine -label:do-not-merge/work-in-progress label:kind/flake -label:needs-rebase

• https://github.com/kubevirt/kubevirt/pull/18689

• previous action items

• state of existing issues: is:issue is:open label:kind/flake sort:updated-asc label:sig/ci

• n/a

• [non-urgent]

• [dhiller] re:dequarantine - there's max_concurrency: 2 which will not allow more than two lane instances to run

• [dhiller] PR for u/s test-execution-report

• those will enable users to find tests not being run on any lane

• lane selection might not yet be perfect, please update as required

• preview: https://storage.googleapis.com/kubevirt-prow/reports/test-execution-reports/kubevirt/kubevirt/preview.html

• [fossedihelm] what about the check-unassigned-tests lane?

• [dhiller] will check whether that lane is correct…

• [fossedihelm] Are we already working on 1.37 provider?

• [dollierp] k8s beta out since a few days

• I have a local branch for 1.37 that defaults to centos10 for node

• [fossedihelm] release schedule says it should be based on centos10

• https://github.com/kubevirt/sig-release/blob/main/releases/v1.10/schedule.md

• Look at flakes

• most flaky tests

• auto-quarantine PR: https://github.com/kubevirt/kubevirt/pull/18689

• [dhiller] lgtmed PR with no objections, should be merged soon
  [dhiller] will check what labels are actually applied when the PR is created

• flake stats - create issues accordingly

• overall ( ∑=2506, 100.00% )

• periodic-kubevirt-e2e-k8s-1.36-sig-compute ( ∑=697, 27.81% )

• New flake: [sig-compute] Infrastructure [rfe_id:3187][crit:medium][vendor:cnv...@redhat.com][level:component]Prometheus Endpoints should include the storage metrics for a running VM [test_id:4142] storage read traffic in bytes metric

• Will be quarantined by the auto-quarantine PR

• periodic-kubevirt-e2e-k8s-1.34-sig-compute ( ∑=627, 25.02% )

• Same as above

• periodic-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=533, 21.27% )

• Same as above

• periodic-kubevirt-e2e-test-S390X ( ∑=290, 11.57% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-serial ( ∑=142, 5.67% )

• periodic-kubevirt-e2e-k8s-1.34-sig-monitoring ( ∑=53, 2.11% )

• periodic-kubevirt-e2e-kind-1.36-sev ( ∑=39, 1.56% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-migrations ( ∑=28, 1.12% )

Last updated: 2026-08-05 07:34:26.991616173 +0000 UTC m=+11.580946917

• Look at held tests:

• https://grafana.ci.kubevirt.io/d/uAoSeksSk/referee-retests?orgId=1&refresh=15m&from=now-1h&to=now

• is:pr is:open label:approved label:lgtm -label:do-not-merge/hold -label:needs-rebase

• dequarantine tests:

• look at list of quarantined tests

• Count: 12 tests in quarantine currently
  

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• [dollier] Joao created a pr in project-infra: https://github.com/kubevirt/project-infra/pull/5345

• [dhiller] objections: https://github.com/kubevirt/project-infra/pull/5345#issuecomment-5181057529

• see whether we can dequarantine tests

• misc topics

• [dhiller] will be out next weeks

Action items

• 
  
• 

  update/create issues with latest flakes spotted

• 

  communication

• send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty