2026-07-08 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2026-07-08 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dywhite, dollierp, dhiller, 

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• [dhiller] [sig-compute] #18341: quarantine "[sig-compute] Infrastructure tls configuration should enforce TLS configuration on virt-template components"

• shows 8% flakiness rate as of 7th Jul

• fix pr "#18353: Gate KubeVirt readiness on virt-template rollout for TLS config changes"

• As of 7th Jul missing approval from sig-control-plane

• ci-health

• 

• 

• review and merge the quarantine PRs in 2 working days without SIG lgtm. 

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+quarantine+-label%3Ado-not-merge%2Fwork-in-progress+label%3Akind%2Fflake+-label%3Aneeds-rebase

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• n/a

• [non-urgent]

• 
  

• Look at flakes

• most flaky tests

• [sig-operator]Operator [rfe_id:2291][crit:high][vendor:cnv...@redhat.com][level:component]should update kubevirt [release-blocker][test_id:3145]to target tested release from previous y release by patching KubeVirt CR

• search.ci link

• [fossedihelm] coordinating with lyarwood on working on this

• flake stats - create issues accordingly

• overall ( ∑=1086, 100.00% )

• pull-kubevirt-e2e-k8s-1.36-sig-operator ( ∑=117, 10.77% )

• one test failing a lot: https://storage.googleapis.com/kubevirt-prow/reports/most-flaky-tests/kubevirt/kubevirt/index.html#test_%5bsig-operator%5dOperator%20%5brfe_id%3a2291%5d%5bcrit%3ahigh%5d%5bvendor%3acnv-qe%40redhat.com%5d%5blevel%3acomponent%5dshould%20update%20kubevirt%20%5brelease-blocker%5d%5btest_id%3a3145%5dto%20target%20tested%20release%20from%20previous%20y%20release%20by%20patching%20KubeVirt%20CR

• periodic-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=80, 7.37% )

• clustered failure: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/directory/pull-kubevirt-e2e-k8s-1.36-sig-compute-serial/2074622649710940160

• periodic-kubevirt-e2e-k8s-1.36-sig-compute-migrations ( ∑=72, 6.63% )

• Alexander and Alex working on a fix AFAIU

• periodic-kubevirt-e2e-k8s-1.34-sig-performance-kwok-100 ( ∑=70, 6.45% )

• periodic-kubevirt-e2e-k8s-1.34-sig-performance-kwok ( ∑=68, 6.26% )

• periodic-kubevirt-e2e-k8s-1.36-sig-storage ( ∑=63, 5.80% )

• periodic-kubevirt-e2e-k8s-1.36-sig-compute ( ∑=62, 5.71% )

• periodic-kubevirt-e2e-k8s-1.34-sig-compute ( ∑=58, 5.34% )

• periodic-kubevirt-e2e-k8s-1.34-sig-storage ( ∑=58, 5.34% )

• periodic-kubevirt-e2e-k8s-1.35-sig-storage ( ∑=57, 5.25% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-migrations ( ∑=54, 4.97% )

• periodic-kubevirt-e2e-test-S390X ( ∑=49, 4.51% )

• pull-kubevirt-e2e-k8s-1.35-sig-operator ( ∑=48, 4.42% )

• pull-kubevirt-e2e-k8s-1.34-sig-operator ( ∑=46, 4.24% )

• periodic-kubevirt-e2e-k8s-1.34-sig-monitoring ( ∑=30, 2.76% )

• pull-kubevirt-e2e-kind-1.35-sig-compute-arm64 ( ∑=28, 2.58% )

• pull-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=17, 1.57% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-serial ( ∑=16, 1.47% )

• https://storage.googleapis.com/kubevirt-prow/reports/most-flaky-tests/kubevirt/kubevirt/index.html#test_%5bsig-compute%5d%20Infrastructure%20tls%20configuration%20should%20enforce%20TLS%20configuration%20on%20virt-template%20components

• pull-kubevirt-e2e-k8s-1.34-sig-monitoring ( ∑=15, 1.38% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute ( ∑=12, 1.10% )

• pull-kubevirt-e2e-k8s-1.34-sig-compute ( ∑=11, 1.01% )

Last updated: 2026-07-08 07:01:43.056192062 +0000 UTC m=+13.433836758

• Look at held tests:

• https://grafana.ci.kubevirt.io/d/uAoSeksSk/referee-retests?orgId=1&refresh=15m&from=now-1h&to=now

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+label%3Aapproved+label%3Algtm+-label%3Ado-not-merge%2Fhold+-label%3Aneeds-rebase

• dequarantine tests:

• look at list of quarantined tests

• Count: 14 tests in quarantine currently
  

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• see whether we can dequarantine tests

• misc topics

• [nirdothan] network flakes

• 3 flakes were from the new emulated sriov lane

• asked Or Shoval about them

• [dollierp] we are running just the emulated lane right now

• [nirdothan]

• someone to copy the istio images to quay?

• [dhiller] will handle that

• [dhiller] PR https://github.com/kubevirt/project-infra/pull/5257

• [fossedihelm] we merged a fix on check-for-flakes

• [dhiller] will take a look at the automation and confirm when it’s fixed

• [dhiller] issue https://github.com/kubevirt/kubevirt/issues/18393

Action items

• 

  Daniel Hiller join sig-compute and ask for poc for specific issues raised in sig-ci meetings

• 

  update/create issues with latest flakes spotted

• 

  communication

• send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty