2026-04-29 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2026-04-29 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dhiller, dollierp,dywhite, nirdothan

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• 
  

• ci-health

• 

• 

• ci-failures

• 5/9 are external download failures

• review and merge the quarantine PRs in 2 working days without SIG lgtm. 

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+quarantine+-label%3Ado-not-merge%2Fwork-in-progress+label%3Akind%2Fflake+-label%3Aneeds-rebase

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• [non-urgent]

• [dhiller] quarantine lifecycle: https://github.com/kubevirt/kubevirt/pull/17633

• every sig should take a look at quarantined tests they own and come up with a plan for them

• Look at flakes

• most flaky tests

• kwok lanes failing, new issue for sig-compute: https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flake-stats-14days-2026-04-29.html#BeforeSuite

• (new) https://github.com/kubevirt/project-infra/issues/5026

• 1.36 periodic sig-compute needs investigation by compute teams

• also 1.35 and 1.34 periodics seem to have gotten less stable, investigation by compute teams is advised

• flake stats - create issues accordingly

• overall ( ∑=970, 100.00% )

• periodic-kubevirt-e2e-k8s-1.36-sig-compute ( ∑=189, 19.48% )

• periodic-kubevirt-e2e-test-S390X ( ∑=170, 17.53% )

• periodic-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=105, 10.82% )

• failing every time since 22-04-2026

• periodic-kubevirt-e2e-k8s-1.34-sig-compute ( ∑=103, 10.62% )

• failing nearly every time since 21-04-2026

• periodic-kubevirt-e2e-k8s-1.34-sig-monitoring ( ∑=51, 5.26% )

• periodic-kubevirt-e2e-k8s-1.34-sig-operator ( ∑=45, 4.64% )

• pull-kubevirt-e2e-k8s-1.35-sig-operator ( ∑=44, 4.54% )

• periodic-kubevirt-e2e-k8s-1.34-sig-performance-kwok-100 ( ∑=36, 3.71% )

• periodic-kubevirt-e2e-k8s-1.34-sig-storage ( ∑=34, 3.51% )

• periodic-kubevirt-e2e-k8s-1.35-sig-storage ( ∑=31, 3.20% )

• periodic-kubevirt-e2e-k8s-1.36-sig-storage ( ∑=25, 2.58% )

• periodic-kubevirt-e2e-k8s-1.35-ipv6-sig-network ( ∑=17, 1.75% )

• pull-kubevirt-e2e-kind-1.35-sig-compute-arm64 ( ∑=16, 1.65% )

• pull-kubevirt-e2e-k8s-1.35-sig-compute-migrations ( ∑=13, 1.34% )

• pull-kubevirt-e2e-k8s-1.35-sig-compute-serial ( ∑=12, 1.24% )

• periodic-kubevirt-e2e-k8s-1.35-sig-compute-migrations ( ∑=11, 1.13% )

• pull-kubevirt-e2e-k8s-1.34-sig-performance ( ∑=11, 1.13% )

• pull-kubevirt-e2e-k8s-1.34-sig-performance-kwok ( ∑=11, 1.13% )

Last updated: 2026-04-29 07:23:09.488206629 +0000 UTC m=+13.799788176

• Look at held tests:

• https://grafana.ci.kubevirt.io/d/uAoSeksSk/referee-retests?orgId=1&refresh=15m&from=now-1h&to=now

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+label%3Aapproved+label%3Algtm+-label%3Ado-not-merge%2Fhold+-label%3Aneeds-rebase

• dequarantine tests:

• look at list of quarantined tests

• Count: 20 tests in quarantine currently
  

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• see whether we can dequarantine tests

• misc topics

• 
  

Action items

• 
  
• 

  update/create issues with latest flakes spotted

• 

  communication

• 

  send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty