2026-07-15 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2026-07-15 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dhiller, dollierp, fossedihelm

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• [dollierp] merge queue length is broken, hours to merge as well

• currently there’s 14 lgtm/approved, although some are targeting release-1.9

• [dhiller] will take a look, but currently working on unblocking the istio bump, reason is ssh failures when connecting to the vm

• was present earlier, whereas we reverted the bump in kubevirtci and kubevirt and disabled centos 9 stream image bump automation 

• ci-health

• 

• 

• review and merge the quarantine PRs in 2 working days without SIG lgtm. 

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+quarantine+-label%3Ado-not-merge%2Fwork-in-progress+label%3Akind%2Fflake+-label%3Aneeds-rebase

• https://github.com/kubevirt/kubevirt/pull/18420 is there for three days now, seems the fix PRs (https://github.com/kubevirt/kubevirt/pull/18355, https://github.com/kubevirt/kubevirt/pull/18397) are not going to land soon, therefore we quarantine the test

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• [non-urgent]

• [fossedihelm] feedback request on 1.10 schedule: https://github.com/kubevirt/sig-release/pull/67 

• Look at flakes

• most flaky tests

• 
  

• flake stats - create issues accordingly

• overall ( ∑=848, 100.00% )

• periodic-kubevirt-e2e-test-S390X ( ∑=159, 18.75% )

• periodic-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=90, 10.61% )

• periodic-kubevirt-e2e-k8s-1.34-sig-performance-kwok-100 ( ∑=74, 8.73% )

• periodic-kubevirt-e2e-k8s-1.36-sig-compute ( ∑=73, 8.61% )

• periodic-kubevirt-e2e-k8s-1.34-sig-performance-kwok ( ∑=72, 8.49% )

• pull-kubevirt-e2e-k8s-1.36-sig-operator ( ∑=70, 8.25% )

• periodic-kubevirt-e2e-k8s-1.34-sig-compute ( ∑=65, 7.67% )

• pull-kubevirt-e2e-k8s-1.35-sig-operator ( ∑=53, 6.25% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-migrations ( ∑=30, 3.54% )

• periodic-kubevirt-e2e-k8s-1.34-sig-monitoring ( ∑=26, 3.07% )

• pull-kubevirt-e2e-k8s-1.36-sig-compute-serial ( ∑=16, 1.89% )

• periodic-kubevirt-e2e-k8s-1.36-sig-compute-migrations ( ∑=15, 1.77% )

• pull-kubevirt-e2e-k8s-1.35-sig-compute ( ∑=13, 1.53% )

• pull-kubevirt-e2e-kind-1.35-sig-compute-arm64 ( ∑=13, 1.53% )

Last updated: 2026-07-15 07:12:12.622556204 +0000 UTC m=+13.864615105

• Look at held tests:

• https://grafana.ci.kubevirt.io/d/uAoSeksSk/referee-retests?orgId=1&refresh=15m&from=now-1h&to=now

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+label%3Aapproved+label%3Algtm+-label%3Ado-not-merge%2Fhold+-label%3Aneeds-rebase

• dequarantine tests:

• look at list of quarantined tests

• Count: 11 tests in quarantine currently
  

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• see whether we can dequarantine tests

• misc topics

• [fossedihelm] Does this https://github.com/kubevirt/project-infra/pull/5247 apply to release presubmit too?

• automatic image bumping only happens for main

• release-1.9 faces the same issue, but still has the old image: https://github.com/kubevirt/project-infra/blob/f5088c2833a0e9892c54e849312680baa9e88ada/github/ci/prow-deploy/files/jobs/kubevirt/kubevirt/kubevirt-presubmits-1.9.yaml#L446

• let’s bump the image in 1.9 for the pull-kubevirt-unit-test lane to the one with the fix for PIDs

• [dollierp] will do the bump

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty