2026-05-27 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2026-05-27 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dhiller, Dylan White, fossedihelm

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• 
  

• ci-health

• 

• 

• review and merge the quarantine PRs in 2 working days without SIG lgtm. 

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+quarantine+-label%3Ado-not-merge%2Fwork-in-progress+label%3Akind%2Fflake+-label%3Aneeds-r

Ebase

• [dywhite] centOS 9 bump has be causing the ci infra issues I believe

• Was bumped on May 20th, merged into kubevirt 22nd

• [dhiller] Dylan to disable the auto bump so we don’t have an instability again

• [dhiller] Dylan to revert the centos 9 bump in kubevirtci then bump kubevirt manually

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• [non-urgent]

• release-blocker: Virtiofs test

• q pr

• [dhiller] to look into failing lanes

• arm 1.35 presubmit failing consistently

• tracker: https://github.com/kubevirt/kubevirt/issues/17908

• moved to optional on all lanes using the cluster

• [Nir on behalf of oshoval] requesting review https://github.com/kubevirt/kubevirtci/pull/1600

• check provision 1.34 is failing

• Dylan will override

• dhiller to look into the failures: https://prow.ci.kubevirt.io/job-history/gs/kubevirt-prow/pr-logs/directory/check-provision-k8s-1.34?buildId=2059169421175296000

• Look at flakes

• most flaky tests

• virtiofsbeing qd

• storage hotplug fixed, pr got in yesterday

• HostDevices regression on 1.34

• https://storage.googleapis.com/kubevirt-prow/reports/flakefinder/kubevirt/kubevirt/flake-stats-14days-2026-05-27.html

• tracker: https://github.com/kubevirt/kubevirt/issues/17929

• flake stats - create issues accordingly

• https://github.com/kubevirt/ci-health/blob/main/output/kubevirt/kubevirt/flake-overview/flake-overview-2026-05-27.md

• Look at held tests:

• https://grafana.ci.kubevirt.io/d/uAoSeksSk/referee-retests?orgId=1&refresh=15m&from=now-1h&to=now

• https://github.com/kubevirt/kubevirt/pulls?q=is%3Apr+is%3Aopen+label%3Aapproved+label%3Algtm+-label%3Ado-not-merge%2Fhold+-label%3Aneeds-rebase

• dequarantine tests:

• look at list of quarantined tests

• Count: xx tests in quarantine currently
  (insert screenshot from ci-health)

• check status, i.e. who is working on those

• Dequarantine: [sig-compute] Infrastructure cluster profiler for pprof data aggregation when ClusterProfiler configuration is enabled it should allow subresource access

• Unquarantine sig-observability tests

• look at PRs that want to fix flakes

• see whether we can dequarantine tests

• misc topics

• [fossedihelm] (raised last time) US guys want to join one of the meetings

• any time proposal?

• [dhiller] request for moving one of the meetings towards US TZ compatible time, suggestions?

• will write a mail to k-dev

Action items

• 
  
• 

  update/create issues with latest flakes spotted

• 

  communication

• send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty