2025-12-17 sig-ci quarantine catch-up - notes

[Daniel Hiller]

2025-12-17 sig-ci quarantine catch-up

When: Weekly on Wed, 9:45 – 10:15am

Notes: KubeVirt CI SIG meeting notes

Attendees: dhiller, dollierp, fossedihelm, xpivarc

Reminders:

• we will create GitHub issues for tracking

• GitHub issues and PRs

• should be marked with /sig ci and /kind flake if applicable

• should be marked with the target sig

• kubevirt quarantine process documentation

Topics:

• [urgent]

• 
  

• ci-health

• 

• 

• SIG CI summary

• sig-operator - issue pending resolution as discussed earlier

• tracker: https://github.com/kubevirt/kubevirt/issues/16371

• previous action items

• state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci

• n/a

• [non-urgent]

• 
  

• Look at flakes

• flake stats - create issues accordingly

• count: 952 failures overall

• sig-compute

• 361 periodic-kubevirt-e2e-k8s-1.35-sig-compute

• (existing) https://github.com/kubevirt/kubevirt/issues/15976

• [xpivarc] 1.35 seems to be caused by image volume, will take a look

• 129 periodic-kubevirt-e2e-k8s-1.32-sig-compute

• two clustered failures

• (24):  https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/logs/periodic-kubevirt-e2e-k8s-1.32-sig-compute/2001087575657287680

• (19): https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/logs/periodic-kubevirt-e2e-k8s-1.32-sig-compute/2000483584149819392

• added to (existing)  https://github.com/kubevirt/kubevirt/issues/15791

• remainder attributed to quarantined tests

• 109 periodic-kubevirt-e2e-k8s-1.33-sig-compute

• ~100 attributed to quarantined tests

• 101 periodic-kubevirt-e2e-k8s-1.34-sig-compute

• ~90 attributed to quarantined tests

• 91 pull-kubevirt-e2e-k8s-1.34-sig-compute-serial

• clustered failure: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/directory/pull-kubevirt-e2e-k8s-1.34-sig-compute-serial/2000849175889055744

• added to (existing) https://github.com/kubevirt/kubevirt/issues/16084

• 43 pull-kubevirt-e2e-k8s-1.33-sig-operator

• clustered failure: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/directory/pull-kubevirt-e2e-k8s-1.33-sig-operator/1999186697576779776

• added to (existing) https://github.com/kubevirt/kubevirt/issues/16036

• 22 periodic-kubevirt-e2e-k8s-1.34-sig-compute-np

• clustered failure: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/logs/periodic-kubevirt-e2e-k8s-1.34-sig-compute-np/1996472173815926784

• recorded previously here https://github.com/kubevirt/kubevirt/issues/16320

• dequarantine tests:

• look at list of quarantined tests

• 14 tests in quarantine currently
  

• check status, i.e. who is working on those

• look at PRs that want to fix flakes

• see whether we can dequarantine tests 

• cross ns migration might be fixed by this PR: https://github.com/kubevirt/kubevirt/pull/16333

• Adi didn’t confirm whether that PR would help fix the flakiness

• [dhiller] created test PR: https://github.com/kubevirt/kubevirt/pull/16368

• misc topics

• 
  

Action items

• 
  
• 

  update/create issues with latest flakes spotted

• 

  communication

• send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)

--

Kind regards,

Daniel Hiller

He / Him / His

Principal Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty