2025-09-17 sig-ci quarantine catch-up - notes
Daniel Hiller
When: Weekly on Wed, 9:45 – 10:15am
Attendees: dhiller, ndothan, brianmcarey, fossedihelm
Topics:
[urgent]
previous action items
state of existing issues: https://github.com/kubevirt/kubevirt/issues?q=is%3Aissue+is%3Aopen+label%3Akind%2Fflake+sort%3Aupdated-asc+label%3Asig%2Fci
[non-urgent]
[dhiller] update dequarantine section in the kubevirt docs: https://github.com/kubevirt/kubevirt/pull/15636
[ndothan] Why is (Istio Bump) https://github.com/kubevirt/kubevirtci/pull/1535 still breaking?
[bc] strange that there’s still 1.24.4 seen in the log: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/pull/kubevirt_kubevirtci/1535/check-provision-k8s-1.34/1967613707575889920#1:build-log.txt%3A2139
[bc] mirror job needs approval: https://github.com/kubevirt/project-infra/pull/4375
Look at flakes
flake stats - create issues accordingly
count: 663 failures
periodic sig-operator on 1.34 shows clustered failures: https://testgrid.k8s.io/kubevirt-periodics#periodic-kubevirt-e2e-k8s-1.34-sig-operator&width=20
periodic sig-compute lanes all show failures around 70-80: example: https://testgrid.k8s.io/kubevirt-periodics#periodic-kubevirt-e2e-k8s-1.34-sig-compute&width=20
largely caused by the Prometheus tests that are in quarantine
long-standing issue (open since Oct 2024!)
pull-sig-compute-1.34 also shows a clustered failure: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/directory/pull-kubevirt-e2e-k8s-1.34-sig-compute/1967533321894236160
seems to have been caused by harmful PR, which was closed
dequarantine tests:
look at list of quarantined tests
tests in quarantine currently
check status, i.e. who is working on those
look at PRs that want to fix flakes
see whether we can dequarantine tests
misc topics
Action items
Daniel Hiller mirror job needs approval: https://github.com/kubevirt/project-infra/pull/4375
update/create issues with latest flakes spotted
communication
send meeting notes to kubevirt-dev, bcc sig people for spotted flakes (include meeting changes for upcoming instances)
Kind regards,
Daniel Hiller
He / Him / His
Principal Software Engineer, KubeVirt CI, OpenShift Virtualization
 |
Red Hat GmbH, Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany Commercial register: Amtsgericht Muenchen/Munich, HRB 153243, Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty