Overview of quarantined tests for kubevirt/kubevirt

[Daniel Hiller]

Hi everyone,

we now have an overview page of quarantined tests [1] for kubevirt/kubevirt, which is updated on a daily basis. This page is sorted by time spent in quarantine descending.

Now, when you look at the page you will notice that there's a couple of tests that are already in quarantine for quite some time. Background: quarantine effectively means that they are not run during the presubmit phase, so they are not merge-gating.

Now I would like to ask two questions:

* did we either just drop the ball on those and need to pick up the work to make them non flaky (which was the reason why they were put in quarantine) or

* don't we need those any more, since noone was actively working on bringing them back to the set of gating tests?

I understand that those questions might sound provocative. To be clear: this is not my intent at all. I am just asking for others memory on these.

Anyhow still the problem stands that a test in quarantine should either be removed or fixed. So if you can, please help shed some light here.

Thanks!

[1] https://storage.googleapis.com/kubevirt-prow/reports/quarantined-tests/kubevirt/kubevirt/index.html
--

Kind regards,

Daniel Hiller

He / Him / His

Senior Software Engineer, KubeVirt CI, OpenShift Virtualization

Red Hat

dhi...@redhat.com   

Red Hat GmbH, Registered seat: Werner-von-Siemens-Ring 12, D-85630 Grasbrunn, Germany  
Commercial register: Amtsgericht München/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Michael O'Neill, Amy Ross 

[Luboslav Pivarc]

Hi Daniel,

I believe all of these tests are still relevant and I know that we work on few of those.

I will personally have a look at the one related to vgpu. Anyone let me know if you need help with any of those that are left.

-Lubo

--
You received this message because you are subscribed to the Google Groups "kubevirt-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kubevirt-dev...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/kubevirt-dev/CAK%2BeyL6FQaOm7ejwKkrYGptoQrrrYrF7mSckSKH%3DVz3kY3UfEA%40mail.gmail.com.

[Daniel Hiller]

Hi Lubo,

On Fri, Apr 28, 2023 at 1:55 PM Luboslav Pivarc <lpi...@redhat.com> wrote:

Hi Daniel,

I believe all of these tests are still relevant and I know that we work on few of those.

I will personally have a look at the one related to vgpu. Anyone let me know if you need help with any of those that are left.

thanks for your answer. I have taken a look at the test status myself, it seems like we can take two tests in directly, thus I have created a PR for it [1]

[1] https://github.com/kubevirt/kubevirt/pull/9719

--

-- 

Best,

Daniel