We have been struggling with keeping our test grids green and it has a bunch of consequences for everything including releases.
For example, here's a list of jobs that are currently RED for a while now (opened yesterday!) :
This is not a new problem and sig-testing has been trying to think about this, see:
We also have the reliability KEP that wants to help push folks to do better:
For now this is a request for action from sig chairs and leads to look for things under their SIG that they want to clean up one way or another, by fixing issues or removing the unnecessary CI jobs. Look through these json files to start:
Please prioritize this work! We should use the 2 weeks (the 1.24 pushed out) to clean up our house. If you need help, please come to sig-testing.