If you have job that history is kept let say for 14 days and it was never been green the "Test Statistics Grid" shows all in "0" and "0%" including total as 0 tests
If you have job that history is kept let say for 14 days and it was never been green the "Test Statistics Grid" shows all in "0" and "0%" including total as 0 tests
If you have job that history is kept let say for 14 days and it was never been green the "Test Statistics Grid" shows all in "0" and "0%" including total as 0 tests
I tested again with version 2.9.9 Unfortunately the problem still exists - Failed tests form test sets that never passed are not included in the chart http://screencast.com/t/orRVRGU53
I tested again with version 2.9.9 Unfortunately the problem still exists - Failed tests form test sets that never passed are not included in the chart http://screencast.com/t/orRVRGU53
What plugin are you using to run/tabulate the test statistics? The Dashboard view is pretty dumb; it just reports whatever the test result actions from the plugin report. I can try and confirm/diagnose, but I'd like to make sure I replicate your environment.
Not sure what you are asking, but I am using simple dashboard view with Test Statistics Chart and Test Trend Chart Whenever there is a NA in "Last Success" column the result of this test set is ignored in Test Statistics Chart.
However it is important to note that Test Trend Chart (seems to) show correctly the number of failing test. This is strange since I would expect that trend chart uses same data as pie chart but shows them over time.
Definitely agree that it looks like something is wonky. Can you throw the "Test Statistics Grid" up on your dashboard, and show me the result of that? It shows all the individual jobs being tallied up, and that might help diagnose the issue. I don't see anywhere in the code where there should be an issue specific to never-passed jobs, so I'd like to try and get more data.
Regarding the Grid, what type of tests are being published? I fixed an issue with the TAP plugin where it wasn't publishing its results in a way that the grid liked. I'd recommend opening a separate defect report for that one, tied to whatever test tool is trying to publish results. You can reference https://issues.jenkins-ci.org/browse/JENKINS-22016 which was the fix for the TAP plugin.
Definitely agree that it looks like something is wonky. Can you throw the "Test Statistics Grid" up on your dashboard, and show me the result of that? It shows all the individual jobs being tallied up, and that might help diagnose the issue. I don't see anywhere in the code where there should be an issue specific to never-passed jobs, so I'd like to try and get more data.
UPDATE: I went through your latest screenshot, and it doesn't look like the "successful" tests for those two jobs are being included in the chart either. Is there anything special about those jobs? What plugin is publishing those test results?