[JIRA] (JENKINS-59891) Possibility to select whether to show test case as passed or failed if there are multiple test cases with same name

2 views
Skip to first unread message

sami.sallmen@gmail.com (JIRA)

unread,
Oct 22, 2019, 11:57:03 AM10/22/19
to jenkinsc...@googlegroups.com
Sami Sallmen created an issue
 
Jenkins / Improvement JENKINS-59891
Possibility to select whether to show test case as passed or failed if there are multiple test cases with same name
Issue Type: Improvement Improvement
Assignee: Varun Menon
Components: test-results-analyzer-plugin
Created: 2019-10-22 15:56
Environment:  test-results-analyzer-plugin version 0.3.5
Priority: Minor Minor
Reporter: Sami Sallmen

Currently if there are multiple executions of the same test case (same test case class and name in jUnit XML) the test case is shown only once in the analyzer view as FAILED if even one of the executions is failed. In many cases that is ok but in some cases I would like to show it as passed, if even one of the executions is passed.

My use case for such case is that I run one test case few times because of some lag in the system, which is causing the test to fail. I stop running the test either when I have run it x times, or when it passes, which ever comes first, and I am happy if it passed the last time. For test analysis purposes I am anyhow recording every test case execution to the jUnit XML. Thus, in my case it would also be sufficient solution to be able to configure the plugin to show only the status of the last execution, instead of marking it as passed if the case has passed even once.

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages