[JIRA] [junit-plugin] (JENKINS-31187) Not all failure cases reported in JUnit test result report

[Adam.Beben@dysant.com (JIRA)]

Adam Beben created an issue

Jenkins / JENKINS-31187 Not all failure cases reported in JUnit test result report Issue Type: Bug Assignee: Unassigned Components: junit-plugin Created: 27/Oct/15 2:04 PM Environment: Jenkins ver. 1.619 JUnit Plugin ver. 1.9 Labels: junit plugin reporting results Priority: Minor Reporter: Adam Beben Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: ... <testcase classname="com.SomeTestClass" name="someTestName" time="7.718"> <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message at Some failure 1 stack trace... </failure> <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message at Some failure 2 stack trace... </failure> </testcase> ... From above snippet only "Some error 1 message" will be reported, junitResults.xml: <case> <duration>7.718</duration> <className>com.SomeTestClass</className> <testName>someTestName</testName> <skipped>false</skipped> <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message at Some failure 1 stack trace... </errorStackTrace> <errorDetails>Some error 1 message</errorDetails> <failedSince>0</failedSince> </case> Is it possible for JUnit Plugin to report all failures? Add Comment

This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)

[Adam.Beben@dysant.com (JIRA)]

Adam Beben updated an issue

Jenkins / JENKINS-31187 Not all failure cases reported in JUnit test result report

Change By: Adam Beben

Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this:

{code}

...   <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">     <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace... </failure>     <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace... </failure>   </testcase> ...

{code}

From above snippet only "Some error 1 message" will be reported, junitResults.xml:

{code}

<case>           <duration>7.718</duration>           <className>com.SomeTestClass</className>           <testName>someTestName</testName>           <skipped>false</skipped>           <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message at Some failure 1 stack trace... </errorStackTrace>           <errorDetails>Some error 1 message</errorDetails>           <failedSince>0</failedSince>         </case>

{code}

Is it possible for JUnit Plugin to report all failures?

Add Comment

[Adam.Beben@dysant.com (JIRA)]

Adam Beben updated an issue

Jenkins / JENKINS-31187 Not all failure cases reported in JUnit test result report Change By: Adam Beben

Hi, JUnit allows to collect multiple test failures, eg. using ErrorCollector rule. But JUnit Plugin reports only first failure. For example test result may looks like this: {code} ...   <testcase classname="com.SomeTestClass" name="someTestName" time="7.718">     <failure message="Some error 1 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace... </failure>     <failure message="Some error 2 message" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: Some error 2 message     at Some failure 2 stack trace... </failure>   </testcase> ... {code} From above snippet only "Some error 1 message" will be reported, junitResults.xml: {code}

...

<case>   <duration>7.718</duration>   <className>com.SomeTestClass</className>   <testName>someTestName</testName>   <skipped>false</skipped>   <errorStackTrace>junit.framework.AssertionFailedError: Some error 1 message     at Some failure 1 stack trace...   </errorStackTrace>   <errorDetails>Some error 1 message</errorDetails>   <failedSince>0</failedSince> </case>

..

{code} Is it possible for JUnit Plugin to report all failures?

Add Comment

[fun4jimmy@gmail.com (JIRA)]

James Whitworth commented on JENKINS-31187

Re: Not all failure cases reported in JUnit test result report Is this not being looked at because there are objections to modifying junit plugin to support multiple failures or just because it's low priority and there's no one available to do the work required?

Add Comment

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)

[fun4jimmy@gmail.com (JIRA)]

James Whitworth edited a comment on JENKINS-31187

Re: Not all failure cases reported in JUnit test result report

Is this not being looked at because there are objections to modifying junit the JUnit plugin to support multiple failures or just because it's low priority and there's no one available to do the work required?

Add Comment