[JIRA] (JENKINS-58960) Test Result Trend chart not showing on Multibranch Pipeline branch if last build has no test results

17 views
Skip to first unread message

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:23:03 AM8/16/19
to jenkinsc...@googlegroups.com
Edgars Batna created an issue
 
Jenkins / Bug JENKINS-58960
Test Result Trend chart not showing on Multibranch Pipeline branch if last build has no test results
Issue Type: Bug Bug
Assignee: Nikolas Falco
Components: xunit-plugin
Created: 2019-08-16 08:22
Environment: Windows Server
Jenkins 2.189
Latest plugins
Labels: test-statistics-graph
Priority: Minor Minor
Reporter: Edgars Batna

I'm not sure if this a problem in xUnit plugin. We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:

stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:23:03 AM8/16/19
to jenkinsc...@googlegroups.com
Edgars Batna updated an issue
Change By: Edgars Batna
I'm not sure if this is a problem in xUnit plugin.   Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}

stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}

The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:23:03 AM8/16/19
to jenkinsc...@googlegroups.com
Edgars Batna updated an issue
I'm not sure if this is a problem in xUnit plugin. We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:

{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests.

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:25:02 AM8/16/19
to jenkinsc...@googlegroups.com

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:25:02 AM8/16/19
to jenkinsc...@googlegroups.com
Edgars Batna updated an issue
I'm not sure if this is a problem in xUnit plugin. Please reassign this as required.

We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

mdealer@gmail.com (JIRA)

unread,
Aug 16, 2019, 4:25:03 AM8/16/19
to jenkinsc...@googlegroups.com
Edgars Batna updated an issue
I'm not sure if this is a problem in xUnit or pipeline multibranch plugin. Please reassign this as required.


We've got a Multibranch Pipeline project and we upload various test results using the xUnit plugin. It's somewhat like this:
{code:java}
stage("Reachable stage") {
    if (some condition)
        return; // Skip all subsequent stages. This appears to cause the problem.
}
stage("Potentially failing or unreachable stage") {
    try
    {
        // This might fail and abort consequent stages.
    }
    finally
    {   // We still want all tests and artifacts that we can get, but we only care for artifacts whose unit tests were executed.
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'unittests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
        archiveArtifacts artifacts: '...', defaultExcludes: false
        xunit testTimeMargin: '2000', thresholdMode: 1, thresholds: [skipped(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0'), failed(failureNewThreshold: '0', failureThreshold: '0', unstableNewThreshold: '0', unstableThreshold: '0')], tools: [xUnitDotNet(deleteOutputFiles: true, failIfNotNew: false, pattern: 'boxtests.xml', skipNoTestFiles: false, stopProcessingIfError: true)]
    }
}
stage("Potentially unreachable stage") {
}

{code}
The trend chart shows up when builds fail with or without tests or succeed with tests, but the chart disappears when the build skips stages which record the tests. To be entirely honest, I'm not sure what the current behavior is exactly (it's inconsistent).

This should be fixed. As long as there are test results in any builds at all, they should be displayed regardless of test results in the latest build.

nfalco79@hotmail.com (JIRA)

unread,
Aug 16, 2019, 4:56:02 AM8/16/19
to jenkinsc...@googlegroups.com

nfalco79@hotmail.com (JIRA)

unread,
Aug 16, 2019, 4:57:03 AM8/16/19
to jenkinsc...@googlegroups.com

nfalco79@hotmail.com (JIRA)

unread,
Aug 16, 2019, 4:57:04 AM8/16/19
to jenkinsc...@googlegroups.com

nfalco79@hotmail.com (JIRA)

unread,
Aug 16, 2019, 4:58:01 AM8/16/19
to jenkinsc...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages