Get failing tests related to a maven build in a pipeline script?

[Vincent Massol]

Hi guys,

I know how to get the failing tests for a job with:

AbstractTestResultAction testResultAction = currentBuild.rawBuild.getAction(AbstractTestResultAction.class)
def failedTests = testResultAction.getResult().getFailedTests()

However, my pipeline job is executing Maven several times. 

Is there a simple way to do this or do I need to save the failing tests in a variable after each maven execution to compute the new failing tests?

Thanks

-Vincent

[Victor Martinez]

What about this: https://groups.google.com/d/msg/jenkinsci-dev/hI3aSyayYxQ/txGte6HQAAAJ ? Not sure whether the failureDiffString method might help you in this case.

Cheers

[Vincent Massol]

Thanks Victor. Not sure how failureDiffString would help. The issue is that this returns the failures from all past maven executions and not just for the last run.

FTM I've done this but it's overly complex and it would be nice to be able to get the failed tests related only to the last maven execution:

https://github.com/xwiki/xwiki-jenkins-pipeline/commit/cd1ed55e12b22f3957ee1a6e099686461886350b

Note that I have to go through a global env variable to save the previous state and compare.

Thanks

-Vincent

[Vincent Massol]

Actually my code won't work. Just realized that 'env' can only store Strings. Thus I need a way to have some global variable shared between calls to my scripted pipeline library... Any idea?

[Vincent Massol]

And the solution is simpler, I just need to save the failing tests before the maven execution and compare with the full list of failing tests I get after that maven execution:

https://github.com/xwiki/xwiki-jenkins-pipeline/commit/1bce23c511fa04a1b26ae012f198c9b99049a100

Thanks

-Vincent

[Vincent Massol]

Well, it doesn't work...

The issue is because we use parallel() step and thus we have several maven runs starting in parallel. So they start with empty failing tests but one of them can contribute failing tests to the others since all failing tests are accruing in currentBuild... :(

So I really need to find a way to identify how to get the failing tests for a given maven run...

Is there anything in CaseResult/TestResult would allow me to do this for example?

Any idea?

thanks

-Vincent