TestNG testng-failed.xml 'invocation-numbers' values are not calculated correctly with retry and dataproviders?

33 views
Skip to first unread message

Zoltán Gyimóthi

unread,
Sep 24, 2024, 2:58:58 PMSep 24
to testng-users
Hi All,

Thank you in advance for your time on the following problem.

I am trying to understand the behaviour of generating the testng-failed.xml file when we are using dataproviders and retry mechanizm.

In short: When running a test with dataprovider and retries, if a test for a certain given data-provider value eventually passes after a retry, it still gets generated in the testng-failed.xml if that method has a failed invocation (after all retries) with a different value.

I have posted some code in StackOverflow, please check it for clarification:

Thank you for your insights on this topic in advance.

Best regards,
Zoltan

⇜Krishnan Mahadevan⇝

unread,
Oct 1, 2024, 1:48:05 AMOct 1
to testng...@googlegroups.com
Zoltan,

I believe you had filed this as an issue at https://github.com/testng-team/testng/issues/3180

This is now fixed and the fix is available in master branch and should be available in the next upcoming release of TestNG (7.11.0)


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/
My Technical Scribblings @ https://rationaleemotions.com/


--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/testng-users/5bf57663-a695-4a74-808e-8b1e853090cfn%40googlegroups.com.

Zoltán Gyimóthi

unread,
Oct 1, 2024, 2:41:28 AMOct 1
to testng...@googlegroups.com
Hi Krishnan,

Thank you for your kind support, and I am really happy with the quick and timely fix for this issue.
Do you have any estimates when the 7.11.0 version will be  actually released?

Best regards,
Zoltán

Krishnan Mahadevan

unread,
Oct 1, 2024, 3:59:11 AMOct 1
to testng...@googlegroups.com
Am hoping that we could fix a few more issues and include them as part of 7.11.0. 

So maybe first week of November perhaps? 


Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

From: testng...@googlegroups.com <testng...@googlegroups.com> on behalf of Zoltán Gyimóthi <gyi...@gmail.com>
Sent: Tuesday, October 1, 2024 12:10:38 PM
To: testng...@googlegroups.com <testng...@googlegroups.com>
Subject: Re: [testng-users] TestNG testng-failed.xml 'invocation-numbers' values are not calculated correctly with retry and dataproviders?
 

Zoltán Gyimóthi

unread,
Oct 1, 2024, 4:01:42 AMOct 1
to testng...@googlegroups.com
Cool, looking forward to it.

Thanks once again,
Zoltán

Reply all
Reply to author
Forward
0 new messages