jUnit reports show false fails

[Milo Gertjejansen]

I have recently moved from jUnit to TestNG.

We are getting some false fails in some of our jUnit reports. If setup or teardown fails for one method it gets reported on in another method (in addition to method it should be reported in).

For example, the method TestOne.testOne() fails. A number of minutes later the BeforeMethod for TestTwo.testTwo() fails. In the jUnit reports for TestOne, you would see TestTwo.testTwo's BeforeMethod failure. In TestTwo's report you would see TestTwo.testTwo's BeforeMethod failure like normal.

Looking at the logs, TestOne failed for a legitimate reason but seems to be overwritten by TestTwo's fail in the jUnit reports.

Has anybody experienced this and, if so, was there anything you could do to fix it?

[Krishnan Mahadevan]

What version of TestNG are you working with ? Can you please try using TestNG 6.12 and see if the issue happens ?

If the issue happens, I would request you to please help file a bug in https://github.com/cbeust/testng/issues and add some sample that can be used to reproduce the problem.

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To post to this group, send email to testng...@googlegroups.com.
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Milo Gertjejansen]

I am not positive the version. I am using the selenium-standalone-server.jar, which has TestNG packaged in with it. I can switch to TestNG 6.12 though and report back.

[Krishnan Mahadevan]

AFAIK, the selenium standalone uber jar doesn’t come bundled with TestNG (not atleast the latest ones). What version of Selenium standalone are you on ? 3.5.3 is the latest.

[Milo Gertjejansen]

Ah possibly 2.53. I am looking in the VERSION.txt in the root of the jar.