Problems upgrading to testNG 6.14.3

[PerfectStorm]

We are trying to upgrade from testng 6.9.4 to 6.14.3 and we are running into issues where all tests do not running and the suite just stops. I have determined that the issue causing this to happen is we have group-by-instances="true" set in our suite file. If I remove this all tests will run but I get a large amount of failures because the tests are running the the @afterClass out of order. An example below

Currently are tests run like this

@BeforeSuite

@BeforeClass

@Test

@AfterClass

@BeforeClass

@Test

@AfterClass

@AfterSuite

When I remove group-by-instances="true" it now runs like this

@BeforeSuite

@BeforeClass

@Test

@BeforeClass

@Test

@AfterClass

@BeforeClass

@Test

@AfterClass

@AfterSuite

It is not honoring the @AfterClass in the same class

It seems whatever changed the behavior of what worked before for us was in 6.9.5. I tried upgrading to that and I saw the same issue

Some other info

We run the tests by using a regular expression on the package <package name="com.XXXXXX.XXXXXX.restapi.tests.*"> so we only have this one line in our suite file to run all of our tests

All tests extend one base test class which has the @BeforeSuite and @afterSuite in it

Any Thoughts of what could have changed this behavior in 6.9.5?

[PerfectStorm]

One other thing if I run in Eclipse by selecting the package it seems to work fine. It is when I run via the testng.xml with all tests included I run into this problem

[Krishnan Mahadevan]

John,

 

Please help share a full-fledged test sample that can be used to reproduce the issue.

 

Thanks & Regards

Krishnan Mahadevan

 

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"

My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribbings @ http://rationaleemotions.wordpress.com/

Reply-To: <testng...@googlegroups.com>
Date: Monday, March 12, 2018 at 10:00 PM
To: testng-users <testng...@googlegroups.com>
Subject: [testng-users] Re: Problems upgrading to testNG 6.14.3

--
You received this message because you are subscribed to the Google Groups "testng-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to testng-users...@googlegroups.com.
To post to this group, send email to testng...@googlegroups.com.
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[Rajitha Nyalakanti]

Any update on this issue. I did see this when I run all tests in the suite.

To unsubscribe from this group and stop receiving emails from it, send an email to testng-users+unsubscribe@googlegroups.com.

To post to this group, send email to

testng...@googlegroups.com.
Visit this group at https://groups.google.com/group/testng-users.
For more options, visit https://groups.google.com/d/optout.

[⇜Krishnan Mahadevan⇝]

What update are you expecting? If you are also experiencing the same issue, please help share a sample project that we can use to reproduce the issue and debug.

Thanks & Regards
Krishnan Mahadevan

"All the desirable things in life are either illegal, expensive, fattening or in love with someone else!"
My Scribblings @ http://wakened-cognition.blogspot.com/

My Technical Scribblings @ http://rationaleemotions.wordpress.com/