occasional test suite failure in GroupsTest

[marcusb]

Hi,

when building TestNG 5.8 from svn, I get an occasional test failure in
a Regression2 test:

<testcase name="verifyBothAfterGroups" time="0.019"
classname="test.configuration.GroupsTest">
<failure type="java.lang.AssertionError" message="null: lists
don&apos;t have the same size expected:&lt;8&gt; but was:&lt;7&gt;">
<![CDATA[java.lang.AssertionError: null: lists don't have the
same size expected:<8> but was:<7>
at test.configuration.GroupsTest.runTest(GroupsTest.java:54)
at test.configuration.GroupsTest.verifyBothAfterGroups
(GroupsTest.java:41)
... Removed 28 stack frames]]>
</failure>
</testcase>

Any ideas why? I'm building on a Debian amd64 system with OpenJDK 6.

Cheers,

Marcus

[Cédric Beust ♔]

Hi Marcus,

The tests pass consistently for me.  There might be a bug in this particular class, but since you are using a 64 bits *and* OpenJDK, I would start looking in this direction first.  Can you pare down this test and make it fail consistently?

-- 

Cédric