Build.joomla.com discrepency

[garyamort]

According to:  http://build.joomla.org/job/platform/670/testReport/?

There are 2295 tests, 0 failures, and 0 skipped 

According to: http://build.joomla.org/job/platform/670/console

There are  3233 tests 0 failures, 659 incomplete, and 279 skipped

So which number is currently correct?

[brian teeman]

 

3233 - 659 - 279 = 2295

[garyamort]

On Sunday, March 25, 2012 5:13:44 PM UTC-4, brian teeman wrote:

 

3233 - 659 - 279 = 2295

So shouldn't the results be:

2576 tests, 0 failures, and 279 skipped ?

Or are there different definitions for skipped? 

[Amy Stephen]

Gary -

I get the 2nd set of 3233 tests when I run unittests locally on current framework.

I think they are working on getting jools running again - the two sets of values might be related to that. (?)

Time: 20 seconds, Memory: 153.00Mb

OK, but incomplete or skipped tests!
Tests: 3233, Assertions: 4894, Incomplete: 650, Skipped: 307.
Amy-Stephen:joomla-platform amystephen$

[Ian]

Yeah, it is the difference between the tally report in PHPUnit and the way that the xUnit parser in Jenkins parses the report.  So basically two different organizations (Sebastian Bergmann and PHPUnit vs whoever wrote the xUnit parser from the Jenkins crew).

Ian