Regression testing

[Jay Hannah]

Looks like I have some basic regression testing in place now:

http://jays.net/wiki/ChemChains_sandbox#Regression_Testing

Current result set below.

So far I'm running each C++ version of ChemChains (using
sampleNet.txt, sampleSpecs.txt)

tarballs/ChemChains1.0_clean
svn/branches/CC1_0-rc1
svn/branches/MathbioRelease
svn/trunk

And testing its output against the ChemChains1.0_clean output. Looks
like CC1_0-rc1 and trunk match, but MathbioRelease does not. This
seems to indicate that MathbioRelease is not currently backward
compatible to ChemChains1.0_clean, which I assume is considered a bug.

Now that I have a test suite, I can start whipping perl/ into shape,
if it's broken. :)

(All my commits were accidentally as odynug. Sorry about that.)

Cheers,

j

$ prove -r 2>/dev/null
TAP/000_mkdir..............ok
TAP/CC1_0-rc1..............ok
TAP/ChemChains1.0_clean....ok
TAP/MathbioRelease.........FAILED tests 3-5, 7-9, 11-13, 15-17,
19-21, 23-25, 27-29, 31-33, 35-37, 39-41, 43-45, 47-49, 51-53, 55-57,
59-61, 63-65, 67-69, 71-73, 75-77, 79-81, 83-85, 87-89, 91-93, 95-97, 99
Failed 73/99 tests, 26.26% okay
TAP/trunk..................ok
Failed Test Stat Wstat Total Fail List of Failed
------------------------------------------------------------------------
-------
TAP/MathbioRelease.t 99 73 3-5 7-9 11-13 15-17 19-21
23-25 27-
29 31-33 35-37 39-41
43-45 47-49
51-53 55-57 59-61 63-65
67-69 71-73
75-77 79-81 83-85 87-89
91-93 95-97
99
Failed 1/5 test scripts. 73/399 subtests failed.
Files=5, Tests=399, 1 wallclock secs ( 0.60 cusr + 0.17 csys =
0.77 CPU)

[Tomas Helikar]

Great! MathbioRelease is not currently compatible with rc1, but we're working on it.

Tom