Running cxx tests in random order, repeatedly, overnight

[theo...@verific.com]

We are having great success with CxxTest, to the extent that the repeated setUp() and tearDown() of many tests may be showing something interesting...

We would consequently like to run the set of tests we have repeatedly, overnight, in some random order.

Ideally, the CxxTest executable would read from stdin and we would ask for the set of tests, then repeatedly ask for some specific test to be run.

In this way little to no changes to the CxxTest framework would occur but the overnight test would be some python that interacts with CxxTest,

Currently we have this test_runner behavior--

prompt> ./unittest UtilsTest testReplaceSameSuffix
Running cxxtest tests (1 test).OK!
prompt>

Something as per the below test_runner behavior may be ideal--

prompt> ./unittest -interactive
UtilsTest testReplaceSameSuffix
Running cxxtest tests (1 test).OK!
UtilsTest testReplaceSameString
Running cxxtest tests (1 test).OK!
UserAttributeNormalSuite testAttributesClearedByInit
Running cxxtest tests (1 test).OK!
exit
prompt>

Best regards,

Theodore

[theo...@verific.com]

The features below are apparently available on the newer versions of cxx_test.