Testing against different Spec versions, how to do it?

[Philippe Hennes]

Hi,

when we go on with enhancing the testsuite, we should have a mechanism
to test against different versions of the same spec (that is I guess a
valid scenario for W3C, PhoneGap, WAC/JIL and others I guess).
As from version to version of a spec the bigger amount of tests itself
will most likely not change, but single tests need to be adopted, it
would be nice to do this by configuration for the Ant script.
i.e.: Having a base config which describes the build targets:

html5 : [Test_ID1, Test_ID2, Test_ID3,...];
W3C_HTML5_ED1 : [Test_ID7, Test_ID11, ...];
W3C_HTML5_WD2 : [Test_ID8, Test_ID11, ...];

WAC_1.2.2 : [Test_ID33, Test_ID47, "W3C_HTML5_ED1"]

The test ID would rerlate to specific tests inside a testset and would
be analysed while runtime.

We would get a flexible sokution for users to build whether specific
sets needed for their current testenvironment and would have a kind of
history with this configration.

Old Testsets can simply be outcommented while the latest tests are
default and always ready to be build.

What do you thinks?

Cheers
Philippe