Hudson Anyone?

[Tim Scott]

We use Hudson for CI, and most of our tests are in M-Spec. Obviously
I want to run M-Spec tests under the CI build and and have test
reports available via Hudson. What I have found is:

1) NUnit runner does not run M-Spec tests
2) MSpec runner does not output a report that Hudson can present

So I migrated my project from NUnit to Gallio in hopes I could use
Machine.Specifications.GallioAdapter.dll to make Gallio run the M-Spec
tests. I was hoping this would work especially because the Gallio
reports are so nice. I added a reference to the adapter in my test
project. I have not been able to make this work. I cannot find any
docs about how to use the adapter. I have seen comments that it is
not actively developed.

Is there any way to run M-Spec test and output reports that Hudson
likes? If GallioAdapter is the tool I need, how do I use it? Is
there some config I need to do? Is there some other way?

We're committed to both Hudson and M-Spec. If there is no current way
to make this work, I would be willing to lend a hand to build it. I
just need to be pointed in the right direction. Thanks.

[Aaron Jensen]

Hi Tim,

I'm not familiar with Hudson's requirements in this area. 

I think you're on with your analysis. The gallio adapter is not actively maintained. There is no output format for the command line runner for hudson. In short, there's no way to get what you want right now.

That said, you have two options:

1) Get the Gallio adapter up to speed. This is annoying because it's a moving target. It's probably stabilized a bit by now, but who knows how much work it will be.

2) Add hudson reporting to the command line runner. Recently, xml reporting was added to the runner for CC.NET I believe. Prior to that, TC reporting was added. There's plenty of precedent for this. It's less of a moving target. I'd probably prefer this approach, but I'd be fine with either.

Unfortunately, I'm not going to be able to dedicate much time in this area, but if you want to take it on I would be able to offer support. Plus I'd be thankful :) 

Aaron

--

You received this message because you are subscribed to the Google Groups "machine_users" group.
To post to this group, send email to machin...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/machine_users?hl=.

[Tim Scott]

Thanks for the quick reply. I tried kicking the around the Gallio
adapter. I can see this will be a lot of work just to grok Gallio
extensibility. I'm not up for that at present. Regarding #2, I think
the task would actually be writing a Hudson plugin to convert your XML
report to JUnit format. At least that's how the NUnit and Gallio
plugins work. I'm probably not up for that at present either. For
now, I think I will have to settle for outputting test results to the
console. :(

[Aaron Jensen]

Does hudson do artifacts? you can just output html and add the html to the artifacts.. or does hudson not work like that?