Build bots, smoke servers & Smolder

0 views
Skip to first unread message

Michael G Schwern

unread,
Jun 6, 2009, 4:16:04 AM6/6/09
to makemaker, test-mo...@googlegroups.com
This MakeMaker release has several totally avoidable bugs. The most odious of
which is that it won't pass tests on a clean 5.8.8. This was present in
6.51_03 and 6.51_04. Nobody caught it. It also clearly fails on VMS, again
present in several alphas. On top of that it busts building bleadperl on
Windows and VMS. Now I need to spend the weekend fixing these bugs.

Clearly its past time I got an automated smoke server. MakeMaker and
Test::More both need build bots that can pull from git, smoke servers of
various interesting OS' and a Smolder instance to send the results to.

I have a full time job now so my time to work on all this is limited, and I've
got a week and a half before a block of speaking engagements kicks off. And I
just wasted tonight unexpectedly rewriting my DSL. If someone could do this,
set up smoke bots [1] and smolder system running off the github repositories,
that would be a huge help!


[1] Keep it simple, it ideally has to work on Unix, Windows and VMS.

--
<Schwern> What we learned was if you get confused, grab someone and swing
them around a few times
-- Life's lessons from square dancing

Nicholas Clark

unread,
Jun 6, 2009, 5:38:52 AM6/6/09
to Michael G Schwern, makemaker, test-mo...@googlegroups.com
On Sat, Jun 06, 2009 at 01:16:04AM -0700, Michael G Schwern wrote:
> This MakeMaker release has several totally avoidable bugs. The most odious of
> which is that it won't pass tests on a clean 5.8.8. This was present in
> 6.51_03 and 6.51_04. Nobody caught it. It also clearly fails on VMS, again
> present in several alphas. On top of that it busts building bleadperl on
> Windows and VMS. Now I need to spend the weekend fixing these bugs.

> just wasted tonight unexpectedly rewriting my DSL. If someone could do this,


> set up smoke bots [1] and smolder system running off the github repositories,

It sounds like pretty much the same task as the CPAN testers already enjoy
doing. Clearly they are motivated - are they the right people to ask?

But what surprises me is that you released 6.51_03 and 6.51_04 as alphas to
CPAN, and some smokers tested them:

http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.51_04
http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.51_03

All pass. There are passes on 5.8.8.

6.52 itself only has passes on 5.8.8:

http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.52

So how do the smokers' systems differ from the clean 5.8.8 that it won't pass
tests on?

Nicholas Clark

Michael G Schwern

unread,
Jun 6, 2009, 2:21:43 PM6/6/09
to makemaker, test-mo...@googlegroups.com
Nicholas Clark wrote:
> On Sat, Jun 06, 2009 at 01:16:04AM -0700, Michael G Schwern wrote:
>> This MakeMaker release has several totally avoidable bugs. The most odious of
>> which is that it won't pass tests on a clean 5.8.8. This was present in
>> 6.51_03 and 6.51_04. Nobody caught it. It also clearly fails on VMS, again
>> present in several alphas. On top of that it busts building bleadperl on
>> Windows and VMS. Now I need to spend the weekend fixing these bugs.
>
>> just wasted tonight unexpectedly rewriting my DSL. If someone could do this,
>> set up smoke bots [1] and smolder system running off the github repositories,
>
> It sounds like pretty much the same task as the CPAN testers already enjoy
> doing. Clearly they are motivated - are they the right people to ask?

Yes. I wouldn't be surprised if Bingos is marshaling his inexhaustible army
of smokers right now. I need something beyond smoke-after-release to let
MakeMaker do TDD. I guess I should forward this on to them.


> But what surprises me is that you released 6.51_03 and 6.51_04 as alphas to
> CPAN, and some smokers tested them:
>
> http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.51_04
> http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.51_03
>
> All pass. There are passes on 5.8.8.
>
> 6.52 itself only has passes on 5.8.8:
>
> http://matrix.cpantesters.org/?dist=ExtUtils-MakeMaker+6.52
>
> So how do the smokers' systems differ from the clean 5.8.8 that it won't pass
> tests on?

It looks like they all have an upgraded ExtUtils::Install, which one would
have if they've installed MakeMaker lately. None are clean builds (I can't
tell for most of Bingos' as they aren't reporting deps).

I would guess this is because individual smokers simply installed the alphas
in a CPAN shell with a dirty 5.8.8 rather than running them through a full
clean smoke, which is about all I can expect. It looks like Bingos ran a few
through a real smoke run so I don't know what happened there.


--
101. I am not allowed to mount a bayonet on a crew-served weapon.
-- The 213 Things Skippy Is No Longer Allowed To Do In The U.S. Army
http://skippyslist.com/list/

Reply all
Reply to author
Forward
0 new messages