Switching Thunderbird's automated MozMill tests to require version 1.3 or later - Tuesday 9th 07:00 PST
Mark Banner
MozMill 1.2 due to the harness having been written against that version.
We're now setting up to deploy MozMill to our production boxes, and as
part of that we'd like to upgrade to MozMill 1.4. This means we must
upgrade our test harness [1] and unfortunately this would be complicated
to make it backwards compatible with 1.2.
Therefore the new requirement will be for MozMill 1.3 or later (there
were mainly backend changes between 1.3 and 1.4, however I would
recommend all developers pick up 1.4).
We are planning on landing the revised test harness and upgrading
MozMill on our staging boxes [2] on Tuesday 9th at around 07:00 - 09:00 PST.
The Thunderbird tree will be closing whilst we do the upgrade so we can
compare results before and after.
Once we confirm the upgrade is stable, we'll be deploying MozMill on the
production boxes. At the moment we'll most likely just deploy on Windows
and Mac as we still have some persistent failures on Linux.
To install the latest version of MozMill you can run
# easy_install -U MozMill
If you want to ensure you get the specific versions that we'll be
running on the builders, follow the instructions on the build wiki page
[3] (these will be copied to the Thunderbird MozMill page [4] when we do
the upgrade).
If there's any reason we shouldn't go ahead with this upgrade, please
let us know.
I'll post again when we do the upgrade and have updated the docs.
Standard8
[1] https://bugzilla.mozilla.org/show_bug.cgi?id=533246
[2] http://tinderbox.mozilla.org/ThunderbirdTest/
[3]
https://wiki.mozilla.org/Thunderbird/Infrastructure/Builder_Installations#MozMill
[4] https://developer.mozilla.org/en/Thunderbird/Thunderbird_MozMill_Testing
Dan Mosedale
> Once we confirm the upgrade is stable, we'll be deploying MozMill on
> the production boxes. At the moment we'll most likely just deploy on
> Windows and Mac as we still have some persistent failures on Linux.
>
> To install the latest version of MozMill you can run
>
> # easy_install -U MozMill
are they likely to have problems running tests locally?
Also, do I recall correctly that this change will actually break a few
Linux tests that are currently working, but that we've decided that's a
reasonable tradeoff?
Dan
Siddharth Agarwal
> If folks upgrade MozMill before the production changes land on Tuesday,
> are they likely to have problems running tests locally?
Yes. They can apply the patch in the bug locally as a workaround.
>
> Also, do I recall correctly that this change will actually break a few
> Linux tests that are currently working, but that we've decided that's a
> reasonable tradeoff?
No, I'm not aware of any tests breaking due to Mozmill 1.4. Perhaps you
were referring to Mozilla versions? (1.9.1 is green, trunk is persistent
orange)
Mark Banner
> On 2/4/10 8:23 AM, Mark Banner wrote:
>> Once we confirm the upgrade is stable, we'll be deploying MozMill on
>> the production boxes. At the moment we'll most likely just deploy on
>> Windows and Mac as we still have some persistent failures on Linux.
>>
>> To install the latest version of MozMill you can run
>>
>> # easy_install -U MozMill
> If folks upgrade MozMill before the production changes land on Tuesday,
> are they likely to have problems running tests locally?
Yes, if folks upgrade it will break them. Applying the patch from
https://bugzilla.mozilla.org/show_bug.cgi?id=533246 will let them run
with 1.4 (or 1.3).
> Also, do I recall correctly that this change will actually break a few
> Linux tests that are currently working, but that we've decided that's a
> reasonable tradeoff?
I haven't heard anything about that. The only think I heard about was
asuth was having some issues somewhere and 1.4 didn't resolve them (or
make them worse).
In any case, I think getting MozMill upgraded before we roll out to
production will save us extra hassle and as we need to do this upgrade
at some stage.
Standard8
Siddharth Agarwal
> Once we confirm the upgrade is stable, we'll be deploying MozMill on the
> production boxes. At the moment we'll most likely just deploy on Windows
> and Mac as we still have some persistent failures on Linux.
Note that we still have some random oranges, especially on Windows.
<https://bugzilla.mozilla.org/show_bug.cgi?id=tbmozmillorange> tracks
the failures -- please file bugs if you see any failures not already filed.