Thunderbird Automated MozMill tests now require version 1.3 or above.

[Mark Banner]

As mentioned in my earlier posting, we've proceeded with the MozMill
upgrade and have applied the patches to comm-central and comm-1.9.1.

This means you'll now need MozMill 1.3 or above to run the tests. We've
actually installed MozMill 1.4 on the builders, so that's what I
recommend you go with.

I've updated the installation instructions here:

https://developer.mozilla.org/en/Thunderbird/Thunderbird_MozMill_Testing

We haven't yet rolled this out to production. There may be an
intermittent crasher on windows, but I'm not completely sure whether
that is a result of the upgrade to 1.4 or something changing in
mozilla-central. What is clear is that I need to confirm the crash
handling is working as I think it should be.

We've also now got a new mac mini running on staging, though the early
results show a timeout on trunk, so we may need to do some debug there
as well to get mac going again.

I'll keep posting updates as we move forward.

Standard8

[Mark Banner]

On 09/02/2010 22:44, Mark Banner wrote:
> We haven't yet rolled this out to production. There may be an
> intermittent crasher on windows, but I'm not completely sure whether
> that is a result of the upgrade to 1.4 or something changing in
> mozilla-central. What is clear is that I need to confirm the crash
> handling is working as I think it should be.
>
> We've also now got a new mac mini running on staging, though the early
> results show a timeout on trunk, so we may need to do some debug there
> as well to get mac going again.

Quick update:

We've now got mac builders back again on staging (we're testing out the
new minis). There seems to be a persistent failure, but it could be an
issue with that box (it did strange things when we first started it!).

Windows is still looking stable, however there's been a couple of
timeouts where error dialogs have been thrown up. I believe these are
really crashes and they shouldn't have throw a dialog up. I thought we
had correct crash handling in place, but maybe not, so I'll be going
through the test harness and checking that we've got everything we
should have (and try and remember to document it).

Unfortunately I'm not going to have time to do that before the middle
next week, so this will be on hold until then.

Standard8

[Dan Mosedale]

On 2/11/10 2:02 AM, Mark Banner wrote:
> On 09/02/2010 22:44, Mark Banner wrote:
>> We haven't yet rolled this out to production.

> Unfortunately I'm not going to have time to do that before the middle
> next week, so this will be on hold until then.

Am I understanding the situation correctly, that the end-developer
effects are as follows:

* people pulling the tree and running mozmill tests by hand need 1.3 or
1.4, and
* the mozmill tests on the ThunderbirdTest page are in some undefined
state and shouldn't be trusted until next week?

Thanks,
Dan

[Mark Banner]

On 11/02/2010 17:15, Dan Mosedale wrote:
> On 2/11/10 2:02 AM, Mark Banner wrote:
>> On 09/02/2010 22:44, Mark Banner wrote:
>>> We haven't yet rolled this out to production.
>> Unfortunately I'm not going to have time to do that before the middle
>> next week, so this will be on hold until then.
> Am I understanding the situation correctly, that the end-developer
> effects are as follows:
>
> * people pulling the tree and running mozmill tests by hand need 1.3 or
> 1.4, and

Yes, as per the original post. That won't change now whatever happens.

> * the mozmill tests on the ThunderbirdTest page are in some undefined
> state and shouldn't be trusted until next week?

For Windows and Linux:
- If the level of failures increase on ThunderbirdTest after your
checkin then it is likely that you've broken something. However, its
worth waiting for at least two cycles to check that its not random failures.

For Mac:
- Don't trust these at the moment but maybe use them as a guide. We're
setting up some new minis with them and we're getting strange results.

Standard8

[gNeandr]

OK, Mark,
you posted at *Bug 519956*
<https://bugzilla.mozilla.org/show_bug.cgi?id=519956> - Finalize
customization ..
> The best place for TB specific MozMill items is the
> mozilla.dev.apps.thunderbird newsgroup. We can point you at MozMill specific
> locations if necessary.
>

To extract the points here to this newsgroup for further discussions:
> Comment 137 Blake Winton (:bwinton) 2010-02-13 06:53:02 PST
>
> We have some information up at
> https://developer.mozilla.org/en/Thunderbird/Thunderbird_MozMill_Testing that
> might help.
>
> Comment 138 2010-02-13 07:10:54 PST
>
> I've seen that page before, and sorry skipped it. Maybe I'm wrong, but I don't
> want to run a build to get the test running but just 'install' MozMill (as an
> extension??) and use it. You see my 'inexperienced' attitude ...
>

So my open point is:
That mentioned link doesn't help me (as an extension developer) for
using MozMill.
If I didn't got it totally wrong that link tells me how run a build
including the MozMill feature set.
My intension is: get a TB version which can do specific testing on the
extension. I understood MozMill can do it. So where to download such a
TB3.0x(+MozMill) version?

G�nter