Re: Testing duplicated access keys and cropped elements during our todays Mozmill Test Day

[Ehsan Akhgari]

This is great!

Is this something which should be done at localizers' requests? I'd
really like such tests to be run automatically on every locale before we
accept them for 4.0, and as a bonus, it would be very nice to get bugs
filed against the localizations which get something wrong in terms of
accesskey or UI elements being cropped.

Thanks!
Ehsan

On 10-11-26 10:48 AM, Henrik Skupin wrote:
> Hi Localizers,
>
> Today Mozilla QA is running a test day dedicated to Mozmill and testing
> Firefox 4 Beta 7 or recent Minefield builds. The big thing, why I want
> to also announce it relatively late on this mailing list, is, that we
> now have Mozmill tests available which can automatically check for
> duplicate access keys and cropped elements.
>
> In the last 3 months Adrian Kalla was working on those tests and the
> necessary shared modules to allow automated tests in that area. For now
> those tests are limited to the preferences dialog, but will be expanded
> in the future. Given test-runs against a couple of existing locales has
> already proven the importance of those tests.
>
> For an example (with screenshots) see the results for the eo locale:
> https://bugzilla.mozilla.org/show_bug.cgi?id=614938
>
> If you want to run those tests against your own locale, you should check
> our test day event page and join us today:
>
> http://quality.mozilla.org/events/2010/11/22/testing-with-mozmill-test-day-friday-november-26th/
>
> The QA Test Automation team is looking forward to work with you.
>
> Best,
>

[Axel Hecht]

We've actually got the tests run during the Mozilla Balkans meetup here
in Ljubljana yesterday. There are clearly some rough edges still, but
everybody was able to actually fire up the test run and investigate the
results here, including people that didn't have hg yet, and folks on
Windows machines.

I really think that localizers should feel encouraged to run the tests
themselves, at least as long as we've not figured out the details.

Running the tests on check-in is something you should file a bug about :-)

Axel

[Henrik Skupin]

Ehsan Akhgari wrote on 12/4/10 9:43 PM:

> This is great!
>
> Is this something which should be done at localizers' requests? I'd
> really like such tests to be run automatically on every locale before we
> accept them for 4.0, and as a bonus, it would be very nice to get bugs
> filed against the localizations which get something wrong in terms of
> accesskey or UI elements being cropped.

Thanks Ehsan for your feedback! We appreciate it and want to make sure
to even add more improvements in the future. Also the fully automated
execution of those tests. I already talked with Axel and we are working
on it. But there is still a bit of work to do. At the moment we are
happy to have those modules ready and are able to add tests for various
dialogs/windows. Even with only supporting the preferences dialog at the
moment, it should be easy to add more tests for other windows.

Sadly we do not have the man power to get this done in our group itself.
So it would be amazing to get help from the localizer community. It's a
bit javascript you will have to know, but the implementation would be
really straight forward. As more as windows we cover, as lesser work it
will be for all localizers to check the localized content.

If anyone has interest to help us, feel free to contact us in #mozmill.
We would appreciate it and whenever questions arise we are available to
answer those.

Best,

--
Henrik Skupin
QA Execution Engineer
Mozilla Corporation