Review of the litmus l10n testrun for Firefox 3.6

[Axel Hecht]

Hi,

I could use some help with reviewing the 3.6 l10n test run 57.
https://litmus.mozilla.org/test_run_report.cgi?test_run_id=57 is the
current report.

My confusion starts with drilling down the the subgroup to be run, and I
see two called FX 3.6 l10n - Localizer Run,
https://litmus.mozilla.org/manage_subgroups.cgi?subgroup_id=1302 and
https://litmus.mozilla.org/manage_subgroups.cgi?subgroup_id=1355. That
doesn't look right?

Before going into the individual tests, I wanted to make sure I focus on
the right thing.

Reading through 1302, https://litmus.mozilla.org/show_test.cgi?id=9323
seems to belong into the RTL subgroup, not the plain l10n subgroup?
https://litmus.mozilla.org/show_test.cgi?id=8836 needs an update now
that firstrun is a mozilla.org prerelease page?
https://litmus.mozilla.org/show_test.cgi?id=8834 says that the bookmarks
vary by locale, they don't. The url and folder titles should be
localized, and optimally match the titles used on the localized pages, I
guess. The about:rights test doesn't really have an expected result, AFAICT.

There's probably more, I just dug through the first few tests for now.

Axel

[Henrik Skupin]

Axel Hecht wrote on 04.11.09 09:10:

> I could use some help with reviewing the 3.6 l10n test run 57.
> https://litmus.mozilla.org/test_run_report.cgi?test_run_id=57 is the
> current report.
>
> My confusion starts with drilling down the the subgroup to be run, and I
> see two called FX 3.6 l10n - Localizer Run,
> https://litmus.mozilla.org/manage_subgroups.cgi?subgroup_id=1302 and
> https://litmus.mozilla.org/manage_subgroups.cgi?subgroup_id=1355. That
> doesn't look right?

I only see one subgroup for l10 tests. A second one the RTL subgroup is
not related. It has been created a while back to get tests for RTL
locales in Litmus but no-one has taken care about several months. I feel
that we should remove it again.

> Reading through 1302, https://litmus.mozilla.org/show_test.cgi?id=9323
> seems to belong into the RTL subgroup, not the plain l10n subgroup?

Looks like, yes.

> https://litmus.mozilla.org/show_test.cgi?id=8836 needs an update now
> that firstrun is a mozilla.org prerelease page?

Has the url of the firstrun page been changed?

> https://litmus.mozilla.org/show_test.cgi?id=8834 says that the bookmarks
> vary by locale, they don't. The url and folder titles should be
> localized, and optimally match the titles used on the localized pages, I

Each locale has different url's which point to the appropriate content
of that locale. Has something been changed for localized builds?

> guess. The about:rights test doesn't really have an expected result, AFAICT.

Which test is that?

Cheers,

--
Henrik Skupin
QA Execution Engineer
Mozilla Corporation