Firefox for iOS Screenshots Update 2016-03-07

[Stefan Arentz]

Hello everyone,

We just uploaded a new batch of screenshots to:

http://people.mozilla.org/~sarentz/fxios/screenshots/2016-03-07/

You can navigate to your locale of choice and open the screenshots.html for a gallery.


Couple of things to note:

* We have scalability issues. This last run took 17 hours. This may not be surprising with 58 locales and more than 5600 resulting screenshots. But it is a real problem and it prevents us from running this more frequently. We are investigating what to do.

* The ar locale did not finish correctly and we actually excluded it from these screenshots for now. Needs investigation and bugs filed. Is most likely tests or UI that works incorrectly Right To Left.

* As you can see in the URL above, screenshots are now copied to a date specific directory. This makes it simpler to go back in time to see differences.

* We have resolved the issue where some string tables were not imported correctly

* Do not get too attached to URLs to these image files. Things may change. If we outgrow people.mozilla.org for example. If you file bugs, please just attach the image file as an attachemnt instead of linking to it.


The following new screenshots have been added since last time:

* Firefox Account login / logout / clear private data
* Context menus for web content: long press on an image, a link or a linked image
* More coverage of the settings: all sub pages are screenshotted now. We know there is an issue with scrolling through the main settings.
* Basic auth authentication dialog
* The context menu that shows when long pressing the reload button


Let us know what you think,

The iOS team

[Stefan Plewako]

> Wiadomość napisana przez Stefan Arentz <sar...@mozilla.com> w dniu 07.03.2016, o godz. 22:11:

>
> * We have scalability issues. This last run took 17 hours. This may not be surprising with 58 locales and more than 5600 resulting screenshots. But it is a real problem and it prevents us from running this more frequently. We are investigating what to do.

How much do we gain from having two same width sizes? Scheduling only changed locales by default might be other many hours saving idea.

> * As you can see in the URL above, screenshots are now copied to a date specific directory. This makes it simpler to go back in time to see differences.

Screenshots in date specific directories are great but latest screenshots page without stable url is no so much - does it really need to be date specific?

[Stefan Arentz]

> On Mar 7, 2016, at 4:46 PM, Stefan Plewako <sple...@aviary.pl> wrote:
>
>> Wiadomość napisana przez Stefan Arentz <sar...@mozilla.com> w dniu 07.03.2016, o godz. 22:11:
>>
>> * We have scalability issues. This last run took 17 hours. This may not be surprising with 58 locales and more than 5600 resulting screenshots. But it is a real problem and it prevents us from running this more frequently. We are investigating what to do.
>
> How much do we gain from having two same width sizes? Scheduling only changed locales by default might be other many hours saving idea.

We do have some screens where the vertical layout matters. For example:

http://people.mozilla.org/~sarentz/fxios/screenshots/latest/de/screenshots.html

I’m happy to remove the iPhone 4s if we think we are good there.

Note that at one point we would like to add at least iPad and maybe even do the iPhones also in landscape mode. So removing devices now is just a temporary solution.

>
>> * As you can see in the URL above, screenshots are now copied to a date specific directory. This makes it simpler to go back in time to see differences.
>
> Screenshots in date specific directories are great but latest screenshots page without stable url is no so much - does it really need to be date specific?

Here is a symlink that always points to the most recent run:

http://people.mozilla.org/~sarentz/fxios/screenshots/latest/

S.

[Stefan Plewako]

> Wiadomość napisana przez Stefan Arentz <sar...@mozilla.com> w dniu 08.03.2016, o godz. 01:48:

>
>> On Mar 7, 2016, at 4:46 PM, Stefan Plewako <sple...@aviary.pl> wrote:
>>
>>> Wiadomość napisana przez Stefan Arentz <sar...@mozilla.com> w dniu 07.03.2016, o godz. 22:11:
>>>
>>> * We have scalability issues. This last run took 17 hours. This may not be surprising with 58 locales and more than 5600 resulting screenshots. But it is a real problem and it prevents us from running this more frequently. We are investigating what to do.
>>
>> How much do we gain from having two same width sizes? Scheduling only changed locales by default might be other many hours saving idea.
>
> We do have some screens where the vertical layout matters. For example:
>
> http://people.mozilla.org/~sarentz/fxios/screenshots/latest/de/screenshots.html

Yes, but I was wondering how likely is to have a bug in a bigger screen (4 inch) and do not have it in smaller (3.5 inch)?

> I’m happy to remove the iPhone 4s if we think we are good there.

I think we should remove 4 inch set - Firefox is supported on iPhone 4s (3.5 inch, same width) and as general rule we should test on smallest screen possible.

> Note that at one point we would like to add at least iPad and maybe even do the iPhones also in landscape mode. So removing devices now is just a temporary solution.

Right. There is more than one iPad, there is also iPhone Plus and there is landscape mode. In future we could have also iPod Touch, Apple TV or any other iOS device with different screen dimensions.

This does impact volume of work (machine and human) but doesn't necessarily win much (in l10n qa case) beyond having smallest dimensions tested (per product category or app layout perspective) and maybe (?!) additionally something bigger/latest/most popular.

>>> * As you can see in the URL above, screenshots are now copied to a date specific directory. This makes it simpler to go back in time to see differences.
>>
>> Screenshots in date specific directories are great but latest screenshots page without stable url is no so much - does it really need to be date specific?
>
> Here is a symlink that always points to the most recent run:
>
> http://people.mozilla.org/~sarentz/fxios/screenshots/latest/

Thank you so much!