Survey: browser testing needs (BrowserStack, Sauce Labs, etc.)

[Philip Jägenstedt]

Hi Blinkers!

Ever get the question "what does Edge do" in code review? If you have any need for testing of other engines while working on Blink, please fill out this survey:

https://goo.gl/forms/IxqmeHMZbf5v6SRm2

I am looking into whether we can get BrowserStack or Sauce Labs access for Blink developers who occasionally need it with as little friction as possible. A chromium.org is not required to answer, and I'll keep the survey open for a week.

Thanks!

[Robert Hogan]

Thanks for taking the initiative on this Philip. This would be a fantastic asset for the project.

Has anyone ever explored using the trybot infrastructure to generate png results from other browsers on tests added by a CL?

If edge, Safari and Firefox have headless support this could be relatively easy to tack on as a task to existing  windows and mac bots. If they ran by default on a CQ dry run it would make it easy for both author and reviewer to inspect and compare results.

--
You received this message because you are subscribed to the Google Groups "blink-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.

[PhistucK]

Will the availability of this access be limited to Google (or other big corporations that commit) employees?

I am triaging a lot of interoperability bugs and I just use what I have on my machine (one machine has Internet Explorer 11 and Chrome, plus the canary and the other also has Firefox and no canary), so having access to this would be beneficial to me for the Chromium project.

☆PhistucK

--

You received this message because you are subscribed to the Google Groups "blink-dev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+unsubscribe@chromium.org.

[Philip Jägenstedt]

Thanks for the support, Robert!

https://www.browserstack.com/screenshots is already available to take screenshots, and appears to not even require a login.

However, I find this to be rather insufficient. More often than not, I'd like to open a console and poke around a bit to see what API surface is there, and while screenshots can be used for that it's cumbersome enough that I'd rather install VMs myself.

As for running a test from a Chromium code review CL in other browsers before landing, I would love that very, very much. We have a contractor working on something like that for upstream web-platform-tests, and I'm hopeful that it can also be connected directly to Chromium reviews.

[Philip Jägenstedt]

I can't make any promises, but my hope is that this can be made available to anyone using it for Chromium work, certainly you are a good example of why this would be useful. Will report back when I know more!

To unsubscribe from this group and stop receiving emails from it, send an email to blink-dev+...@chromium.org.

[Philip Jägenstedt]

Hi everyone!

The survey got 27 responses, out of which 9 were non-Googlers.

Looks like most people are using only physical machines, with 8 people using a mixture of mostly VMs and BrowserStack.

On "Which service would you prefer to use?", not many expressed a preference, with 3 for BrowserStack and 1 for Sauce.

I'm not sure what's possible yet, but I will hand this over to someone else internally to investigate further, and eventually report back here.