Robo tests as run by Google Play do not ignore certain resources

[Andreas B]

I'm publishing a number of Android apps on Google Play that use Firebase Auth (and com.firebaseui:firebase-ui-auth for the UI part). Whenever I update these apps, Google Play launches a number of Firebase Test Lab robo tests for its "pre-launch report", and I have provided Google Play with mail/password account credentials.

This seems to work insofar as the mail address must have actually been entered by the robo tests. However, the robo tests seem to be very eager to then click the "forgot password" link, because for every pre-launch report that runs, I get around half a dozen password reset mails sent to the mail address in question.

For what it's worth, not all of the tests run seem to do this, so I assume that at least some of them manage to actually sign in with the provided credentials although I have no good way to really confirm that.

While I can set up robo tests to ignore specific fields or buttons of my app if I run them myself from the Firebase console, I don't know of a way to configure this in the Google Play console. Since Google Play is somewhat hard to contact and get an answer from, I wonder if this is something that can be fixed centrally on the side of Firebase Robo tests?

[Arthur Thompson]

Hi Andreas,

This seems like a really useful feature request. I'll pass this on to the Test Lab team.

--
You received this message because you are subscribed to the Google Groups "Firebase Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firebase-tal...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/firebase-talk/b8fbb16a-3a5a-49d7-8555-2ab6a7888566n%40googlegroups.com.

[Andreas B]

Thanks Arthur, much appreciated. :)