Firebase Test Lab for iOS

310 views
Skip to first unread message

Kalpesh Talkar

unread,
Aug 25, 2021, 7:03:57 PM8/25/21
to Firebase Google Group
Hello,

I am trying to run XCTest on Firebase Test Lab but every time I run the test with some combination of devices and OS versions, the test result is always inconclusive.

So far, I was only able to run the test for following devices:
- iPhone 8 iOS 14.7 (default)
- iPhone 11 Pro iOS 14.7

The test is inconclusive for all other device combinations. Why is that so? What does this mean?
Also, is there any way I can run the tests on a simulator?
I have attached a few screenshots of the test results for your reference.

I am a newbie here. Guidance on using Firebase Test Lab will be appreciated.

Thanks & Regards,
Kalpesh Talkar
skipped-iphone11-14.7.png
inconclusive-iphone7plus-14.1-iphonexr-13.2-iphonexsmax-12.1.png
inconclusive-iphone11-13.6.png
passed-iphone11pro-14.7.png
inconclusive-iphonexr-13.2.png
passed-iphone8-14.7.png
inconclusive-iphone7plus-14.1.png

Faith Chan

unread,
Sep 9, 2021, 11:56:57 PM9/9/21
to Firebase Google Group
Hi Kalpesh!

An inconclusive result can mean that one of the tests in the test matrix failed, or that Test Lab encountered an error. If you think this is a Test Lab error, please post an example matrix ID/matrix IDs so we can take a look! The iphone11/14.7 test was skipped because we don't offer that device; you can see the supported devices by running `gcloud firebase test ios models list`.

Thanks,
Faith

Reply all
Reply to author
Forward
0 new messages