Thanks,
I am sorry for short text, here is details
We are using Jenkins 1.611,Plugin mainly github, android emulator, Gradle, system LMDE 17.2 , Oracle JDK 8, NVidia GPU , latest android SDK
Problem is
On different API levels we are getting different test fails or if we run with same API two three jobs at once , we are getting different fails
see few fails.
it is problematic that if we remove problematic test then another test shows same behavior, can be said random fails.
Before upgrading jenkins (which is running other jobs fine) we wish to run this project some where to know if our system has problem or code is nasty.
Please let me know if you need any further information.
I can send you job configuration and project url to test.
19:59:02 junit.framework.AssertionFailedError: Text string: 'testLook1' is not found!
19:59:02 at com.robotium.solo.Clicker.clickOnText(Clicker.java:447)
19:59:02 at com.robotium.solo.Solo.clickOnText(Solo.java:1095)
19:59:02 at org.catrobat.catroid.uitest.content.brick.SetLookBrickTest.selectLook(SetLookBrickTest.java:234)
19:59:02 at org.catrobat.catroid.uitest.content.brick.SetLookBrickTest.testAdapterUpdateInScriptActivity(SetLookBrickTest.java:190)
19:59:02 at java.lang.reflect.Method.invokeNative(Native Method)
19:59:02 at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
19:59:02 at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
19:59:02 at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
19:59:02 at org.catrobat.catroid.uitest.util.BaseActivityInstrumentationTestCase.runBare(BaseActivityInstrumentationTestCase.java:137)
19:59:02 at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
19:59:02 at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
19:59:02 at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
19:59:02 at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)
20:02:23 .....
20:02:48 org.catrobat.catroid.uitest.content.brick.SetSizeToBrickTest:
20:02:48 Failure in testSetSizeToBrick:
20:02:48 junit.framework.AssertionFailedError: Text string: 'Preview' is not found!
20:02:48 at com.robotium.solo.Clicker.clickOnText(Clicker.java:447)
20:02:48 at com.robotium.solo.Solo.clickOnText(Solo.java:1095)
20:02:48 at org.catrobat.catroid.uitest.content.brick.SetSizeToBrickTest.testSetSizeToBrick(SetSizeToBrickTest.java:106)
20:02:48 at java.lang.reflect.Method.invokeNative(Native Method)
20:02:48 at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:214)
20:02:48 at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:199)
20:02:48 at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:192)
20:02:48 at org.catrobat.catroid.uitest.util.BaseActivityInstrumentationTestCase.runBare(BaseActivityInstrumentationTestCase.java:137)
20:02:48 at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:191)
20:02:48 at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:176)
20:02:48 at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:554)
20:02:48 at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1701)