https://tbpl.mozilla.org/php/getParsedLog.php?id=34517350&tree=Ash&full=1#error12 15:44:35 INFO - 0 INFO SimpleTest START 15:44:35 INFO - 1 INFO TEST-START | testPictureLinkContextMenu 15:44:35 INFO - 2 INFO TEST-PASS | testPictureLinkContextMenu | Given message occurred for registered event: {"type":"Gecko:Ready"} - Gecko:Ready should equal Gecko:Ready 15:44:35 INFO - EventExpecter: no longer listening for Gecko:Ready 15:44:35 INFO - 3 INFO TEST-PASS | testPictureLinkContextMenu | waiting for urlbar text to gain focus - urlbar text gained focus 15:44:35 INFO - 4 INFO TEST-PASS | testPictureLinkContextMenu | URL typed properly - http://mochi.test:8888/tests/robocop/robocop_picture_link.html should equal http://mochi.test:8888/tests/robocop/robocop_picture_link.html 15:44:35 INFO - 5 INFO TEST-PASS | testPictureLinkContextMenu | Given message occurred for registered event: {"errorType":"","bgColor":"transparent","type":"DOMContentLoaded","tabID":0} - DOMContentLoaded should equal DOMContentLoaded 15:44:35 INFO - EventExpecter: no longer listening for DOMContentLoaded 15:44:35 INFO - long-clicking at 512.0, 103.0 15:44:35 INFO - 6 INFO TEST-PASS | testPictureLinkContextMenu | Checking that the option: Copy Image Location is available - The option is available 15:44:35 INFO - 7 INFO TEST-UNEXPECTED-FAIL | testPictureLinkContextMenu | Checking that the option: Share Image is available - The option is available 15:44:35 INFO - Exception caught during test! 15:44:35 INFO - junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testPictureLinkContextMenu | Checking that the option: Share Image is available - The option is available 15:44:35 INFO - at junit.framework.Assert.fail(Assert.java:47) 15:44:35 INFO - at org.mozilla.gecko.FennecMochitestAssert._logMochitestResult(FennecMochitestAssert.java:110) 15:44:35 INFO - at org.mozilla.gecko.FennecMochitestAssert.ok(FennecMochitestAssert.java:139) 15:44:35 INFO - at org.mozilla.gecko.tests.ContentContextMenuTest.verifyContextMenuItems(ContentContextMenuTest.java:34) 15:44:35 INFO - at org.mozilla.gecko.tests.testPictureLinkContextMenu.testPictureLinkContextMenu(testPictureLinkContextMenu.java:26) 15:44:35 INFO - at java.lang.reflect.Method.invokeNative(Native Method) 15:44:35 INFO - at java.lang.reflect.Method.invoke(Method.java:507) 15:44:35 INFO - at android.test.InstrumentationTestCase.runMethod(InstrumentationTestCase.java:204) 15:44:35 INFO - at android.test.InstrumentationTestCase.runTest(InstrumentationTestCase.java:194) 15:44:35 INFO - at android.test.ActivityInstrumentationTestCase2.runTest(ActivityInstrumentationTestCase2.java:186) 15:44:35 INFO - at org.mozilla.gecko.tests.BaseTest.runTest(BaseTest.java:150) 15:44:35 INFO - at junit.framework.TestCase.runBare(TestCase.java:127) 15:44:35 INFO - at junit.framework.TestResult$1.protect(TestResult.java:106) 15:44:35 INFO - at junit.framework.TestResult.runProtected(TestResult.java:124) 15:44:35 INFO - at junit.framework.TestResult.run(TestResult.java:109) 15:44:35 INFO - at junit.framework.TestCase.run(TestCase.java:118) 15:44:35 INFO - at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:169) 15:44:35 INFO - at android.test.AndroidTestRunner.runTest(AndroidTestRunner.java:154) 15:44:35 INFO - at android.test.InstrumentationTestRunner.onStart(InstrumentationTestRunner.java:529) 15:44:35 INFO - at android.app.Instrumentation$InstrumentationThread.run(Instrumentation.java:1448) 15:44:35 INFO - 8 INFO TEST-UNEXPECTED-FAIL | testPictureLinkContextMenu | Exception caught - junit.framework.AssertionFailedError: 7 INFO TEST-UNEXPECTED-FAIL | testPictureLinkContextMenu | Checking that the option: Share Image is available - The option is available 15:44:35 INFO - 9 INFO TEST-END | testPictureLinkContextMenu | finished in 98233ms

On Android 2.3, it looks like the page may still be loading when the test starts clicking. Changing from inputAndLoadUrl to loadAndPaint changed this from perma-orange to 5 green runs in a row. I changed waitForText to verifyPageTitle since it's more specific, more descriptive, and used in more tests. https://tbpl.mozilla.org/php/getParsedLog.php?id=35809077&tree=Ash&full=1

Comment on attachment 8387941 [details] [diff] [review] use loadAndPaint for loading page Review of attachment 8387941 [details] [diff] [review]: ----------------------------------------------------------------- Sounds reasonable to me. I wonder if we need to wait for the page to be painted specifically because this test is clicking on an image.