11:28:13 INFO - TEST-START | test_settings_wallpaper.py TestWallpaper.test_change_wallpaper 11:28:41 INFO - TEST-PASS | test_settings_wallpaper.py TestWallpaper.test_change_wallpaper | took 27833ms 11:28:41 INFO - TEST-START | test_system_notification_bar.py TestNotificationBar.test_notification_bar 11:29:08 ERROR - TEST-UNEXPECTED-FAIL | test_system_notification_bar.py TestNotificationBar.test_notification_bar | AssertionError: 'TestNotificationBar_BODY' != u'' 11:29:08 INFO - Traceback (most recent call last): 11:29:08 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette_test.py", line 267, in run 11:29:08 INFO - testMethod() 11:29:08 INFO - File "/builds/slave/test/gaia/tests/python/gaia-ui-tests/gaiatest/tests/functional/system/test_system_notification_bar.py", line 37, in test_notification_bar 11:29:08 INFO - self.assertEqual(self._notification_body, notifications[0].content) 11:29:08 INFO - TEST-INFO took 27677ms 11:29:08 INFO - TEST-START | test_system_message_pending.py TestSystemMessage.test_pending_system_message 11:29:26 INFO - TEST-PASS | test_system_message_pending.py TestSystemMessage.test_pending_system_message | took 18149ms 11:29:26 INFO - TEST-START | test_privileged_app_contacts_prompt.py TestPrivilegedAppContactsPrompt.test_contact_prompt 11:29:48 INFO - TEST-PASS | test_privileged_app_contacts_prompt.py TestPrivilegedAppContactsPrompt.test_contact_prompt | took 21768ms 11:29:48 INFO - TEST-START | test_privileged_app_device_sdcard_prompt.py TestPrivilegedAppDeviceSDcardPrompt.test_get_sdcard_prompt 11:30:09 INFO - TEST-PASS | test_privileged_app_device_sdcard_prompt.py TestPrivilegedAppDeviceSDcardPrompt.test_get_sdcard_prompt | took 21212ms 11:30:09 INFO - TEST-START | test_video_empty.py TestVideoEmpty.test_empty_video 11:30:29 INFO - TEST-PASS | test_video_empty.py TestVideoEmpty.test_empty_video | took 19147ms 11:30:29 INFO - TEST-START | test_play_ogg_video.py TestPlayOGGVideo.test_play_ogg_video 11:30:53 INFO - TEST-PASS | test_play_ogg_video.py TestPlayOGGVideo.test_play_ogg_video | took 23922ms

This (and another f2 failure I'm about to file) seemed to have started up on my backout of bug 1044736. Was there something else we needed to back out to get everything working?

(In reply to Wes Kocher (:KWierso) from comment #1) > This (and another f2 failure I'm about to file) seemed to have started up on > my backout of bug 1044736. Was there something else we needed to back out to > get everything working? I don't think there are any more patches need back out. I'll take a look when investigating the earlier failures.

The Utility try opens and then immediately closes after that We need to update the wait_for_notification_container_displayed and investigate why the Utility try closes

This was caused by: https://bugzilla.mozilla.org/show_bug.cgi?id=1098118 which was backed out, but then the changed was landed again in: https://bugzilla.mozilla.org/show_bug.cgi?id=1099137

(In reply to Zac C (:zac) from comment #95) > This was caused by: > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118 > > which was backed out, but then the changed was landed again in: > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137 I doubt that this was caused by 1098118. The failure continues even 1098118 was backed out.

(In reply to Kan-Ru Chen [:kanru] from comment #96) > (In reply to Zac C (:zac) from comment #95) > > This was caused by: > > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118 > > > > which was backed out, but then the changed was landed again in: > > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137 > > I doubt that this was caused by 1098118. The failure continues even 1098118 > was backed out. You're right, it was probably https://bugzilla.mozilla.org/show_bug.cgi?id=1044736

Gecko or something is cancelling the flick events before the status bar can lock into place. Occasionally the utility bar stays open for just long enough for the test to pass and that is the cause of the intermittent. This patch to the test uses move_by_offset which is not susceptible, for whatever reason.

(In reply to Zac C (:zac) from comment #97) > (In reply to Kan-Ru Chen [:kanru] from comment #96) > > (In reply to Zac C (:zac) from comment #95) > > > This was caused by: > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118 > > > > > > which was backed out, but then the changed was landed again in: > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137 > > > > I doubt that this was caused by 1098118. The failure continues even 1098118 > > was backed out. > > You're right, it was probably > https://bugzilla.mozilla.org/show_bug.cgi?id=1044736 Nope. The test fails when 1044736 was backed out too.

(In reply to Kan-Ru Chen [:kanru] from comment #99) > (In reply to Zac C (:zac) from comment #97) > > (In reply to Kan-Ru Chen [:kanru] from comment #96) > > > (In reply to Zac C (:zac) from comment #95) > > > > This was caused by: > > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1098118 > > > > > > > > which was backed out, but then the changed was landed again in: > > > > https://bugzilla.mozilla.org/show_bug.cgi?id=1099137 > > > > > > I doubt that this was caused by 1098118. The failure continues even 1098118 > > > was backed out. > > > > You're right, it was probably > > https://bugzilla.mozilla.org/show_bug.cgi?id=1044736 > > Nope. The test fails when 1044736 was backed out too. The very earliest instance I can find of it failing on b2g-i is: https://hg.mozilla.org/integration/b2g-inbound/rev/5f740aacca6d

In any case, I think these patches have just exposed some downstream bugs. For example this only seems to occur on linux, not mac, which could point to some kind of different Gecko path.

Merged on master