Filed by: archaeopteryx [at] coole-files.de https://treeherder.mozilla.org/logviewer.html#?job_id=127353515&repo=autoland https://queue.taskcluster.net/v1/task/MCzYP69ASCysya1WBFY0Vg/runs/0/artifacts/public/logs/live_backing.log [task 2017-08-31T10:40:11.219992Z] 10:40:11 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Element should not be null, when checking visibility - [task 2017-08-31T10:40:11.222688Z] 10:40:11 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Menu separator should be visible with multiple menu items - [task 2017-08-31T10:40:11.227812Z] 10:40:11 INFO - Test 14 took 168ms [task 2017-08-31T10:40:11.231234Z] 10:40:11 INFO - Running test 15 [task 2017-08-31T10:40:11.237058Z] 10:40:11 INFO - Opening context menu with single menu item on enabled theme, in detail view [task 2017-08-31T10:40:11.239648Z] 10:40:11 INFO - Buffered messages logged at 10:39:23 [task 2017-08-31T10:40:11.244006Z] 10:40:11 INFO - Longer timeout required, waiting longer... Remaining timeouts: 1 [task 2017-08-31T10:40:11.246958Z] 10:40:11 INFO - Buffered messages finished [task 2017-08-31T10:40:11.249407Z] 10:40:11 INFO - TEST-UNEXPECTED-FAIL | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Test timed out - [task 2017-08-31T10:40:11.252056Z] 10:40:11 INFO - Unregistering mock add-on provider

our current linux64 browser-chrome tests run on really slow single core VM instances- this takes a lot of time up in getting results and is not very realistic- I can reproduce this failure at 50%+ rate when running on multi-core machines: https://treeherder.mozilla.org/#/jobs?repo=try&revision=7bc76d4a5cbd30c7cff11b329cb1ff4e00e8c5df&filter-searchStr=opt&selectedJob=136979361 ^ linux64:bc1, linux64-stylo-disabled:bc3 here is data from one of the logs: [task 2017-10-14T10:58:55.165Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Element should not be null, when checking visibility - [task 2017-10-14T10:58:55.166Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | 'Install' should be hidden - [task 2017-10-14T10:58:55.168Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Element should not be null, when checking visibility - [task 2017-10-14T10:58:55.169Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | 'Show More Information' should be visible in list view - [task 2017-10-14T10:58:55.170Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Element should not be null, when checking visibility - [task 2017-10-14T10:58:55.171Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Menu separator should be visible with multiple menu items - [task 2017-10-14T10:58:55.172Z] 10:58:55 INFO - Test 2 took 69ms [task 2017-10-14T10:58:55.173Z] 10:58:55 INFO - Running test 3 [task 2017-10-14T10:58:55.174Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | view controller is tracking the displayed view correctly - [task 2017-10-14T10:58:55.175Z] 10:58:55 INFO - TEST-PASS | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Should have found addon element - [task 2017-10-14T10:58:55.176Z] 10:58:55 INFO - Opening context menu on newly enabled extension item [task 2017-10-14T10:58:55.177Z] 10:58:55 INFO - Buffered messages logged at 10:58:09 [task 2017-10-14T10:58:55.179Z] 10:58:55 INFO - Longer timeout required, waiting longer... Remaining timeouts: 1 [task 2017-10-14T10:58:55.180Z] 10:58:55 INFO - Buffered messages finished [task 2017-10-14T10:58:55.181Z] 10:58:55 INFO - TEST-UNEXPECTED-FAIL | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Test timed out - [task 2017-10-14T10:58:55.182Z] 10:58:55 INFO - Unregistering mock add-on provider [task 2017-10-14T10:58:55.183Z] 10:58:55 INFO - GECKO(6089) | MEMORY STAT | vsize 2694MB | residentFast 304MB | heapAllocated 97MB [task 2017-10-14T10:58:55.184Z] 10:58:55 INFO - TEST-OK | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | took 90071ms [task 2017-10-14T10:58:55.185Z] 10:58:55 INFO - Not taking screenshot here: see the one that was previously logged [task 2017-10-14T10:58:55.186Z] 10:58:55 INFO - TEST-UNEXPECTED-FAIL | toolkit/mozapps/extensions/test/browser/browser_bug591465.js | Found a tab after previous test timed out: about:addons - I assume the failure is here: http://searchfox.org/mozilla-central/source/toolkit/mozapps/extensions/test/browser/browser_bug591465.js#145 this is waiting for a popupshown event. Here is a screenshot: https://public-artifacts.taskcluster.net/MiXOrcK3Qlq0gkenCdmrPA/0/public/test_info//mozilla-test-fail-screenshot_laDcoC.png this looks to be on the correct page of the browser, the synthesize mouse seems to not get us into the popupshown event handler. Maybe the timing is more sensitive on multi-core than single core? :andym, would you know more about this test or failure pattern? Possibly someone on the team would know more?

Comment on attachment 8921520 [details] [diff] [review] disable one test so we can move fast while we are green Review of attachment 8921520 [details] [diff] [review]: ----------------------------------------------------------------- Thanks - this will help us move forward with bug 1408506.

Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/5d28f87d07b2 Disable toolkit/mozapps/extensions/test/browser/browser_bug591465.js on linux/opt to get tests running in multi-core. r=gbrown

This was the only test case preventing us from moving tests. The danger is we fix a series of tests, wait a few weeks, then new tests are failing- I am happy to help out here if this is an important test for coverage please remember to enable this when testing a fix for this test case.

The leave-open keyword is there and there is no activity for 6 months. :ddurst, maybe it's time to close this bug?

I don't have context for this.

:ddurst, is anyone looking at or would want to look at making toolkit/mozapps/extensions/test/browser/browser_bug591465.js run again on linux opt/pgo ? If not, maybe we should close this.