This bug will track work required to move off of the desktop1604-test image.

Begin migration of test images being used in CI to ubuntu1804, starting with low-risk items. Goal is to migrate all by end of December 2019.

https://hg.mozilla.org/mozilla-central/rev/a2658260c088

FYI, I have been doing the same work for the lint image in bug 1601612 (upgrade to ubuntu 18.04)

Thanks for the heads up :sylvestre!

Our work should not overlap since you're pulling the vanilla 18.04 image. Using the ubuntu1804-test image would be too bloated, I suspect.

I will update the title to say '...where desktop1604-test is currently used' just to be extra clear.

https://hg.mozilla.org/mozilla-central/rev/c8f27bb541a5
https://hg.mozilla.org/mozilla-central/rev/bb871c7ddeef
https://hg.mozilla.org/mozilla-central/rev/f0da4af70330

Changes:

Because part of the setup for test-linux jobs are done in taskcluster/taskgraph/transforms/tests.py, I suspect there isn't an easy way like in test-macosx1014 to migrate a green suite one at a time, in piecemeal fashion.

This is the alternative proof of concept:

• rename the linux jobs with treeherder/job labels that include the version number like every other platform on our CI
• like test-macosx1014, create two test sets in test-sets.yml and stop running tests that are green on the older platform. If test has issues running on the new platform, keep it on the older, green platform at the moment while issues are worked out.

As proof of concept, apply this to linux32/opt web-platform-tests tasks

https://hg.mozilla.org/mozilla-central/rev/af9a67687311

https://hg.mozilla.org/mozilla-central/rev/0f8b72761010

https://hg.mozilla.org/mozilla-central/rev/dc4b649e269d

Backed out for perma fails on ayout/forms/test/test_bug549170.html.

Push with failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&resultStatus=testfailed%2Cbusted%2Cexception&revision=8c8ca0a0417bbdda365442a96393de3775523a65&selectedJob=283083101

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=283083101&repo=autoland&lineNumber=6479

Backout: https://hg.mozilla.org/integration/autoland/rev/b179d50f7d3e08ba29071d05c6d5312e6dcff46c

https://hg.mozilla.org/mozilla-central/rev/3756a5e51a3d

Clearing ni

https://hg.mozilla.org/mozilla-central/rev/1610532f3db4

https://hg.mozilla.org/mozilla-central/rev/74ae1f4ba31a
https://hg.mozilla.org/mozilla-central/rev/aec0aeb49092
https://hg.mozilla.org/mozilla-central/rev/81a64314e48b
https://hg.mozilla.org/mozilla-central/rev/6cad172ad4bc
https://hg.mozilla.org/mozilla-central/rev/9f0cfd2aaa21
https://hg.mozilla.org/mozilla-central/rev/ca0b54e9be3f

https://hg.mozilla.org/mozilla-central/rev/0feb8fe83cd9
https://hg.mozilla.org/mozilla-central/rev/9b598ca58e8d

https://hg.mozilla.org/mozilla-central/rev/ec49dd56db4e
https://hg.mozilla.org/mozilla-central/rev/76388ea0d634
https://hg.mozilla.org/mozilla-central/rev/6557e93a9970

This test is proving to be a nuisance during the migration.

Temporarily disable it while the reftest-no-accel suite is greened up on ubuntu1804 and ready for migration on mozilla-central.

https://hg.mozilla.org/releases/mozilla-beta/rev/f45e48e2cf75

https://hg.mozilla.org/mozilla-central/rev/53b1fcb5d9d5
https://hg.mozilla.org/mozilla-central/rev/ebdbee43a505
https://hg.mozilla.org/mozilla-central/rev/af7e5f99f36d
https://hg.mozilla.org/mozilla-central/rev/96d082028cb6
https://hg.mozilla.org/mozilla-central/rev/37442417fc24

Depends on D59570

Depends on D59571

Backed out changeset 9e4f3963ad86 (bug 1602863) for WTP Failures. CLOSED TREE

Log:
https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=284461428&repo=autoland&lineNumber=11192

Push with failures:
https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&revision=9e4f3963ad86829d10864ee7d63947f99a4a1aed

Backout:
https://hg.mozilla.org/integration/autoland/rev/aa637f925131b76e4eeb02117c23d404bbd983ca

Backed out 2 changesets (Bug 1602108, Bug 1602863) for causing mochitest failure at browser/browser_accessibility_panel_toolbar_pref_scroll.js

Push with failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&revision=bf9cd5aea492745dcb87999b19f1c65ebbc164eb

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=284484316&repo=autoland&lineNumber=3511

Backout link: https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception&classifiedState=unclassified&revision=8ac68bcb41316043ddfdf332b97acacc4ccb8e64

[task 2020-01-11T00:00:53.215Z] 00:00:53     INFO - TEST-PASS | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Expected menu item - 
[task 2020-01-11T00:00:53.215Z] 00:00:53     INFO - Buffered messages finished
[task 2020-01-11T00:00:53.216Z] 00:00:53     INFO - TEST-UNEXPECTED-FAIL | devtools/client/accessibility/test/browser/browser_accessibility_panel_toolbar_pref_scroll.js | Uncaught exception - Menu item is visible. - timed out after 50 tries.
[task 2020-01-11T00:00:53.216Z] 00:00:53     INFO - Leaving test bound a11YPanelTask
[task 2020-01-11T00:00:54.527Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 32 (0x7f0b40531000) [pid = 1231] [serial = 83] [outer = (nil)] [url = about:blank]
[task 2020-01-11T00:00:54.531Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 31 (0x7f0b40529000) [pid = 1231] [serial = 82] [outer = (nil)] [url = about:blank]
[task 2020-01-11T00:00:54.532Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 30 (0x7f0b5996ec00) [pid = 1231] [serial = 68] [outer = (nil)] [url = about:blank]
[task 2020-01-11T00:00:54.537Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 29 (0x7f0b5109ac00) [pid = 1231] [serial = 64] [outer = (nil)] [url = about:blank]
[task 2020-01-11T00:00:54.538Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 28 (0x7f0b40533800) [pid = 1231] [serial = 62] [outer = (nil)] [url = about:devtools-toolbox]
[task 2020-01-11T00:00:54.539Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231: Main Thread]: I/DocShellAndDOMWindowLeak --DOCSHELL 0x7f0b3ea5a000 == 9 [pid = 1231] [id = {303e5a02-df45-4b48-a893-461b9768d62d}] [url = about:blank]
[task 2020-01-11T00:00:54.759Z] 00:00:54     INFO - GECKO(1231) | [Child 1437: Main Thread]: I/DocShellAndDOMWindowLeak --DOMWINDOW == 1 (0x7f1ceec2e3e0) [pid = 1437] [serial = 7] [outer = (nil)] [url = about:blank]
[task 2020-01-11T00:00:54.819Z] 00:00:54     INFO - Removing tab.
[task 2020-01-11T00:00:54.821Z] 00:00:54     INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2020-01-11T00:00:54.841Z] 00:00:54     INFO - Got event: 'TabClose' on [object XULElement].
[task 2020-01-11T00:00:54.865Z] 00:00:54     INFO - GECKO(1231) | [Parent 1231, Main Thread] WARNING: '!inner', file /builds/worker/workspace/build/src/dom/ipc/JSWindowActorService.cpp, line 181
[task 2020-01-11T00:00:54.873Z] 00:00:54     INFO - Tab removed and finished closing

Backed out for perma fails on position-sticky-scroll-with-clip-and-abspos.html.

Push with failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&selectedJob=284516093&resultStatus=testfailed%2Cbusted%2Cexception&revision=ba5a1a2c62f6354e56f4be5af7346d3f17a4457a&searchStr=wr

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=284516093&repo=autoland&lineNumber=32890

Backout: https://hg.mozilla.org/integration/autoland/rev/46bb509181bfe023d0f0667736d73266dc64253f

Comment on attachment 9119545 [details]
Bug 1602863 - temporarily disable linux1804-64-asan-qr and linux1804-64-ccov platforms

Beta/Release Uplift Approval Request

• User impact if declined: No immediate end-user impact.
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: No
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): Not risky because it disables a platform combination that was not ready to run in CI in the first place.
• String changes made/needed:

Backed out 37442417fc24 as per edwin's request: https://hg.mozilla.org/integration/autoland/rev/ed4cadb326afe38a610445b64c0e8aae9a4c78ec

Comment on attachment 9119545 [details]
Bug 1602863 - temporarily disable linux1804-64-asan-qr and linux1804-64-ccov platforms

Disables some platforms which aren't ready to run in CI yet. Approved for Beta.

https://hg.mozilla.org/releases/mozilla-beta/rev/0390e08fc31b

Comment on attachment 9119545 [details]
Bug 1602863 - temporarily disable linux1804-64-asan-qr and linux1804-64-ccov platforms

Clearing the approval flag to avoid confusion now that this has been uplifted.

Backout of 37442417fc24 from comment 91 merged to central: https://hg.mozilla.org/mozilla-central/rev/ed4cadb326af

https://hg.mozilla.org/mozilla-central/rev/69099f930506

https://hg.mozilla.org/mozilla-central/rev/525b5fde4abe

Backed out changeset 9556b559d52a (Bug 1602863) for test_bug529119-1.html perma failing on 18.04

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=debug-mochitest-fis-e10s&tochange=ecfa4ec62870b9e688e3634610100b765bfc3eb5&fromchange=e2ea31b279b68d3b3e21a12a3f150519126c9677&selectedJob=285000405

Backout link: https://hg.mozilla.org/integration/autoland/rev/ecfa4ec62870b9e688e3634610100b765bfc3eb5

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=285000405&repo=autoland&lineNumber=1936

[task 2020-01-15T08:33:20.694Z] 08:33:20 INFO - TEST-START | docshell/test/mochitest/test_bug529119-1.html
[task 2020-01-15T08:33:20.730Z] 08:33:20 INFO - GECKO(1228) | [Parent 1228, Main Thread] WARNING: we only accept nsIURI interface type, patch welcome: file /builds/worker/workspace/build/src/dom/ipc/PropertyBagUtils.cpp, line 112
[task 2020-01-15T08:33:20.787Z] 08:33:20 INFO - GECKO(1228) | [Child 1428, Main Thread] WARNING: Trying to request nsIHttpChannel from DocumentChannel, this is likely broken: file /builds/worker/workspace/build/src/netwerk/ipc/DocumentChannel.cpp, line 63
[task 2020-01-15T08:33:21.194Z] 08:33:21 INFO - GECKO(1228) | [Parent 1228, Main Thread] WARNING: we only accept nsIURI interface type, patch welcome: file /builds/worker/workspace/build/src/dom/ipc/PropertyBagUtils.cpp, line 112
[task 2020-01-15T08:33:21.202Z] 08:33:21 INFO - GECKO(1228) | [Child 1428, Main Thread] WARNING: Trying to request nsIHttpChannel from DocumentChannel, this is likely broken: file /builds/worker/workspace/build/src/netwerk/ipc/DocumentChannel.cpp, line 63
[task 2020-01-15T08:33:21.995Z] 08:33:21 INFO - GECKO(1228) | [Child 1428, Main Thread] WARNING: Trying to request nsIHttpChannel from DocumentChannel, this is likely broken: file /builds/worker/workspace/build/src/netwerk/ipc/DocumentChannel.cpp, line 63
[task 2020-01-15T08:33:21.995Z] 08:33:21 INFO - GECKO(1228) | [Child 1428, Main Thread] WARNING: Trying to request nsIHttpChannel from DocumentChannel, this is likely broken: file /builds/worker/workspace/build/src/netwerk/ipc/DocumentChannel.cpp, line 63
[task 2020-01-15T08:33:21.996Z] 08:33:21 INFO - GECKO(1228) | [Child 1428, Main Thread] WARNING: NS_ENSURE_TRUE(request) failed: file /builds/worker/workspace/build/src/netwerk/base/nsLoadGroup.cpp, line 584
[task 2020-01-15T08:33:22.112Z] 08:33:22 INFO - GECKO(1228) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmpzMeElB.mozrunner/runtests_leaks_tab_pid1526.log
[task 2020-01-15T08:33:22.188Z] 08:33:22 INFO - GECKO(1228) | [Parent 1228, Main Thread] WARNING: we only accept nsIURI interface type, patch welcome: file /builds/worker/workspace/build/src/dom/ipc/PropertyBagUtils.cpp, line 112
[task 2020-01-15T08:33:22.325Z] 08:33:22 INFO - GECKO(1228) | [Child 1526, Main Thread] WARNING: No CID found when attempting to map contract ID: file /builds/worker/workspace/build/src/xpcom/components/nsComponentManager.cpp, line 721
[task 2020-01-15T08:33:22.506Z] 08:33:22 INFO - GECKO(1228) | Couldn't convert chrome URL: chrome://branding/locale/brand.properties
[task 2020-01-15T08:33:22.724Z] 08:33:22 INFO - GECKO(1228) | [Child 1526, Main Thread] WARNING: could not set real-time limit at process startup: file /builds/worker/workspace/build/src/dom/ipc/ContentChild.cpp, line 1822
[task 2020-01-15T08:33:22.781Z] 08:33:22 INFO - GECKO(1228) | [Child 1526, Main Thread] WARNING: NS_ENSURE_TRUE(mPresShell) failed: file /builds/worker/workspace/build/src/layout/base/nsPresContext.cpp, line 848
[task 2020-01-15T08:33:23.513Z] 08:33:23 INFO - GECKO(1228) | [Child 1526, Main Thread] WARNING: Trying to request nsIHttpChannel from DocumentChannel, this is likely broken: file /builds/worker/workspace/build/src/netwerk/ipc/DocumentChannel.cpp, line 63
[task 2020-01-15T08:33:23.514Z] 08:33:23 INFO - GECKO(1228) | [Child 1526, Main Thread] WARNING: NS_ENSURE_TRUE(request) failed: file /builds/worker/workspace/build/src/netwerk/base/nsLoadGroup.cpp, line 584
[task 2020-01-15T08:33:25.392Z] 08:33:25 INFO - TEST-INFO | started process screentopng
[task 2020-01-15T08:33:25.959Z] 08:33:25 INFO - TEST-INFO | screentopng: exit 0
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - Buffered messages logged at 08:33:20
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - TEST-PASS | docshell/test/mochitest/test_bug529119-1.html | A valid string reason is expected
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - TEST-PASS | docshell/test/mochitest/test_bug529119-1.html | Reason cannot be empty
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - Buffered messages logged at 08:33:21
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - TEST-FAIL | docshell/test/mochitest/test_bug529119-1.html | The author of the test has indicated that flaky timeouts are expected. Reason: untriaged
[task 2020-01-15T08:33:25.960Z] 08:33:25 INFO - Buffered messages logged at 08:33:22
[task 2020-01-15T08:33:25.961Z] 08:33:25 INFO - TEST-FAIL | docshell/test/mochitest/test_bug529119-1.html | The author of the test has indicated that flaky timeouts are expected. Reason: untriaged
[task 2020-01-15T08:33:25.961Z] 08:33:25 INFO - Buffered messages logged at 08:33:23
[task 2020-01-15T08:33:25.961Z] 08:33:25 INFO - TEST-PASS | docshell/test/mochitest/test_bug529119-1.html | Waiting for error page succeeded
[task 2020-01-15T08:33:25.962Z] 08:33:25 INFO - TEST-FAIL | docshell/test/mochitest/test_bug529119-1.html | The author of the test has indicated that flaky timeouts are expected. Reason: untriaged
[task 2020-01-15T08:33:25.962Z] 08:33:25 INFO - Buffered messages logged at 08:33:24
[task 2020-01-15T08:33:25.963Z] 08:33:25 INFO - TEST-FAIL | docshell/test/mochitest/test_bug529119-1.html | The author of the test has indicated that flaky timeouts are expected. Reason: untriaged
[task 2020-01-15T08:33:25.963Z] 08:33:25 INFO - Buffered messages logged at 08:33:25
[task 2020-01-15T08:33:25.964Z] 08:33:25 INFO - TEST-PASS | docshell/test/mochitest/test_bug529119-1.html | Waiting for error page succeeded
[task 2020-01-15T08:33:25.968Z] 08:33:25 INFO - Buffered messages finished
[task 2020-01-15T08:33:25.968Z] 08:33:25 INFO - TEST-UNEXPECTED-FAIL | docshell/test/mochitest/test_bug529119-1.html | Is on an error page - got "about:blank", expected "http://www.some-nonexistent-domain-27489274c892748217cn2384.com/"
[task 2020-01-15T08:33:25.968Z] 08:33:25 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:325:16
[task 2020-01-15T08:33:25.969Z] 08:33:25 INFO - windowLoaded@docshell/test/mochitest/test_bug529119-1.html:60:9
[task 2020-01-15T08:33:25.969Z] 08:33:25 INFO - async*onload@docshell/test/mochitest/bug529119-window.html:1:15
[task 2020-01-15T08:33:25.969Z] 08:33:25 INFO - TEST-PASS | docshell/test/mochitest/test_bug529119-1.html | Must not get www.example.com page on reload of an error page
[task 2020-01-15T08:33:25.969Z] 08:33:25 INFO - GECKO(1228) | MEMORY STAT | vsize 2534MB | residentFast 148MB | heapAllocated 13MB
[task 2020-01-15T08:33:25.970Z] 08:33:25 INFO - TEST-OK | docshell/test/mochitest/test_bug529119-1.html | took 4844ms

https://hg.mozilla.org/mozilla-central/rev/e2ea31b279b6
https://hg.mozilla.org/mozilla-central/rev/3a8303b224f5

(In reply to Bogdan Tara[:bogdan_tara] from comment #105)

Backed out changeset 9556b559d52a (Bug 1602863) for test_bug529119-1.html perma failing on 18.04

Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=debug-mochitest-fis-e10s&tochange=ecfa4ec62870b9e688e3634610100b765bfc3eb5&fromchange=e2ea31b279b68d3b3e21a12a3f150519126c9677&selectedJob=285000405

Backout link: https://hg.mozilla.org/integration/autoland/rev/ecfa4ec62870b9e688e3634610100b765bfc3eb5

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=285000405&repo=autoland&lineNumber=1936

Guess my assumption was wrong - we do run mochitest-e10s on fission in autoland.

I will try to re-land with the offending test marked with fail-if as documented in bug 1605807.

https://hg.mozilla.org/mozilla-central/rev/39d3bfa15c32

https://hg.mozilla.org/mozilla-central/rev/0c32530ec106

https://hg.mozilla.org/mozilla-central/rev/6b3327b8f4ad

https://hg.mozilla.org/mozilla-central/rev/436df7dc06c6

I still see marionette, wpt-wdspec, and the new tsan tests running on ubuntu 1604. Possibly there are other jobs, but that would be a list to start with.

The leave-open keyword is there and there is no activity for 6 months.
:ahal, maybe it's time to close this bug?

Pretty sure this is done :p