Filed by: btara [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=214433898&repo=autoland https://queue.taskcluster.net/v1/task/KeM1Ry2mRnKBPtfyndnvmg/runs/0/artifacts/public/logs/live_backing.log https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/KeM1Ry2mRnKBPtfyndnvmg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1 10:32:19 INFO - REFTEST TEST-START | file:///Users/cltbld/tasks/task_1543429462/build/tests/jsreftest/tests/jsreftest.html?test=non262/lexical-environment/block-scoped-functions-annex-b-with.js 10:32:19 INFO - REFTEST TEST-LOAD | file:///Users/cltbld/tasks/task_1543429462/build/tests/jsreftest/tests/jsreftest.html?test=non262/lexical-environment/block-scoped-functions-annex-b-with.js | 1700 / 17970 (9%) 10:32:19 INFO - ++DOMWINDOW == 83 (0x12d904c00) [pid = 793] [serial = 3616] [outer = 0x11d4a4c00] 10:32:19 INFO - TEST-INFO | FAILED! TypeError: Assertion failed: got "true", expected "false" 10:32:19 INFO - JavaScript error: file:///Users/cltbld/tasks/task_1543429462/build/tests/jsreftest/tests/shell.js, line 127: TypeError: Assertion failed: got "true", expected "false" 10:32:19 INFO - [Child 793, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005: file /builds/worker/workspace/build/src/dom/base/nsContentUtils.cpp, line 4045 10:32:19 INFO - REFTEST TEST-PASS | file:///Users/cltbld/tasks/task_1543429462/build/tests/jsreftest/tests/jsreftest.html?test=non262/lexical-environment/block-scoped-functions-annex-b-with.js | (LOAD ONLY) 10:32:19 INFO - REFTEST TEST-END | file:///Users/cltbld/tasks/task_1543429462/build/tests/jsreftest/tests/jsreftest.html?test=non262/lexical-environment/block-scoped-functions-annex-b-with.js

I don't know why this isn't being reported all the time -- I think this test fails about 50% of the time. Have we been messing around with annex B lately? Maybe Iain had to touch something...?

I think this only happens on Mac. I saw this on Try with my same-compartment-realms patches and thougth I broke something :/ This has been almost perma-failure on inbound/autoland for a while. It looks like sheriffs have been incorrectly flagging as bug 1491924?

First hit I could find on autoland: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=os%2Cx%2C10.10%2Cdebug%2Creftests%2Cwith%2Ce10s%2Ctest-macosx64%2Fdebug-jsreftest-e10s-1%2Cr-e10s%28j1%29&group_state=expanded&tochange=7bebcd679d58f09ef3c7e77026d42f82a6467f01 I'll do some retriggers to see if that gives us a useful range.

(In reply to Jan de Mooij [:jandem] from comment #4) > It looks > like sheriffs have been incorrectly flagging as bug 1491924? My bad, that one *also* happens. I wonder if they're related somehow.

I wonder if we broke the jsreftest browser harness. In a green run I see many "failures" like this: 08:10:04 INFO - TEST-INFO | FAILED! ReferenceError: quit is not defined 08:10:04 INFO - JavaScript error: file:///Users/cltbld/tasks/task_1543593696/build/tests/jsreftest/tests/non262/regress/regress-1476383-calloc-exc.js, line 3: ReferenceError: quit is not defined Ugh.

I don't think I've touched anything in this area. Does this consistently fail on Mac? If so, does anybody with a Macbook feel like dissecting it for us?

Bug 1512989 is what's happening.