Mochitest selftests landed recently, but there isn't a test for crashes, assertions or leaks yet. These are all critical pieces that need test coverage.

Comment on attachment 8880545 [details] Bug 1372263 - Add ability to skip mochitest selftests based on mozinfo properties, https://reviewboard.mozilla.org/r/151878/#review157136 this is really cool!

Comment on attachment 8880546 [details] Bug 1372263 - Add additional mochitest selftests for crashes, assertions and leaks, https://reviewboard.mozilla.org/r/151880/#review157142 pretty close to r+ a few nits. we are checking for certain things in the the logs, but I am afraid we won't be catching all the oddities we find in logs. ::: testing/mochitest/tests/python/files/test_assertion.html:15 (Diff revision 1) > + <link rel="stylesheet" type="text/css" href="/tests/SimpleTest/test.css"/> > + <script type="application/javascript"> > + const Cc = SpecialPowers.Cc; > + const Ci = SpecialPowers.Ci; > + let debug = Cc["@mozilla.org/xpcom/debug;1"].getService(Ci.nsIDebug2); > + debug.assertion('failed assertion check', 'false', 'test_crash.html', 15); why is this mentioning test_crash.html, not test_assertion.html ? ::: testing/mochitest/tests/python/test_basic_mochitest_plain.py:31 (Diff revision 1) > error_list=BaseErrorList+HarnessErrorList, > strict=False, > suite_category='mochitest', > ) > > + with open(os.devnull, 'w') as fh: can you add a brief comment here why you are redirecting stdout to devnull ::: testing/mochitest/tests/python/test_basic_mochitest_plain.py:90 (Diff revision 1) > + > + crash = filter_action('crash', lines) > + assert len(crash) == 1 > + assert crash[0]['action'] == 'crash' > + assert crash[0]['signature'] > + assert crash[0]['minidump_path'] we really should have this on all OS, not just linux :) ::: testing/mochitest/tests/python/test_basic_mochitest_plain.py:113 (Diff revision 1) > + assert len(assertions) == 1 > + assert assertions[0]['count'] == 1 > + > + lines = filter_action('test_end', lines) > + if build_obj: > + assert len(lines) == 2 why would build_obj add an extra test_end line? can you add a comment here? ::: testing/mochitest/tests/python/test_basic_mochitest_plain.py:127 (Diff revision 1) > + # instead of the actual one. > + import mozleak > + old_process_leak_log = mozleak.process_leak_log > + > + def process_leak_log(*args, **kwargs): > + return old_process_leak_log(os.path.join(here, 'files', 'leaks.log'), *args[1:], **kwargs) we skip the first arg value, is that typically the filename?

Comment on attachment 8880546 [details] Bug 1372263 - Add additional mochitest selftests for crashes, assertions and leaks, https://reviewboard.mozilla.org/r/151880/#review157142 > we really should have this on all OS, not just linux :) Originally this was linux only because the taskcluster support on windows/mac was questionable at the time. Maybe by now it's ready, but I'd like to investigate that in another bug. I'll file a follow-up. > why would build_obj add an extra test_end line? can you add a comment here? Mochitest has a "the following tests failed:" message at the end, which re-prints the log messages. But it only happens if running locally with mach. I'll add a comment. > we skip the first arg value, is that typically the filename? Yes, the first value is the filename, which we replace with the leaks.log file. I'm doing it this way because I couldn't figure out how to write a test that reliably produces a leak.

Comment on attachment 8880546 [details] Bug 1372263 - Add additional mochitest selftests for crashes, assertions and leaks, https://reviewboard.mozilla.org/r/151880/#review157142 I agree, there are a lot of oddities to catch that this patch is likely missing. But I think we'll be able to easily add assertions to these existing tests as we run into those oddities. The main purpose of these three tests are to make sure the job "turns orange" if we hit a crash/assertion/leak. This is verified by checking the TBPL_STATUS returned by mozharness' log parser (a status of TBPL_WARNING or TBPL_FAILURE means an orange or red job).

Comment on attachment 8880546 [details] Bug 1372263 - Add additional mochitest selftests for crashes, assertions and leaks, https://reviewboard.mozilla.org/r/151880/#review157230 thanks for addressing the issues!

Comment on attachment 8880544 [details] Bug 1372263 - Add additional mochitest selftests for crashes, assertions and leaks, https://reviewboard.mozilla.org/r/151876/#review158540

Noticed the "debug" tests were accidentally running with the opt build, and upon fixing that there was a minor test failure that needed to be fixed. Here are the tests running and passing for real: https://treeherder.mozilla.org/#/jobs?repo=try&revision=ed2d3a93c5cd1de5a8b12937507547ebc8b24d03

Pushed by ahalberstadt@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/32f1daf0a256 Set MOZ_CRASHREPORTER_SHUTDOWN in mozrunner based unittests, r=ted https://hg.mozilla.org/integration/autoland/rev/6b8840096867 Add ability to skip mochitest selftests based on mozinfo properties, r=jmaher https://hg.mozilla.org/integration/autoland/rev/7dcc7dac37d1 Add additional mochitest selftests for crashes, assertions and leaks, r=jmaher

Backed out for crashing in mochitests dom/ipc/tests/test_CrashService_crash.html and dom/ipc/tests/test_process_error.xul with js::ctypes::ConvertToJS: https://hg.mozilla.org/integration/autoland/rev/e1ce1ec02f2a6c623f482877f08ddf9f26d8e266 https://hg.mozilla.org/integration/autoland/rev/a5d9eeb8e8e524f94e4d4d747f27c1ecf247a9cf https://hg.mozilla.org/integration/autoland/rev/1a27697afcddf67b8023f47ab2e1ac32e5e985c7 Push with failures: https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=7dcc7dac37d19d0b8fe1d8100cfb01642c9d13a9&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=retry&filter-resultStatus=usercancel&filter-resultStatus=runnable Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=111250598&repo=autoland [task 2017-06-30T22:26:19.198719Z] 22:26:19 INFO - TEST-START | dom/ipc/tests/test_CrashService_crash.html [task 2017-06-30T22:26:21.256936Z] 22:26:21 INFO - GECKO(1460) | XPCOM_MEM_BLOAT_LOG: /tmp/tmpNmJxWQ.mozrunner/runtests_leaks.log [task 2017-06-30T22:26:21.258864Z] 22:26:21 INFO - GECKO(1460) | Writing to log: /tmp/tmpNmJxWQ.mozrunner/runtests_leaks_tab_pid1527.log [task 2017-06-30T22:26:21.730374Z] 22:26:21 INFO - GECKO(1460) | [Parent 1460] WARNING: pipe error (62): Connection reset by peer: file /builds/worker/workspace/build/src/ipc/chromium/src/chrome/common/ipc_channel_posix.cc, line 353 [task 2017-06-30T22:26:21.735455Z] 22:26:21 INFO - GECKO(1460) | ###!!! [Parent][MessageChannel] Error: (msgtype=0x28007E,name=PBrowser::Msg_Destroy) Channel error: cannot send/recv [task 2017-06-30T22:26:21.744212Z] 22:26:21 INFO - GECKO(1460) | JavaScript error: resource:///modules/ContentCrashHandlers.jsm, line 135: TypeError: WeakMap key must be an object, got undefined [task 2017-06-30T22:26:21.746944Z] 22:26:21 INFO - GECKO(1460) | JavaScript error: resource://gre/modules/debug.js, line 50: TypeError: access to strict mode caller function is censored [task 2017-06-30T22:26:21.754144Z] 22:26:21 INFO - GECKO(1460) | JavaScript error: chrome://browser/content/tabbrowser.xml, line 2286: TypeError: aTab is undefined [task 2017-06-30T22:26:22.250701Z] 22:26:22 INFO - GECKO(1460) | [Parent 1460] WARNING: waitpid failed pid:1527 errno:10: file /builds/worker/workspace/build/src/ipc/chromium/src/base/process_util_posix.cc, line 276 [task 2017-06-30T22:26:22.816288Z] 22:26:22 INFO - GECKO(1460) | JavaScript error: jar:file:///builds/worker/workspace/build/application/firefox/omni.ja!/components/nsUpdateTimerManager.js, line 311: TypeError: invalid 'in' operand this._timers [task 2017-06-30T22:26:23.825988Z] 22:26:23 INFO - TEST-INFO | Main app process: exit 0 [task 2017-06-30T22:26:23.828047Z] 22:26:23 INFO - runtests.py | Application ran for: 0:00:12.675031 [task 2017-06-30T22:26:23.829102Z] 22:26:23 INFO - zombiecheck | Reading PID log: /tmp/tmpLFXwUXpidlog [task 2017-06-30T22:26:23.836305Z] 22:26:23 INFO - ==> process 1460 launched child process 1480 [task 2017-06-30T22:26:23.838174Z] 22:26:23 INFO - ==> process 1460 launched child process 1527 [task 2017-06-30T22:26:23.840032Z] 22:26:23 INFO - zombiecheck | Checking for orphan process with PID: 1480 [task 2017-06-30T22:26:23.841795Z] 22:26:23 INFO - zombiecheck | Checking for orphan process with PID: 1527 [task 2017-06-30T22:26:23.843708Z] 22:26:23 INFO - mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/CDo4oT4oT5eRblH3kVwtyw/artifacts/public/build/target.crashreporter-symbols.zip [task 2017-06-30T22:26:37.580335Z] 22:26:37 INFO - mozcrash Copy/paste: /usr/local/bin/linux64-minidump_stackwalk /tmp/tmpNmJxWQ.mozrunner/minidumps/56011f2e-54a8-1fe5-bc96-ea483783f270.dmp /tmp/tmpdMfVvx [task 2017-06-30T22:26:55.613136Z] 22:26:55 INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/56011f2e-54a8-1fe5-bc96-ea483783f270.dmp [task 2017-06-30T22:26:55.615318Z] 22:26:55 INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/56011f2e-54a8-1fe5-bc96-ea483783f270.extra [task 2017-06-30T22:26:55.858441Z] 22:26:55 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [@ js::ctypes::ConvertToJS] [task 2017-06-30T22:26:55.863142Z] 22:26:55 INFO - Crash dump filename: /tmp/tmpNmJxWQ.mozrunner/minidumps/56011f2e-54a8-1fe5-bc96-ea483783f270.dmp [task 2017-06-30T22:26:55.867026Z] 22:26:55 INFO - Operating system: Linux [task 2017-06-30T22:26:55.868830Z] 22:26:55 INFO - 0.0.0 Linux 3.13.0-100-generic #147-Ubuntu SMP Tue Oct 18 16:48:51 UTC 2016 x86_64 [task 2017-06-30T22:26:55.870438Z] 22:26:55 INFO - CPU: amd64 [task 2017-06-30T22:26:55.872100Z] 22:26:55 INFO - family 6 model 45 stepping 7 [task 2017-06-30T22:26:55.873670Z] 22:26:55 INFO - 1 CPU [task 2017-06-30T22:26:55.875300Z] 22:26:55 INFO - [task 2017-06-30T22:26:55.877075Z] 22:26:55 INFO - GPU: UNKNOWN [task 2017-06-30T22:26:55.878959Z] 22:26:55 INFO - [task 2017-06-30T22:26:55.881080Z] 22:26:55 INFO - Crash reason: SIGSEGV [task 2017-06-30T22:26:55.884576Z] 22:26:55 INFO - Crash address: 0x8 [task 2017-06-30T22:26:55.886258Z] 22:26:55 INFO - Process uptime: not available [task 2017-06-30T22:26:55.887840Z] 22:26:55 INFO - [task 2017-06-30T22:26:55.889465Z] 22:26:55 INFO - Thread 0 (crashed) [task 2017-06-30T22:26:55.894996Z] 22:26:55 INFO - 0 libxul.so!js::ctypes::ConvertToJS [CTypes.cpp:7dcc7dac37d1 : 3206 + 0x8] [task 2017-06-30T22:26:55.896708Z] 22:26:55 INFO - rax = 0x00007fff0589c950 rdx = 0x00007fe693c19cc0 [task 2017-06-30T22:26:55.898376Z] 22:26:55 INFO - rcx = 0x0000000000000008 rbx = 0x00007fe68a2c5000 [task 2017-06-30T22:26:55.900042Z] 22:26:55 INFO - rsi = 0x0000000000000001 rdi = 0x00007fe6782c5200 [task 2017-06-30T22:26:55.901904Z] 22:26:55 INFO - rbp = 0x00007fff0589c8b0 rsp = 0x00007fff0589c7d0 [task 2017-06-30T22:26:55.903608Z] 22:26:55 INFO - r8 = 0x0000000000000000 r9 = 0x0000000000000000 [task 2017-06-30T22:26:55.905332Z] 22:26:55 INFO - r10 = 0x00007fff0589cb30 r11 = 0x00007fe68d0ab800 [task 2017-06-30T22:26:55.906947Z] 22:26:55 INFO - r12 = 0x0000000000000008 r13 = 0x0000000000000000 [task 2017-06-30T22:26:55.908577Z] 22:26:55 INFO - r14 = 0x00007fff0589c910 r15 = 0x0000000000000000 [task 2017-06-30T22:26:55.910188Z] 22:26:55 INFO - rip = 0x00007fe693c19cc8 [task 2017-06-30T22:26:55.915017Z] 22:26:55 INFO - Found by: given as instruction pointer in context [task 2017-06-30T22:26:55.916811Z] 22:26:55 INFO - 1 libxul.so!js::ctypes::PointerType::ContentsGetter [CTypes.cpp:7dcc7dac37d1 : 5345 + 0x6] [task 2017-06-30T22:26:55.918457Z] 22:26:55 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589c990 [task 2017-06-30T22:26:55.920122Z] 22:26:55 INFO - rsp = 0x00007fff0589c8c0 r12 = 0x00007fffffffffff [task 2017-06-30T22:26:55.922048Z] 22:26:55 INFO - r13 = 0x00007fff0589c9a0 r14 = 0x00007fff0589c900 [task 2017-06-30T22:26:55.923750Z] 22:26:55 INFO - r15 = 0xfff9000000000000 rip = 0x00007fe693c1c230 [task 2017-06-30T22:26:55.925396Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.927196Z] 22:26:55 INFO - 2 libxul.so!js::ctypes::Property<js::ctypes::PointerType::IsPointer, js::ctypes::PointerType::ContentsGetter>::Fun [CallNonGenericMethod.h:7dcc7dac37d1 : 100 + 0xc] [task 2017-06-30T22:26:55.929744Z] 22:26:55 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589c9f0 [task 2017-06-30T22:26:55.931450Z] 22:26:55 INFO - rsp = 0x00007fff0589c9a0 r12 = 0x00007fe686332160 [task 2017-06-30T22:26:55.933099Z] 22:26:55 INFO - r13 = 0x00007fffffffffff r14 = 0x00007fff0589ca40 [task 2017-06-30T22:26:55.935047Z] 22:26:55 INFO - r15 = 0x00007fe693c1c440 rip = 0x00007fe693c1c51c [task 2017-06-30T22:26:55.937888Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.939623Z] 22:26:55 INFO - 3 libxul.so!js::InternalCallOrConstruct [jscntxtinlines.h:7dcc7dac37d1 : 293 + 0x6] [task 2017-06-30T22:26:55.941286Z] 22:26:55 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589cab0 [task 2017-06-30T22:26:55.943241Z] 22:26:55 INFO - rsp = 0x00007fff0589ca00 r12 = 0x00007fe68a2bd000 [task 2017-06-30T22:26:55.947001Z] 22:26:55 INFO - r13 = 0x00007fff0589caf0 r14 = 0x00007fff0589ca40 [task 2017-06-30T22:26:55.948684Z] 22:26:55 INFO - r15 = 0x00007fe693c1c440 rip = 0x00007fe693c81207 [task 2017-06-30T22:26:55.950259Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.951969Z] 22:26:55 INFO - 4 libxul.so!js::CallGetter [Interpreter.cpp:7dcc7dac37d1 : 534 + 0x5] [task 2017-06-30T22:26:55.954905Z] 22:26:55 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589cb60 [task 2017-06-30T22:26:55.956549Z] 22:26:55 INFO - rsp = 0x00007fff0589cac0 r12 = 0x00007fff0589caf0 [task 2017-06-30T22:26:55.958172Z] 22:26:55 INFO - r13 = 0x00007fff0589cd70 r14 = 0x00007fff0589cbb0 [task 2017-06-30T22:26:55.959882Z] 22:26:55 INFO - r15 = 0x00007fe6881d51b0 rip = 0x00007fe693c81e80 [task 2017-06-30T22:26:55.961610Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.964634Z] 22:26:55 INFO - 5 libxul.so!CallGetter [NativeObject.cpp:7dcc7dac37d1 : 2064 + 0x5] [task 2017-06-30T22:26:55.966316Z] 22:26:55 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589cbe0 [task 2017-06-30T22:26:55.970764Z] 22:26:55 INFO - rsp = 0x00007fff0589cb70 r12 = 0x00007fe68a2c5038 [task 2017-06-30T22:26:55.972449Z] 22:26:55 INFO - r13 = 0x00007fe6782b7970 r14 = 0x00007fff0589d680 [task 2017-06-30T22:26:55.974134Z] 22:26:55 INFO - r15 = 0x00007fe68a2c5000 rip = 0x00007fe6940bc634 [task 2017-06-30T22:26:55.975737Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.977421Z] 22:26:55 INFO - 6 libxul.so!js::NativeGetProperty [NativeObject.cpp:7dcc7dac37d1 : 2116 + 0x1e] [task 2017-06-30T22:26:55.979104Z] 22:26:55 INFO - rbx = 0x00007fe6782b7970 rbp = 0x00007fff0589cd00 [task 2017-06-30T22:26:55.980735Z] 22:26:55 INFO - rsp = 0x00007fff0589cbf0 r12 = 0x00007fe68a2c5038 [task 2017-06-30T22:26:55.983011Z] 22:26:55 INFO - r13 = 0x00007fe6782b7970 r14 = 0x00007fff0589d680 [task 2017-06-30T22:26:55.985906Z] 22:26:55 INFO - r15 = 0x00007fe68a2c5000 rip = 0x00007fe6940cca08 [task 2017-06-30T22:26:55.990754Z] 22:26:55 INFO - Found by: call frame info [task 2017-06-30T22:26:55.992564Z] 22:26:55 INFO - 7 libxul.so!js::Wrapper::get [NativeObject.h:7dcc7dac37d1 : 1536 + 0xb] [task 2017-06-30T22:26:55.994194Z] 22:26:55 INFO - rbx = 0x00007fff0589cd70 rbp = 0x00007fff0589cd30 [task 2017-06-30T22:26:55.995830Z] 22:26:55 INFO - rsp = 0x00007fff0589cd10 r12 = 0x00007fff0589ceb0 [task 2017-06-30T22:26:55.997511Z] 22:26:55 INFO - r13 = 0x00007fe68d0ab800 r14 = 0x00007fff0589ced0 [task 2017-06-30T22:26:55.999121Z] 22:26:55 INFO - r15 = 0x00007fe68a2c5000 rip = 0x00007fe693ffb017 [task 2017-06-30T22:26:56.000764Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.002433Z] 22:26:56 INFO - 8 libxul.so!js::CrossCompartmentWrapper::get [CrossCompartmentWrapper.cpp:7dcc7dac37d1 : 226 + 0x19] [task 2017-06-30T22:26:56.004114Z] 22:26:56 INFO - rbx = 0x00007fff0589cd70 rbp = 0x00007fff0589cdb0 [task 2017-06-30T22:26:56.007081Z] 22:26:56 INFO - rsp = 0x00007fff0589cd40 r12 = 0x00007fff0589ceb0 [task 2017-06-30T22:26:56.008925Z] 22:26:56 INFO - r13 = 0x00007fe68d0ab800 r14 = 0x00007fff0589ced0 [task 2017-06-30T22:26:56.010961Z] 22:26:56 INFO - r15 = 0x00007fe68a2c5000 rip = 0x00007fe693ff9220 [task 2017-06-30T22:26:56.012664Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.019096Z] 22:26:56 INFO - 9 libxul.so!js::Proxy::get [Proxy.cpp:7dcc7dac37d1 : 340 + 0x12] [task 2017-06-30T22:26:56.020836Z] 22:26:56 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589ce70 [task 2017-06-30T22:26:56.022838Z] 22:26:56 INFO - rsp = 0x00007fff0589cdc0 r12 = 0x00007fff0589ce20 [task 2017-06-30T22:26:56.024496Z] 22:26:56 INFO - r13 = 0x00007fff0589ceb0 r14 = 0x00007fe696064a30 [task 2017-06-30T22:26:56.027331Z] 22:26:56 INFO - r15 = 0x00007fe6881d51b0 rip = 0x00007fe693ff9f59 [task 2017-06-30T22:26:56.029005Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.030680Z] 22:26:56 INFO - 10 libxul.so!js::GetProperty [NativeObject.h:7dcc7dac37d1 : 1535 + 0x8] [task 2017-06-30T22:26:56.032320Z] 22:26:56 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589cf10 [task 2017-06-30T22:26:56.033969Z] 22:26:56 INFO - rsp = 0x00007fff0589ce80 r12 = 0x00007fe6881d51b0 [task 2017-06-30T22:26:56.035722Z] 22:26:56 INFO - r13 = 0x00007fff0589d790 r14 = 0x00007fff0589d750 [task 2017-06-30T22:26:56.037605Z] 22:26:56 INFO - r15 = 0x00007fff0589ce80 rip = 0x00007fe693c67726 [task 2017-06-30T22:26:56.041959Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.043680Z] 22:26:56 INFO - 11 libxul.so!Interpret [Interpreter.cpp:7dcc7dac37d1 : 193 + 0x5] [task 2017-06-30T22:26:56.045373Z] 22:26:56 INFO - rbx = 0x00007fe696015800 rbp = 0x00007fff0589d890 [task 2017-06-30T22:26:56.047260Z] 22:26:56 INFO - rsp = 0x00007fff0589cf20 r12 = 0x00007fe68a2c5020 [task 2017-06-30T22:26:56.048940Z] 22:26:56 INFO - r13 = 0x00007fff0589d780 r14 = 0x00007fe68a2c5000 [task 2017-06-30T22:26:56.050572Z] 22:26:56 INFO - r15 = 0x00007fff0589d9c0 rip = 0x00007fe693c74c8f [task 2017-06-30T22:26:56.052218Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.055111Z] 22:26:56 INFO - 12 libxul.so!js::RunScript [Interpreter.cpp:7dcc7dac37d1 : 410 + 0xb] [task 2017-06-30T22:26:56.056752Z] 22:26:56 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589d9b0 [task 2017-06-30T22:26:56.058367Z] 22:26:56 INFO - rsp = 0x00007fff0589d8a0 r12 = 0x00007fff0589d8f0 [task 2017-06-30T22:26:56.063106Z] 22:26:56 INFO - r13 = 0x00007fff0589d9c0 r14 = 0x00007fe6782bc848 [task 2017-06-30T22:26:56.064784Z] 22:26:56 INFO - r15 = 0x00007fff0589d8e0 rip = 0x00007fe693c80c30 [task 2017-06-30T22:26:56.066461Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.068378Z] 22:26:56 INFO - 13 libxul.so!js::ExecuteKernel [Interpreter.cpp:7dcc7dac37d1 : 699 + 0x5] [task 2017-06-30T22:26:56.070168Z] 22:26:56 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589da30 [task 2017-06-30T22:26:56.071901Z] 22:26:56 INFO - rsp = 0x00007fff0589d9c0 r12 = 0x00007fe68a2c5020 [task 2017-06-30T22:26:56.073595Z] 22:26:56 INFO - r13 = 0x00007fff0589da50 r14 = 0x00007fff0589db70 [task 2017-06-30T22:26:56.075260Z] 22:26:56 INFO - r15 = 0x00007fff0589da60 rip = 0x00007fe693c82e82 [task 2017-06-30T22:26:56.079025Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.080730Z] 22:26:56 INFO - 14 libxul.so!js::ExecuteInGlobalAndReturnScope [Eval.cpp:7dcc7dac37d1 : 478 + 0x8] [task 2017-06-30T22:26:56.082382Z] 22:26:56 INFO - rbx = 0x00007fe68a2c5000 rbp = 0x00007fff0589db00 [task 2017-06-30T22:26:56.084074Z] 22:26:56 INFO - rsp = 0x00007fff0589da40 r12 = 0x00007fe68a2c5020 [task 2017-06-30T22:26:56.085767Z] 22:26:56 INFO - r13 = 0x00007fff0589da50 r14 = 0x00007fff0589db70 [task 2017-06-30T22:26:56.088551Z] 22:26:56 INFO - r15 = 0x00007fff0589da60 rip = 0x00007fe693c89554 [task 2017-06-30T22:26:56.090201Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.092299Z] 22:26:56 INFO - 15 libxul.so!nsMessageManagerScriptExecutor::LoadScriptInternal [nsFrameMessageManager.cpp:7dcc7dac37d1 : 1560 + 0x5] [task 2017-06-30T22:26:56.094065Z] 22:26:56 INFO - rbx = 0x00007fe68501b008 rbp = 0x00007fff0589dc50 [task 2017-06-30T22:26:56.096320Z] 22:26:56 INFO - rsp = 0x00007fff0589db10 r12 = 0x00007fff0589db80 [task 2017-06-30T22:26:56.098076Z] 22:26:56 INFO - r13 = 0x00007fff0589db40 r14 = 0x00007fff0589db60 [task 2017-06-30T22:26:56.103070Z] 22:26:56 INFO - r15 = 0x00007fff0589db20 rip = 0x00007fe69167069d [task 2017-06-30T22:26:56.104793Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.106475Z] 22:26:56 INFO - 16 libxul.so!mozilla::dom::TabChild::RecvLoadRemoteScript [TabChild.cpp:7dcc7dac37d1 : 2139 + 0xc] [task 2017-06-30T22:26:56.108381Z] 22:26:56 INFO - rbx = 0x00007fe68501b000 rbp = 0x00007fff0589dc80 [task 2017-06-30T22:26:56.110968Z] 22:26:56 INFO - rsp = 0x00007fff0589dc60 r12 = 0x00007fe68501b058 [task 2017-06-30T22:26:56.112690Z] 22:26:56 INFO - r13 = 0x00007fff0589dd40 r14 = 0x00007fff0589dd20 [task 2017-06-30T22:26:56.114305Z] 22:26:56 INFO - r15 = 0x00007fe68d0e2208 rip = 0x00007fe6925f26d2 [task 2017-06-30T22:26:56.115892Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.117756Z] 22:26:56 INFO - 17 libxul.so!mozilla::dom::PBrowserChild::OnMessageReceived [PBrowserChild.cpp:7dcc7dac37d1 : 4131 + 0x17] [task 2017-06-30T22:26:56.123080Z] 22:26:56 INFO - rbx = 0x0000000000000000 rbp = 0x00007fff0589dfc0 [task 2017-06-30T22:26:56.124795Z] 22:26:56 INFO - rsp = 0x00007fff0589dc90 r12 = 0x00007fe68501b058 [task 2017-06-30T22:26:56.126471Z] 22:26:56 INFO - r13 = 0x00007fff0589dd40 r14 = 0x00007fff0589dd20 [task 2017-06-30T22:26:56.128283Z] 22:26:56 INFO - r15 = 0x00007fe68d0e2208 rip = 0x00007fe690fd5a6a [task 2017-06-30T22:26:56.131013Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.132795Z] 22:26:56 INFO - 18 libxul.so!mozilla::dom::PContentChild::OnMessageReceived [PContentChild.cpp:7dcc7dac37d1 : 5288 + 0xc] [task 2017-06-30T22:26:56.134445Z] 22:26:56 INFO - rbx = 0x00007fe68d0e2200 rbp = 0x00007fff0589e250 [task 2017-06-30T22:26:56.136127Z] 22:26:56 INFO - rsp = 0x00007fff0589dfd0 r12 = 0x0000000000000001 [task 2017-06-30T22:26:56.137876Z] 22:26:56 INFO - r13 = 0x00007fe68d0e2200 r14 = 0x00007fe6a0dd7020 [task 2017-06-30T22:26:56.139610Z] 22:26:56 INFO - r15 = 0x0000000000000006 rip = 0x00007fe6910b9aa6 [task 2017-06-30T22:26:56.143025Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.144795Z] 22:26:56 INFO - 19 libxul.so!mozilla::ipc::MessageChannel::DispatchAsyncMessage [MessageChannel.cpp:7dcc7dac37d1 : 2093 + 0x9] [task 2017-06-30T22:26:56.146471Z] 22:26:56 INFO - rbx = 0x00007fe6a0dd7128 rbp = 0x00007fff0589e290 [task 2017-06-30T22:26:56.148126Z] 22:26:56 INFO - rsp = 0x00007fff0589e260 r12 = 0x0000000000000001 [task 2017-06-30T22:26:56.150996Z] 22:26:56 INFO - r13 = 0x00007fe68d0e2200 r14 = 0x0000000000000000 [task 2017-06-30T22:26:56.153062Z] 22:26:56 INFO - r15 = 0x0000000000000000 rip = 0x00007fe690d13744 [task 2017-06-30T22:26:56.155002Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.156841Z] 22:26:56 INFO - 20 libxul.so!mozilla::ipc::MessageChannel::DispatchMessage [MessageChannel.cpp:7dcc7dac37d1 : 2019 + 0xb] [task 2017-06-30T22:26:56.162956Z] 22:26:56 INFO - rbx = 0x00007fe6a0dd7128 rbp = 0x00007fff0589e340 [task 2017-06-30T22:26:56.164695Z] 22:26:56 INFO - rsp = 0x00007fff0589e2a0 r12 = 0x00007fe68d0e2200 [task 2017-06-30T22:26:56.166346Z] 22:26:56 INFO - r13 = 0x00000000ffffffff r14 = 0x00007fe68d07a2e0 [task 2017-06-30T22:26:56.168122Z] 22:26:56 INFO - r15 = 0x00007fe686210538 rip = 0x00007fe690d1b514 [task 2017-06-30T22:26:56.169854Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.171695Z] 22:26:56 INFO - 21 libxul.so!mozilla::ipc::MessageChannel::MessageTask::Run [MessageChannel.cpp:7dcc7dac37d1 : 1921 + 0xc] [task 2017-06-30T22:26:56.173412Z] 22:26:56 INFO - rbx = 0x00007fe68d0e21b0 rbp = 0x00007fff0589e360 [task 2017-06-30T22:26:56.175135Z] 22:26:56 INFO - rsp = 0x00007fff0589e350 r12 = 0x00007fe68d07a2e0 [task 2017-06-30T22:26:56.176751Z] 22:26:56 INFO - r13 = 0x00007fe686ecf468 r14 = 0x0000000000000001 [task 2017-06-30T22:26:56.178373Z] 22:26:56 INFO - r15 = 0x00007fff0589e51f rip = 0x00007fe690d1e9ee [task 2017-06-30T22:26:56.179998Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.183069Z] 22:26:56 INFO - 22 libxul.so!mozilla::SchedulerGroup::Runnable::Run [SchedulerGroup.cpp:7dcc7dac37d1 : 367 + 0x6] [task 2017-06-30T22:26:56.184714Z] 22:26:56 INFO - rbx = 0x00007fe68d08ae50 rbp = 0x00007fff0589e3f0 [task 2017-06-30T22:26:56.186371Z] 22:26:56 INFO - rsp = 0x00007fff0589e370 r12 = 0x00007fff0589e3a0 [task 2017-06-30T22:26:56.188134Z] 22:26:56 INFO - r13 = 0x00007fe686ecf468 r14 = 0x0000000000000001 [task 2017-06-30T22:26:56.190106Z] 22:26:56 INFO - r15 = 0x00007fff0589e51f rip = 0x00007fe6908c8076 [task 2017-06-30T22:26:56.193001Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.194742Z] 22:26:56 INFO - 23 libxul.so!nsThread::ProcessNextEvent [nsThread.cpp:7dcc7dac37d1 : 1422 + 0x6] [task 2017-06-30T22:26:56.196414Z] 22:26:56 INFO - rbx = 0x00007fe6a0d58d20 rbp = 0x00007fff0589e500 [task 2017-06-30T22:26:56.198693Z] 22:26:56 INFO - rsp = 0x00007fff0589e400 r12 = 0x00007fff0589e460 [task 2017-06-30T22:26:56.202988Z] 22:26:56 INFO - r13 = 0x00007fe686ecf468 r14 = 0x0000000000000001 [task 2017-06-30T22:26:56.204721Z] 22:26:56 INFO - r15 = 0x00007fff0589e51f rip = 0x00007fe6908de091 [task 2017-06-30T22:26:56.206323Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.208082Z] 22:26:56 INFO - 24 libxul.so!NS_ProcessNextEvent [nsThreadUtils.cpp:7dcc7dac37d1 : 489 + 0xd] [task 2017-06-30T22:26:56.209729Z] 22:26:56 INFO - rbx = 0x0000000000000000 rbp = 0x00007fff0589e530 [task 2017-06-30T22:26:56.212596Z] 22:26:56 INFO - rsp = 0x00007fff0589e510 r12 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.214275Z] 22:26:56 INFO - r13 = 0x0000000000000001 r14 = 0x00007fe6a0d58d20 [task 2017-06-30T22:26:56.218896Z] 22:26:56 INFO - r15 = 0x00007fe6a0dc7bc0 rip = 0x00007fe6908dbc6d [task 2017-06-30T22:26:56.220601Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.222255Z] 22:26:56 INFO - 25 libxul.so!mozilla::ipc::MessagePump::Run [MessagePump.cpp:7dcc7dac37d1 : 97 + 0xa] [task 2017-06-30T22:26:56.223915Z] 22:26:56 INFO - rbx = 0x00007fe6a0dc7ba0 rbp = 0x00007fff0589e590 [task 2017-06-30T22:26:56.225556Z] 22:26:56 INFO - rsp = 0x00007fff0589e540 r12 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.227221Z] 22:26:56 INFO - r13 = 0x0000000000000001 r14 = 0x00007fe6a0d58d20 [task 2017-06-30T22:26:56.228854Z] 22:26:56 INFO - r15 = 0x00007fe6a0dc7bc0 rip = 0x00007fe690d0bada [task 2017-06-30T22:26:56.230598Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.233572Z] 22:26:56 INFO - 26 libxul.so!MessageLoop::Run [message_loop.cc:7dcc7dac37d1 : 320 + 0x5] [task 2017-06-30T22:26:56.235266Z] 22:26:56 INFO - rbx = 0x00007fe686ecf460 rbp = 0x00007fff0589e5c0 [task 2017-06-30T22:26:56.237070Z] 22:26:56 INFO - rsp = 0x00007fff0589e5a0 r12 = 0x00007fe6a0d58d20 [task 2017-06-30T22:26:56.239040Z] 22:26:56 INFO - r13 = 0x00007fff0589e680 r14 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.243054Z] 22:26:56 INFO - r15 = 0x00007fe6a0dd7000 rip = 0x00007fe690cde2e2 [task 2017-06-30T22:26:56.244697Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.246335Z] 22:26:56 INFO - 27 libxul.so!nsBaseAppShell::Run [nsBaseAppShell.cpp:7dcc7dac37d1 : 156 + 0xd] [task 2017-06-30T22:26:56.248020Z] 22:26:56 INFO - rbx = 0x00007fe686ecf460 rbp = 0x00007fff0589e5e0 [task 2017-06-30T22:26:56.249718Z] 22:26:56 INFO - rsp = 0x00007fff0589e5d0 r12 = 0x00007fe6a0d58d20 [task 2017-06-30T22:26:56.252527Z] 22:26:56 INFO - r13 = 0x00007fff0589e680 r14 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.254193Z] 22:26:56 INFO - r15 = 0x00007fe6a0dd7000 rip = 0x00007fe69283335e [task 2017-06-30T22:26:56.258748Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.260492Z] 22:26:56 INFO - 28 libxul.so!XRE_RunAppShell [nsEmbedFunctions.cpp:7dcc7dac37d1 : 895 + 0x6] [task 2017-06-30T22:26:56.262115Z] 22:26:56 INFO - rbx = 0x0000000080004005 rbp = 0x00007fff0589e610 [task 2017-06-30T22:26:56.263769Z] 22:26:56 INFO - rsp = 0x00007fff0589e5f0 r12 = 0x0000000000000011 [task 2017-06-30T22:26:56.265432Z] 22:26:56 INFO - r13 = 0x00007fff0589e680 r14 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.267049Z] 22:26:56 INFO - r15 = 0x00007fe6a0dd7000 rip = 0x00007fe693acba0c [task 2017-06-30T22:26:56.268791Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.270422Z] 22:26:56 INFO - 29 libxul.so!MessageLoop::Run [message_loop.cc:7dcc7dac37d1 : 320 + 0x5] [task 2017-06-30T22:26:56.272150Z] 22:26:56 INFO - rbx = 0x00007fff0589ea38 rbp = 0x00007fff0589e640 [task 2017-06-30T22:26:56.277136Z] 22:26:56 INFO - rsp = 0x00007fff0589e620 r12 = 0x0000000000000011 [task 2017-06-30T22:26:56.281735Z] 22:26:56 INFO - r13 = 0x00007fff0589e680 r14 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.283449Z] 22:26:56 INFO - r15 = 0x00007fe6a0dd7000 rip = 0x00007fe690cde2e2 [task 2017-06-30T22:26:56.285061Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.288736Z] 22:26:56 INFO - 30 libxul.so!XRE_InitChildProcess [nsEmbedFunctions.cpp:7dcc7dac37d1 : 711 + 0x8] [task 2017-06-30T22:26:56.290449Z] 22:26:56 INFO - rbx = 0x00007fff0589ea38 rbp = 0x00007fff0589e8d0 [task 2017-06-30T22:26:56.292223Z] 22:26:56 INFO - rsp = 0x00007fff0589e650 r12 = 0x0000000000000011 [task 2017-06-30T22:26:56.294068Z] 22:26:56 INFO - r13 = 0x00007fff0589e680 r14 = 0x00007fff0589e700 [task 2017-06-30T22:26:56.295857Z] 22:26:56 INFO - r15 = 0x00007fe6a0dd7000 rip = 0x00007fe693acbe72 [task 2017-06-30T22:26:56.297522Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.302267Z] 22:26:56 INFO - 31 firefox!content_process_main [plugin-container.cpp:7dcc7dac37d1 : 64 + 0x13] [task 2017-06-30T22:26:56.304009Z] 22:26:56 INFO - rbx = 0x00007fe6a0dbd0b0 rbp = 0x00007fff0589e910 [task 2017-06-30T22:26:56.305656Z] 22:26:56 INFO - rsp = 0x00007fff0589e8e0 r12 = 0x0000000000000013 [task 2017-06-30T22:26:56.307298Z] 22:26:56 INFO - r13 = 0x00007fff0589ea38 r14 = 0x000018684ac2fbd9 [task 2017-06-30T22:26:56.308937Z] 22:26:56 INFO - r15 = 0x0000000000000000 rip = 0x00000000004061b7 [task 2017-06-30T22:26:56.310539Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.312199Z] 22:26:56 INFO - 32 firefox!main [nsBrowserApp.cpp:7dcc7dac37d1 : 282 + 0x16] [task 2017-06-30T22:26:56.314873Z] 22:26:56 INFO - rbx = 0x00007fff0589ea38 rbp = 0x00007fff0589e950 [task 2017-06-30T22:26:56.316602Z] 22:26:56 INFO - rsp = 0x00007fff0589e920 r12 = 0x0000000000000014 [task 2017-06-30T22:26:56.318271Z] 22:26:56 INFO - r13 = 0x00007fff0589eae0 r14 = 0x000018684ac2fbd9 [task 2017-06-30T22:26:56.322282Z] 22:26:56 INFO - r15 = 0x0000000000000000 rip = 0x0000000000405ca1 [task 2017-06-30T22:26:56.323929Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.325543Z] 22:26:56 INFO - 33 libc-2.23.so + 0x20830 [task 2017-06-30T22:26:56.327158Z] 22:26:56 INFO - rbx = 0x0000000000000000 rbp = 0x0000000000421b40 [task 2017-06-30T22:26:56.328810Z] 22:26:56 INFO - rsp = 0x00007fff0589e960 r12 = 0x0000000000405f1c [task 2017-06-30T22:26:56.330458Z] 22:26:56 INFO - r13 = 0x00007fff0589ea30 r14 = 0x0000000000000000 [task 2017-06-30T22:26:56.332393Z] 22:26:56 INFO - r15 = 0x0000000000000000 rip = 0x00007fe6a0fc0830 [task 2017-06-30T22:26:56.335020Z] 22:26:56 INFO - Found by: call frame info [task 2017-06-30T22:26:56.336651Z] 22:26:56 INFO - 34 firefox + 0x5bc0 [task 2017-06-30T22:26:56.339086Z] 22:26:56 INFO - rsp = 0x00007fff0589e980 rip = 0x0000000000405bc0 [task 2017-06-30T22:26:56.340684Z] 22:26:56 INFO - Found by: stack scanning [task 2017-06-30T22:26:56.343010Z] 22:26:56 INFO - 35 firefox + 0x5f1c [task 2017-06-30T22:26:56.346930Z] 22:26:56 INFO - rsp = 0x00007fff0589e998 rip = 0x0000000000405f1c [task 2017-06-30T22:26:56.348594Z] 22:26:56 INFO - Found by: stack scanning [task 2017-06-30T22:26:56.350238Z] 22:26:56 INFO - 36 firefox + 0x5bc0 [task 2017-06-30T22:26:56.351890Z] 22:26:56 INFO - rsp = 0x00007fff0589e9e8 rip = 0x0000000000405bc0 [task 2017-06-30T22:26:56.353479Z] 22:26:56 INFO - Found by: stack scanning [task 2017-06-30T22:26:56.355301Z] 22:26:56 INFO - 37 firefox + 0x21b30 [task 2017-06-30T22:26:56.357054Z] 22:26:56 INFO - rsp = 0x00007fff0589e9f0 rip = 0x0000000000421b30 [task 2017-06-30T22:26:56.363045Z] 22:26:56 INFO - Found by: stack scanning [task 2017-06-30T22:26:56.364666Z] 22:26:56 INFO - 38 firefox + 0x5f1c [task 2017-06-30T22:26:56.366320Z] 22:26:56 INFO - rsp = 0x00007fff0589ea08 rip = 0x0000000000405f1c [task 2017-06-30T22:26:56.367997Z] 22:26:56 INFO - Found by: stack scanning [task 2017-06-30T22:26:56.369637Z] 22:26:56 INFO - 39 firefox!_start + 0x29 [task 2017-06-30T22:26:56.371313Z] 22:26:56 INFO - rsp = 0x00007fff0589ea20 rip = 0x0000000000405f45 [task 2017-06-30T22:26:56.372935Z] 22:26:56 INFO - Found by: stack scanning

This affects only non-e10s.

Please also take a look at the browser-chrome failures (with e10s): https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=7dcc7dac37d19d0b8fe1d8100cfb01642c9d13a9&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=retry&filter-resultStatus=usercancel&filter-resultStatus=runnable E.g. browser/components/sessionstore/test/browser_background_tab_crash.js | tab is pending - false == true - JS frame :: chrome://mochitests/content/browser/browser/components/sessionstore/test/browser_background_tab_crash.js :: crashBackgroundTabs :: line 101 starts with this: https://treeherder.mozilla.org/logviewer.html#?job_id=111243158&repo=autoland

The non-e10s failures are easy enough to fix by only setting MOZ_CRASHREPORTER_SHUTDOWN in e10s mode, but I have no idea what's going on with the browser-chrome leaks. This is all fallout from the MOZ_CRASHREPORTER_SHUTDOWN commit. I think I'm going to only set it in the mochitest selftest harness here, then file a follow-up to get that landed for the general mochitest case.

Pushed by ahalberstadt@mozilla.com: https://hg.mozilla.org/integration/mozilla-inbound/rev/3c2e6a38cf89 Add ability to skip mochitest selftests based on mozinfo properties, r=jmaher https://hg.mozilla.org/integration/mozilla-inbound/rev/d63b3270cf43 Add additional mochitest selftests for crashes, assertions and leaks, r=jmaher

Here was the try run with latest changes: https://treeherder.mozilla.org/#/jobs?repo=try&revision=b3f9f29b5a4445a29ce7d1d3ae26e57d82eb2497

https://hg.mozilla.org/mozilla-central/rev/3c2e6a38cf89 https://hg.mozilla.org/mozilla-central/rev/d63b3270cf43