https://tbpl.mozilla.org/php/getParsedLog.php?id=25278358&tree=Mozilla-Inbound Windows 7 32-bit mozilla-inbound debug test mochitest-2 on 2013-07-15 01:37:02 PDT for push fb87ff45a454 slave: t-w732-ix-090 01:52:49 INFO - out of memory: 0x00000000008A0140 bytes requested 01:52:49 INFO - Hit MOZ_CRASH() at e:/builds/moz2_slave/m-in-w32-d-0000000000000000000/build/memory/mozalloc/mozalloc_abort.cpp:30 01:52:51 WARNING - TEST-UNEXPECTED-FAIL | /tests/dom/imptests/webapps/DOMCore/tests/approved/test_Range-set.html | Exited with code -2147483645 during test run 01:52:51 INFO - INFO | automation.py | Application ran for: 0:12:40.063000 01:52:51 INFO - INFO | zombiecheck | Reading PID log: c:\users\cltbld\appdata\local\temp\tmpau74dcpidlog 01:52:51 INFO - ==> process 2680 launched child process 3456 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be179e8.390454842 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2780 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19875e40.865779382 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 4044 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1935dd60.1418968531 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3504 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1938e5b8.1124846277 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2308 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.193781d8.1289856850 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1712 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1bdf5440.47067234 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2788 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.184fed20.1007039268 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2920 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19388f30.1772538431 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3368 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.184f12f8.1023377985 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 728 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.185022c0.555801973 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3844 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19352078.1924422819 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1956 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1850f6d0.927556829 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1040 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1fe617a0.877314572 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1284 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.184e33f0.2104666706 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3932 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.10f34b28.1853563170 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3284 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1bdec6e0.1456321533 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1160 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1fe4ee40.1372932586 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3200 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.18522030.271822418 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3128 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.18505c08.44455639 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3940 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.184f3518.473271171 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1516 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.18509a30.166143643 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3864 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.185217a8.706711641 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3556 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be13200.1413507977 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3448 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be1e048.1441988691 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2080 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.101de670.1866045830 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3960 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1bdfcbb0.2003870050 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 216 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1fe571e0.663685753 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3384 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1936b2a8.873098641 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3180 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be0f030.1786456793 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2236 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1fe61668.3324414 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2068 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122bb468.1060740546 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2740 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122989e0.2094811813 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 732 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122a5088.1086524988 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 912 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122c15e8.1559458289 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2880 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122b9728.1986622705 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3620 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.184f4fe8.739290415 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3452 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.10a0af58.771380896 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1896 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.10a0a460.1118233570 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3248 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19877430.2026608841 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2928 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19868f10.214717567 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1716 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1fe63138.875108586 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2608 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.c802740.1925100383 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2408 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.c8114e8.1093084732 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2772 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.c809280.1467851180 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1116 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be10fe0.485356876 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3988 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.122909e8.1428599005 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2924 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1bde9d70.231631178 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3312 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be1e8d0.1848001622 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3040 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be03480.1818878514 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3708 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be252d8.850083889 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1544 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1be0b208.1838163285 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 4016 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19862640.638548785 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3868 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1988d6d8.1452782396 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1320 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.19879da0.1571481973 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 3176 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1986d488.2118580817 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 4024 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1938b4f8.1729328249 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 1516 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1987df70.994540076 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:51 INFO - ==> process 2680 launched child process 2064 ("C:\slave\test\build\application\firefox\plugin-container.exe" --channel=2680.1985d228.866436594 -greomni "C:\slave\test\build\application\firefox\omni.ja" -appomni "C:\slave\test\build\application\firefox\browser\omni.ja" -appdir "C:\slave\test\build\application\firefox\browser" - 2680 "\\.\pipe\gecko-crash-server-pipe.2680" tab) 01:52:52 WARNING - PROCESS-CRASH | /tests/dom/imptests/webapps/DOMCore/tests/approved/test_Range-set.html | application crashed [@ mozalloc_abort(char const * const)] 01:52:52 INFO - Crash dump filename: c:\users\cltbld\appdata\local\temp\tmp8kew9g\minidumps\65cfa9c0-936f-4381-9e4f-b4ebe3d64bca.dmp 01:52:52 INFO - Operating system: Windows NT 01:52:52 INFO - 6.1.7601 Service Pack 1 01:52:52 INFO - CPU: x86 01:52:52 INFO - GenuineIntel family 6 model 30 stepping 5 01:52:52 INFO - 8 CPUs 01:52:52 INFO - Crash reason: EXCEPTION_BREAKPOINT 01:52:52 INFO - Crash address: 0x70d31245 01:52:52 INFO - Thread 0 (crashed) 01:52:52 INFO - 0 mozalloc.dll!mozalloc_abort(char const * const) [mozalloc_abort.cpp:fb87ff45a454 : 30 + 0x2c] 01:52:52 INFO - eip = 0x70d31245 esp = 0x002befb4 ebp = 0x002befbc ebx = 0x00000000 01:52:52 INFO - esi = 0x68cf1440 edi = 0x68cf0670 eax = 0x00000000 ecx = 0xc8542cc8 01:52:52 INFO - edx = 0x68dee4d8 efl = 0x00200216 01:52:52 INFO - Found by: given as instruction pointer in context 01:52:52 INFO - 1 mozalloc.dll!mozalloc_handle_oom(unsigned int) [mozalloc_oom.cpp:fb87ff45a454 : 50 + 0x8] 01:52:52 INFO - eip = 0x70d312bf esp = 0x002befc4 ebp = 0x002bf00c 01:52:52 INFO - Found by: call frame info 01:52:52 INFO - 2 mozalloc.dll!moz_xmalloc [mozalloc.cpp:fb87ff45a454 : 56 + 0x5] 01:52:52 INFO - eip = 0x70d310b5 esp = 0x002bf014 ebp = 0x002bf020 01:52:52 INFO - Found by: call frame info

The stack from comment 0 is interesting in that after moz_xmalloc it stops giving function names.

I looked into that, it turns out the minidump is just missing the debug info for xul.dll, so it can't match up symbols. I hacked around that and got the stack: Thread 0 (crashed) 0 mozalloc.dll!mozalloc_abort(char const * const) [mozalloc_abort.cpp:fb87ff45a454 : 30 + 0x2c] eip = 0x70d31245 esp = 0x002befb4 ebp = 0x002befbc ebx = 0x00000000 esi = 0x68cf1440 edi = 0x68cf0670 eax = 0x00000000 ecx = 0xc8542cc8 edx = 0x68dee4d8 efl = 0x00200216 Found by: given as instruction pointer in context 1 mozalloc.dll!mozalloc_handle_oom(unsigned int) [mozalloc_oom.cpp:fb87ff45a454 : 50 + 0x9] eip = 0x70d312bf esp = 0x002befc4 ebp = 0x002bf00c Found by: call frame info 2 mozalloc.dll!moz_xmalloc [mozalloc.cpp:fb87ff45a454 : 56 + 0x6] eip = 0x70d310b5 esp = 0x002bf014 ebp = 0x002bf020 Found by: call frame info 3 xul.dll!nsTArray_base<nsTArrayInfallibleAllocator,nsTArray_CopyElements<SnowWhiteObject> >::EnsureCapacity(unsigned int,unsigned int) [nsTArray-inl.h:fb87ff45a454 : 119 + 0x18] eip = 0x660b197c esp = 0x002bf028 ebp = 0x002bf038 Found by: call frame info 4 xul.dll!SnowWhiteKiller::SnowWhiteKiller(unsigned int) [nsCycleCollector.cpp:fb87ff45a454 : 2164 + 0x10] eip = 0x660b428b esp = 0x002bf040 ebp = 0x002bf050 Found by: call frame info 5 xul.dll!nsPurpleBuffer::RemoveSkippable(bool,void (*)(void)) [nsCycleCollector.cpp:fb87ff45a454 : 2246 + 0xa] eip = 0x660b431c esp = 0x002bf058 ebp = 0x002bf06c Found by: call frame info 6 xul.dll!nsCycleCollector::ForgetSkippable(bool) [nsCycleCollector.cpp:fb87ff45a454 : 2304 + 0xe] eip = 0x660b43cf esp = 0x002bf074 ebp = 0x002bf080 Found by: call frame info 7 xul.dll!nsCycleCollector_forgetSkippable(bool) [nsCycleCollector.cpp:fb87ff45a454 : 3285 + 0xd] eip = 0x660b47ea esp = 0x002bf088 ebp = 0x002bf094 Found by: call frame info 8 xul.dll!FireForgetSkippable [nsJSEnvironment.cpp:fb87ff45a454 : 2499 + 0x8] eip = 0x668b52be esp = 0x002bf09c ebp = 0x002bf0b4 Found by: call frame info 9 xul.dll!CCTimerFired [nsJSEnvironment.cpp:fb87ff45a454 : 2781 + 0x9] eip = 0x668bb5aa esp = 0x002bf0bc ebp = 0x002bf0d4 Found by: call frame info 10 xul.dll!nsTimerImpl::Fire() [nsTimerImpl.cpp:fb87ff45a454 : 543 + 0x6] eip = 0x660a8e70 esp = 0x002bf0dc ebp = 0x002bf15c Found by: call frame info 11 xul.dll!nsTimerEvent::Run() [nsTimerImpl.cpp:fb87ff45a454 : 627 + 0xf] eip = 0x660a8fd3 esp = 0x002bf164 ebp = 0x002bf18c Found by: call frame info 12 xul.dll!nsThread::ProcessNextEvent(bool,bool *) [nsThread.cpp:fb87ff45a454 : 621 + 0xe] eip = 0x660a50fe esp = 0x002bf194 ebp = 0x002bf1f0 Found by: call frame info 13 xul.dll!NS_ProcessNextEvent(nsIThread *,bool) [nsThreadUtils.cpp:fb87ff45a454 : 238 + 0xd] eip = 0x6605910f esp = 0x002bf1f8 ebp = 0x002bf204 Found by: call frame info 14 xul.dll!mozilla::ipc::MessagePump::Run(base::MessagePump::Delegate *) [MessagePump.cpp:fb87ff45a454 : 81 + 0xa] eip = 0x65be013b esp = 0x002bf20c ebp = 0x002bf230 Found by: call frame info 15 xul.dll!MessageLoop::RunInternal() [message_loop.cc:fb87ff45a454 : 219 + 0x9] eip = 0x660e8a4c esp = 0x002bf238 ebp = 0x002bf250 Found by: call frame info 16 xul.dll!MessageLoop::RunHandler() [message_loop.cc:fb87ff45a454 : 212 + 0x5] eip = 0x660e8f89 esp = 0x002bf258 ebp = 0x002bf284 Found by: call frame info 17 xul.dll!MessageLoop::Run() [message_loop.cc:fb87ff45a454 : 186 + 0x7] eip = 0x660e9454 esp = 0x002bf28c ebp = 0x002bf2a4 Found by: call frame info 18 xul.dll!nsBaseAppShell::Run() [nsBaseAppShell.cpp:fb87ff45a454 : 163 + 0xc] eip = 0x66f8e58f esp = 0x002bf2ac ebp = 0x002bf2b4 Found by: call frame info 19 xul.dll!nsAppShell::Run() [nsAppShell.cpp:fb87ff45a454 : 113 + 0x8] eip = 0x66f54d6f esp = 0x002bf2bc ebp = 0x002bf2c4 Found by: call frame info 20 xul.dll!nsAppStartup::Run() [nsAppStartup.cpp:fb87ff45a454 : 269 + 0x12] eip = 0x66cd8436 esp = 0x002bf2cc ebp = 0x002bf2d4 Found by: call frame info 21 xul.dll!XREMain::XRE_mainRun() [nsAppRunner.cpp:fb87ff45a454 : 3853 + 0xe] eip = 0x65ab4c06 esp = 0x002bf2dc ebp = 0x002bf39c Found by: call frame info 22 xul.dll!XREMain::XRE_main(int,char * * const,nsXREAppData const *) [nsAppRunner.cpp:fb87ff45a454 : 3921 + 0x7] eip = 0x65ab4dae esp = 0x002bf3a4 ebp = 0x002bf3b8 Found by: call frame info 23 xul.dll!XRE_main [nsAppRunner.cpp:fb87ff45a454 : 4134 + 0x12] eip = 0x65ab51f6 esp = 0x002bf3c0 ebp = 0x002bf4c8 Found by: call frame info 24 firefox.exe!do_main [nsBrowserApp.cpp:fb87ff45a454 : 272 + 0x1d] eip = 0x012620b1 esp = 0x002bf4d0 ebp = 0x002bfbe0 Found by: call frame info

This is probably a place where we are waiting too long to run the SnowWhite killer, so when it tries to copy the array or whatever it is just too late.

Should this be using fallible allocation?

It is just calling SetCapacity on an nsTArray. I'm a little surprised that is ending up as infallible. It is also a bit unfortunate because the size we're setting the array to is an upper bound. smaug, maybe we shouldn't do the SetCapacity if aMaxCount is above some threshold?

Or we should just delete snowwhite more often. But I still wonder why this started 15th and not when SnowWhite landed.

nsTArray is infallible by default, so any call which fails due to OOM (including SetCapacity) will abort. The thing that I don't really understand is why we'd be getting anywhere close to OOM in our mochitests. Perhaps this is a jemalloc memory corruption which shows up as OOM? Or is there something about this test that actually uses huge amounts of memory (presumably this would also be a slow test, since we'd be thrashing well before we hit actually OOM conditions).

Because of SnowWhite we may use temporarily more memory, since it is CC which deletes objects, not Release(). I'll tweak SnowWhite handling.

Is there a doc explaining what snowwhite is? It sounds like we're talking about all CCed objects being lazily deleted, which also sounds like a really significant loss for highwater memory usage and potentially also for memory fragmentation. But a quick google search didn't show any docs about this, so I'm reading tea leaves and maybe worrying about nothing. Early deletion is a big advantage of refcounting+CC compared with GC! In any case, if we're running anywhere close to OOM conditions, we need to aggressively schedule these collections.

Currently the documentation is in nsCycleCollector.cpp and https://bugzilla.mozilla.org/show_bug.cgi?id=snow-white Late deletion gives us sane addref/release speed, and fixes a class of security bugs.

Another CC OOM intermittent orange kicked into high gear on the 16th, bug 886631. Very odd.

Objects are being deleted lazily now, but we're supposed to purge them every few hundred milliseconds. One problem might be that we're not going to purge them during an IGC (forgetSkippable does not run then), except for the spawned runnables, and during tests that allocate a huge amount of memory we may be spending a lot of time GCing. > The thing that I don't really understand is why we'd be getting anywhere close to OOM in our mochitests. It isn't that surprising, another one in this series was disabled for OOMing during CC in bug 875585. My understanding is that they are a very very comprehensive series of tests.

(In reply to Benjamin Smedberg [:bsmedberg] from comment #13) > The thing that I don't really understand > is why we'd be getting anywhere close to OOM in our mochitests. We have some absolutely crazy tests creating tons of range objects and keeping them alive. IIRC some of them have been disabled on mobile/b2g for quite some time.

(In reply to comment #9) > It is just calling SetCapacity on an nsTArray. I'm a little surprised that is > ending up as infallible. It is also a bit unfortunate because the size we're > setting the array to is an upper bound. smaug, maybe we shouldn't do the > SetCapacity if aMaxCount is above some threshold? Yeah... nsTArray is really InfallibleTArray, which is really really confusing. You want FallibleTArray, I think.

The fact that we have different *types* for fallible and infallible tarray does annoy me. I'd much rather have them like the string classes and hashtables, where you use the same type, but you make the fallible calls explicit using fallible_t. In any case, a bit beyond this bug. If you really want SnowWhiteKiller::mObjects to be a fallible array, you can do that, but you'd have to error-check the call to AppendElement in ShowWhiteKiller::Visit.

SnowWhiteKiller could be made more OOM resistant by switching to a fallible array, then setting some kind of flag if we run out of memory for AppendElement, and we could rerun the freeing loop if we ran out of memory, and freed at least one object, or something, though you could end up spending a lot of CPU time... (SnowWhiteKiller iterates over the purple buffer, looking for objects with refcount of 0, and runs the destructor and frees them.)

(In reply to comment #24) > The fact that we have different *types* for fallible and infallible tarray does > annoy me. I'd much rather have them like the string classes and hashtables, > where you use the same type, but you make the fallible calls explicit using > fallible_t. Well, they're really different typedefs based on nsTArray with different allocator type traits. The annoying thing I was tallking about was more about having FallibleTArray and InfallibleTArray which almost nobody knows about, and then have nsTArray which hides the allocation semantics and puts people into trouble because they use it without thinking about the allocation strategy they want. But I don't want to derail this bug more than I already have. :-)

Probably fixed for realsies by bug 920043.