1152372 - Intermittent Windows OSError: IO Completion Port failed to signal process shutdown after "ABORT: Aborting on channel error.: file ipc\glue\MessageChannel.cpp, line 1610"

Reporter

Description

•

10 years ago

21:45:48 INFO - 165 INFO TEST-START | layout/base/tests/test_remote_frame.html 21:45:48 INFO - ++DOMWINDOW == 140 (000000EF06EF8000) [pid = 1260] [serial = 591] [outer = 000000EF0398AC00] 21:45:48 INFO - [Parent 1260] WARNING: Performance Entry buffer size maximum reached!: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\dom\base\nsPerformance.cpp, line 593 21:45:50 INFO - [NPAPI 1628] ###!!! ABORT: Aborting on channel error.: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\ipc\glue\MessageChannel.cpp, line 1610 21:48:55 INFO - Parent process 1260 exited with children alive: 21:48:55 INFO - PIDS: 3900 21:48:55 INFO - Attempting to kill them... 21:50:22 INFO - [1528] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\toolkit\components\places\Database.cpp, line 453 21:50:22 INFO - [1528] WARNING: NS_ENSURE_TRUE(mDB) failed: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\toolkit\components\places\nsNavHistory.cpp, line 293 21:50:22 INFO - JavaScript error: resource://gre/modules/FormHistory.jsm, line 377: NS_ERROR_FAILURE: Component returned failure code: 0x80004005 (NS_ERROR_FAILURE) [nsIProperties.get] 21:50:22 INFO - [1528] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80004005: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\toolkit\components\places\Database.cpp, line 453 21:50:22 INFO - [1528] WARNING: NS_ENSURE_TRUE(mDB) failed: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\toolkit\components\places\nsNavHistory.cpp, line 293 21:50:22 INFO - JavaScript error: resource://gre/modules/PlacesUtils.jsm, line 1872: NS_ERROR_XPC_GS_RETURNED_FAILURE: Component returned failure code: 0x80570016 (NS_ERROR_XPC_GS_RETURNED_FAILURE) [nsIJSCID.getService] 21:52:25 INFO - Exception in thread Thread-17: 21:52:25 INFO - Traceback (most recent call last): 21:52:25 INFO - File "c:\mozilla-build\python27\Lib\threading.py", line 551, in __bootstrap_inner 21:52:25 INFO - self.run() 21:52:25 INFO - File "c:\mozilla-build\python27\Lib\threading.py", line 504, in run 21:52:25 INFO - self.__target(*self.__args, **self.__kwargs) 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 350, in _procmgr 21:52:25 INFO - self._poll_iocompletion_port() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 385, in _poll_iocompletion_port 21:52:25 INFO - self.kill() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 158, in kill 21:52:25 INFO - self.returncode = self.wait() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 179, in wait 21:52:25 INFO - self.returncode = self._wait() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 492, in _wait 21:52:25 INFO - raise OSError(err) 21:52:25 INFO - OSError: IO Completion Port failed to signal process shutdown 21:52:25 INFO - Traceback (most recent call last): 21:52:25 INFO - File "C:\slave\test\build\tests\mochitest\runtests.py", line 2252, in doTests 21:52:25 INFO - quiet=options.quiet 21:52:25 INFO - File "C:\slave\test\build\tests\mochitest\runtests.py", line 1793, in runApp 21:52:25 INFO - status = proc.wait() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 807, in wait 21:52:25 INFO - self.returncode = self.proc.wait() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 179, in wait 21:52:25 INFO - self.returncode = self._wait() 21:52:25 INFO - File "C:\slave\test\build\venv\lib\site-packages\mozprocess\processhandler.py", line 492, in _wait 21:52:25 INFO - raise OSError(err) 21:52:25 INFO - OSError: IO Completion Port failed to signal process shutdown 21:52:25 INFO - 166 ERROR Automation Error: Received unexpected exception while running application 21:52:25 INFO - Stopping web server 21:52:25 INFO - Stopping web socket server 21:52:25 INFO - Stopping ssltunnel 21:52:25 INFO - TEST-INFO | leakcheck | default process: leak threshold set at 0 bytes 21:52:25 INFO - TEST-INFO | leakcheck | plugin process: leak threshold set at 0 bytes 21:52:25 INFO - TEST-INFO | leakcheck | tab process: leak threshold set at 25000 bytes 21:52:25 INFO - TEST-INFO | leakcheck | geckomediaplugin process: leak threshold set at 20000 bytes 21:52:25 WARNING - TEST-UNEXPECTED-FAIL | leakcheck | default process: missing output line for total leaks! 21:52:25 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\cltbld~1.t-w\appdata\local\temp\tmpsonjc8.mozrunner\runtests_leaks.log 21:52:25 WARNING - TEST-UNEXPECTED-FAIL | leakcheck | plugin process: missing output line for total leaks! 21:52:25 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\cltbld~1.t-w\appdata\local\temp\tmpsonjc8.mozrunner\runtests_leaks_plugin_pid1628.log 21:52:25 INFO - TEST-INFO | leakcheck | tab process: ignoring missing output line for total leaks 21:52:25 INFO - runtests.py | Running tests: end. 21:52:26 INFO - 167 INFO TEST-PASS | layout/base/tests/test_remote_frame.html | A valid string reason is expected 21:52:26 INFO - 168 INFO TEST-PASS | layout/base/tests/test_remote_frame.html | Reason cannot be empty 21:52:26 INFO - SUITE-END | took 490s 21:52:26 ERROR - Return code: 1 21:52:26 ERROR - No tests run or test summary not found

Comment hidden (Legacy TBPL/Treeherder Robot)

Ben Turner (not reading bugmail, use the needinfo flag!)

Comment 2

•

10 years ago

This is python blowing up...

Component: IPC → Mozbase

Product: Core → Testing

Jim Mathies [:jimm]

Comment 3

•

10 years ago

(In reply to Ben Turner [:bent] (use the needinfo flag!) from comment #2) > This is python blowing up... Actually I think the python problem is just a side effect, the chrome process aborts - 21:45:48 INFO - 165 INFO TEST-START | layout/base/tests/test_remote_frame.html 21:45:48 INFO - ++DOMWINDOW == 140 (000000EF06EF8000) [pid = 1260] [serial = 591] [outer = 000000EF0398AC00] 21:45:48 INFO - [Parent 1260] WARNING: Performance Entry buffer size maximum reached!: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\dom\base\nsPerformance.cpp, line 593 21:45:50 INFO - [NPAPI 1628] ###!!! ABORT: Aborting on channel error.: file c:\builds\moz2_slave\m-in-w64-d-0000000000000000000\build\src\ipc\glue\MessageChannel.cpp, line 1610 21:48:55 INFO - Parent process 1260 exited with children alive: 21:48:55 INFO - PIDS: 3900 21:48:55 INFO - Attempting to kill them... and then python blows up trying to clean up. Very very rare crash, and is test only based on the data in bug 1051567.

Jim Mathies [:jimm]

Updated

•

10 years ago

tracking-e10s: ? → -

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=b2g-inbound&job_id=2037210 repository: b2g-inbound start_time: 2015-05-28T10:11:37 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-076 buildname: Windows 8 64-bit b2g-inbound debug test mochitest-browser-chrome-3 revision: a82cebbfbbf3 251 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_basic.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 259 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_captureIfMissing.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 260 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_captureIfMissing.js | got notification of item being created. - Got 0, expected 1 262 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_captureIfMissing.js | Thumbnail should be cached after capture - 264 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_captureIfMissing.js | Test timed out - expected PASS 268 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_crash_during_capture.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 273 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_crash_while_idle.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 279 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_destroy_browser.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 284 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_no_alert.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 289 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_no_auth_prompt.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] 296 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_no_cookies_sent.js | uncaught exception - NS_ERROR_NOT_INITIALIZED: Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] at resource://gre/modules/BackgroundPageThumbs.jsm:298 303 INFO TEST-UNEXPECTED-FAIL | toolkit/components/thumbnails/test/browser_thumbnails_bg_no_cookies_stored.js | A promise chain failed to handle a rejection: - at resource://gre/modules/BackgroundPageThumbs.jsm:298 - Component returned failure code: 0xc1f30001 (NS_ERROR_NOT_INITIALIZED) [nsIMessageSender.sendAsyncMessage] OSError: IO Completion Port failed to signal process shutdown OSError: IO Completion Port failed to signal process shutdown 307 ERROR Automation Error: Received unexpected exception while running application TEST-UNEXPECTED-FAIL | leakcheck | default process: missing output line for total leaks! Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=14276187 repository: mozilla-inbound start_time: 2015-09-17T08:46:29 who: philringnalda[at]gmail[dot]com machine: t-w732-ix-065 buildname: Windows 7 32-bit mozilla-inbound talos g2-e10s revision: 655a465bcc04 2015-09-17 08:53:22,658 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:53:59,823 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:54:36,726 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:55:13,941 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:55:51,941 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:56:28,696 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:57:06,592 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:57:43,917 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:58:22,285 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:59:00,743 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 08:59:38,703 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:00:16,703 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:00:54,914 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:01:33,178 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:02:11,657 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:02:50,917 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:03:29,313 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:04:07,880 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:04:47,996 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:05:27,342 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:06:06,487 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:06:46,403 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:07:25,838 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:08:06,829 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 09:08:47,213 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-17 10:09:08,066 DEBUG : BROWSER_OUTPUT: [Child 2320] ###!!! ABORT: Aborting on channel error.: file c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 1768 Traceback (most recent call last): TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): OSError: IO Completion Port failed to signal process shutdown Return code: 1 TALOSDATA was seen 0 times, expected 1. # TBPL WARNING #

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=14536184 repository: mozilla-inbound start_time: 2015-09-22T17:11:53 who: philringnalda[at]gmail[dot]com machine: t-w732-ix-090 buildname: Windows 7 32-bit mozilla-inbound talos g2-e10s revision: 9545ee4293e5 2015-09-22 17:18:20,255 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:18:54,588 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:19:30,062 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:20:05,323 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:20:40,052 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:21:15,724 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:21:51,042 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:22:26,878 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:23:02,736 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:23:37,825 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:24:14,009 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:24:50,308 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:25:26,813 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:26:03,302 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:26:39,519 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:27:17,016 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 17:27:53,750 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-22 18:17:42,974 DEBUG : BROWSER_OUTPUT: [Child 196] ###!!! ABORT: Aborting on channel error.: file c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 1768 Traceback (most recent call last): TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): OSError: IO Completion Port failed to signal process shutdown Return code: 1 TALOSDATA was seen 0 times, expected 1. # TBPL WARNING #

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=14573240 repository: mozilla-inbound start_time: 2015-09-23T02:13:07 who: tomcat[at]mozilla[dot]com machine: t-w732-ix-122 buildname: Windows 7 32-bit mozilla-inbound talos g2-e10s revision: c57ca7dcefef 2015-09-23 02:18:28,801 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:19:03,181 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:19:38,920 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:20:14,476 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:20:49,030 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:21:24,982 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:21:59,865 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:22:35,634 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:23:11,483 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:23:46,595 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:24:22,655 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:24:58,418 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:25:35,059 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:26:11,927 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:26:47,934 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 02:27:24,815 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-23 03:17:51,713 DEBUG : BROWSER_OUTPUT: [Child 2712] ###!!! ABORT: Aborting on channel error.: file c:/builds/moz2_slave/m-in-w32-000000000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 1768 Traceback (most recent call last): TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): OSError: IO Completion Port failed to signal process shutdown Return code: 1 TALOSDATA was seen 0 times, expected 1. # TBPL WARNING #

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=fx-team&job_id=4832309 repository: fx-team start_time: 2015-09-25T05:37:29 who: tomcat[at]mozilla[dot]com machine: t-w732-ix-012 buildname: Windows 7 32-bit fx-team talos g2-e10s revision: 7b145ea2fbde 2015-09-25 05:44:28,265 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:45:06,082 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:45:41,795 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:46:18,898 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:46:56,984 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:47:33,779 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:48:10,979 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:48:48,078 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:49:26,108 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:50:03,582 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:50:41,118 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:51:19,046 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:51:56,717 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:52:35,355 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:53:13,575 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:53:51,707 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:54:30,394 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:55:09,111 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:55:48,740 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:56:28,125 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:57:08,000 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:57:47,740 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:58:28,128 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:59:08,595 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 05:59:49,276 DEBUG : BROWSER_OUTPUT: Handler function threw an exception: TypeError: can't access dead object 2015-09-25 07:00:09,617 DEBUG : BROWSER_OUTPUT: [Child 4484] ###!!! ABORT: Aborting on channel error.: file c:/builds/moz2_slave/fx-team-w32-000000000000000000/build/src/ipc/glue/MessageChannel.cpp, line 1768 Traceback (most recent call last): TypeError: object of type 'NoneType' has no len() Traceback (most recent call last): OSError: IO Completion Port failed to signal process shutdown Return code: 1 TALOSDATA was seen 0 times, expected 1. # TBPL WARNING #

Comment hidden (Intermittent Failures Robot)

Andrew Halberstadt [:ahal]

Updated

•

9 years ago

See Also: → https://bugzilla.mozilla.org/show_bug.cgi?id=1274584

Comment hidden (Intermittent Failures Robot)

Andrew Halberstadt [:ahal]

Comment 48

•

8 years ago

I believe I have a fix for the python OSError in bug 1274584. But Jim is right in comment 3. The OSError is a failure while mozprocess is trying to cleanup and force-kill the leftover child processes. But there is still some kind of underlying issue that is causing the child processes to not get terminated properly in the first place. So after bug 1274584, OSError will no longer be raised and (I think) the jobs will no longer turn orange.

Comment hidden (Intermittent Failures Robot)

Henrik Skupin [:whimboo][⌚️UTC+2]

Comment 53

•

7 years ago

No updates in the last 2 years. Going to mark as WFM.

Status: NEW → RESOLVED

Closed: 7 years ago

Resolution: --- → WORKSFORME

Comment hidden (Intermittent Failures Robot)

Andreea Pavel [:apavel]

Comment 55

•

6 years ago

Recent failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=179895553&repo=autoland&lineNumber=2990394 21:54:13 INFO - MemoryError 21:56:57 INFO - JavaScript error: jar:file:///Z:/task_1527109412/build/application/firefox/omni.ja!/components/nsPlacesExpiration.js, line 805: TypeError: this._db is undefined 21:57:43 INFO - Traceback (most recent call last): 21:57:43 INFO - File "Z:\task_1527109412\build\venv\lib\site-packages\mozprocess\processhandler.py", line 521, in _wait 21:57:43 INFO - self.MAX_PROCESS_KILL_DELAY) 21:57:43 INFO - File "c:\mozilla-build\python\Lib\Queue.py", line 176, in get 21:57:43 INFO - raise Empty 21:57:43 INFO - Empty 21:57:43 INFO - IO Completion Port unexpectedly closed 21:57:43 INFO - Traceback (most recent call last): 21:57:43 INFO - File "Z:\task_1527109412\build\tests\mochitest\runtests.py", line 2802, in doTests 21:57:43 INFO - marionette_args=marionette_args, 21:57:43 INFO - File "Z:\task_1527109412\build\tests\mochitest\runtests.py", line 2289, in runApp 21:57:43 INFO - status = proc.wait() 21:57:43 INFO - File "Z:\task_1527109412\build\venv\lib\site-packages\mozprocess\processhandler.py", line 863, in wait 21:57:43 INFO - self.returncode = self.proc.wait() 21:57:43 INFO - File "Z:\task_1527109412\build\venv\lib\site-packages\mozprocess\processhandler.py", line 221, in wait 21:57:43 INFO - self.returncode = self._wait() 21:57:43 INFO - File "Z:\task_1527109412\build\venv\lib\site-packages\mozprocess\processhandler.py", line 527, in _wait 21:57:43 INFO - raise OSError("IO Completion Port failed to signal process shutdown") 21:57:43 INFO - OSError: IO Completion Port failed to signal process shutdown 21:57:43 INFO - 832 ERROR Automation Error: Received unexpected exception while running application 21:57:43 INFO - Stopping web server 21:57:43 INFO - Stopping web socket server 21:57:43 INFO - Stopping ssltunnel 21:57:43 INFO - TEST-INFO | leakcheck | default process: leak threshold set at 0 bytes 21:57:43 INFO - TEST-INFO | leakcheck | plugin process: leak threshold set at 0 bytes 21:57:43 INFO - TEST-INFO | leakcheck | tab process: leak threshold set at 1000 bytes 21:57:43 INFO - TEST-INFO | leakcheck | geckomediaplugin process: leak threshold set at 20000 bytes 21:57:43 INFO - TEST-INFO | leakcheck | gpu process: leak threshold set at 0 bytes 21:57:43 ERROR - 833 ERROR TEST-UNEXPECTED-FAIL | leakcheck | default process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks.log 21:57:43 ERROR - 834 ERROR TEST-UNEXPECTED-FAIL | leakcheck | plugin process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_plugin_pid3344.log 21:57:43 ERROR - 835 ERROR TEST-UNEXPECTED-FAIL | leakcheck | plugin process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_plugin_pid3972.log 21:57:43 ERROR - 836 ERROR TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_tab_pid1964.log 21:57:43 ERROR - 837 ERROR TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_tab_pid3480.log 21:57:43 ERROR - 838 ERROR TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_tab_pid3904.log 21:57:43 ERROR - 839 ERROR TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_tab_pid5800.log 21:57:43 ERROR - 840 ERROR TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks! 21:57:43 INFO - TEST-INFO | leakcheck | missing output line from log file c:\users\task_1527109412\appdata\local\temp\tmpnthpd0.mozrunner\runtests_leaks_tab_pid6016.log 21:57:43 INFO - runtests.py | Running tests: end. 21:57:43 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:44 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:45 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:46 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:48 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:51 INFO - Exception WindowsError: WindowsError(5, 'Access is denied') in <bound method Profile.__del__ of <mozprofile.profile.Profile object at 0x025C8690>> ignored 21:57:51 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:51 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:52 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:54 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:56 INFO - remove() failed for "(u'c:\\users\\task_1527109412\\appdata\\local\\temp\\tmpnthpd0.mozrunner\\extensions\\workerbootstrap-test@mozilla.org.xpi',)". Reason: Access is denied (13). Retrying... 21:57:58 INFO - Exception WindowsError: WindowsError(5, 'Access is denied') in <bound method AddonManager.__del__ of <mozprofile.addons.AddonManager object at 0x02A4E6F0>> ignored 21:57:58 INFO - Buffered messages logged at 21:25:43 21:57:58 INFO - 841 INFO Entering test bound contentscript_connect_and_move_tabs 21:57:58 INFO - 842 INFO Extension loaded 21:57:58 INFO - 843 INFO Console message: Warning: attempting to write 5424 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes. 21:57:58 INFO - Buffered messages logged at 21:25:44 21:57:58 INFO - 844 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_connect_and_move_tabs.js | expected message - Expected: connect_from_script, Actual: connect_from_script - 21:57:58 INFO - Buffered messages logged at 21:25:46 21:57:58 INFO - 845 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_connect_and_move_tabs.js | expected message - Expected: ping, Actual: ping - 21:57:58 INFO - 846 INFO Console message: [JavaScript Error: "Promise rejected after context unloaded: Message manager disconnected 21:57:58 INFO - " {file: "moz-extension://57e2d3e2-dd3e-4972-9358-7e6a057ea125/script.js" line: 8}] 21:57:58 INFO - @moz-extension://57e2d3e2-dd3e-4972-9358-7e6a057ea125/script.js:8:13 21:57:58 INFO - 847 INFO Leaving test bound contentscript_connect_and_move_tabs 21:57:58 INFO - 848 INFO Entering test bound extension_tab_connect_and_move_tabs 21:57:58 INFO - 849 INFO Extension loaded 21:57:58 INFO - 850 INFO Console message: Warning: attempting to write 5504 bytes to preference extensions.webextensions.uuids. This is bad for general performance and memory usage. Such an amount of data should rather be written to an external file. This preference will not be sent to any content processes. 21:57:58 INFO - 851 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_connect_and_move_tabs.js | expected message - Expected: open_extension_tab, Actual: open_extension_tab - 21:57:58 INFO - 852 INFO TEST-PASS | browser/components/extensions/test/browser/test-oop-extensions/browser_ext_connect_and_move_tabs.js | expected message - Expected: connect_from_script, Actual: connect_from_script - 21:57:58 INFO - Buffered messages finished 21:57:58 INFO - Running manifest: browser\extensions\webcompat-reporter\test\browser\browser.ini 21:57:58 INFO - The following extra prefs will be set: 21:57:58 INFO - dom.animations-api.core.enabled=true 21:57:59 INFO - Z:\task_1527109412\build\tests\bin\pk12util.exe: PKCS12 IMPORT SUCCESSFUL 21:57:59 INFO - Increasing default timeout to 90 seconds 21:57:59 INFO - MochitestServer : launching [u'Z:\\task_1527109412\\build\\tests\\bin\\xpcshell.exe', '-g', 'Z:\\task_1527109412\\build\\application\\firefox', '-f', 'Z:\\task_1527109412\\build\\tests\\bin\\components\\httpd.js', '-e', "const _PROFILE_PATH = 'c:\\\\users\\\\task_1527109412\\\\appdata\\\\local\\\\temp\\\\tmp7dncyp.mozrunner'; const _SERVER_PORT = '8888'; const _SERVER_ADDR = '127.0.0.1'; const _TEST_PREFIX = undefined; const _DISPLAY_RESULTS = false;", '-f', 'Z:\\task_1527109412\\build\\tests\\mochitest\\server.js'] 21:57:59 INFO - runtests.py | Server pid: 6024 21:57:59 INFO - runtests.py | Websocket server pid: 5296 21:57:59 INFO - runtests.py | SSL tunnel pid: 4596 21:57:59 INFO - Couldn't convert chrome URL: chrome://branding/locale/brand.properties 21:57:59 INFO - [6024, Main Thread] WARNING: Failed to get directory to cache.: file z:/build/build/src/security/sandbox/win/src/sandboxbroker/sandboxBroker.cpp, line 83 21:57:59 INFO - [6024, Main Thread] WARNING: Failed to get directory to cache.: file z:/build/build/src/security/sandbox/win/src/sandboxbroker/sandboxBroker.cpp, line 83 21:57:59 INFO - [6024, Main Thread] WARNING: Failed to get directory to cache.: file z:/build/build/src/security/sandbox/win/src/sandboxbroker/sandboxBroker.cpp, line 83 21:57:59 INFO - [6024, Main Thread] WARNING: Failed to get directory to cache.: file z:/build/build/src/security/sandbox/win/src/sandboxbroker/sandboxBroker.cpp, line 83 21:57:59 INFO - [6024, Main Thread] WARNING: Could not get the program name for a cubeb stream.: 'NS_SUCCEEDED(rv)', file z:/build/build/src/dom/media/CubebUtils.cpp, line 351 21:57:59 INFO - runtests.py | Running with e10s: True 21:57:59 INFO - runtests.py | Running tests: start. 21:57:59 INFO - Found 'firefox' running before starting test browser!

Status: RESOLVED → REOPENED

Resolution: WORKSFORME → ---

Henrik Skupin [:whimboo][⌚️UTC+2]

Comment 56

•

6 years ago

The above happens due to the following assertion which repeats and fills up the log until a memory error is reported: > 21:54:11 INFO - GECKO(2920) | [Parent 2920, Compositor] ###!!! ASSERTION: Child has wrong manager: 'Error', file z:/build/build/src/gfx/layers/Layers.cpp, line 966 > 21:54:11 INFO - GECKO(2920) | #01: mozilla::layers::ContainerLayer::RemoveChild(mozilla::layers::Layer *) [gfx/layers/Layers.cpp:966] > 21:54:11 INFO - GECKO(2920) | #02: mozilla::layers::ContainerLayerComposite::~ContainerLayerComposite() [gfx/layers/composite/ContainerLayerComposite.cpp:653] > 21:54:11 INFO - GECKO(2920) | #03: mozilla::layers::Layer::Release() [gfx/layers/Layers.h:782] So this is bug 1346126.

Henrik Skupin [:whimboo][⌚️UTC+2]

Updated

•

6 years ago

Blocks: 1346126

Comment hidden (Intermittent Failures Robot)

BugBot [:suhaib / :marco/ :calixte]

Comment 63

•

5 years ago

Bugbug thinks this bug is a regression, but please revert this change in case of error.

Keywords: regression

Comment hidden (Intermittent Failures Robot)

Ryan VanderMeulen [:RyanVM]

Reporter

Updated

•

3 years ago

Status: REOPENED → RESOLVED

Closed: 7 years ago → 3 years ago

status-firefox40: affected → wontfix

Resolution: --- → WORKSFORME