Closed
Bug 829551
Opened 12 years ago
Closed 10 years ago
Intermittent B2G "marionette.errors.TimeoutException: socket.timeout" (apparent emulator hang on startup)
Categories
(Firefox OS Graveyard :: General, defect)
Tracking
(Not tracked)
RESOLVED
WORKSFORME
People
(Reporter: emorley, Unassigned)
References
Details
(Keywords: intermittent-failure)
Probably just a dupe of some of the other bugs, but I find these failure modes fairly unhelpful to grok (ideally we'd have all socket.timeouts caught and a constant message given, if they re all due to the same emulator issue)
b2g_ics_armv7a_gecko_emulator mozilla-inbound opt test reftest-6 on 2013-01-11 00:43:14 PST for push 11879a83e5e7
slave: talos-r3-fed-079
https://tbpl.mozilla.org/php/getParsedLog.php?id=18702752&tree=Mozilla-Inbound
{
00:48:40 INFO - REFTEST INFO | runreftest.py | Running tests: start.
00:48:45 INFO - MOZPROCESS WARNING: ProcessHandler.waitForFinish() is deprecated, use ProcessHandler.wait() instead
00:52:04 INFO - Traceback (most recent call last):
00:52:04 INFO - File "runreftestb2g.py", line 564, in main
00:52:04 INFO - retVal = reftest.runTests(manifest, options, cmdlineArgs)
00:52:04 INFO - File "/home/cltbld/talos-slave/test/build/tests/reftest/runreftest.py", line 140, in runTests
00:52:04 INFO - timeout=options.timeout + 30.0)
00:52:04 INFO - File "/home/cltbld/talos-slave/test/build/tests/reftest/automation.py", line 1072, in runApp
00:52:04 INFO - stderr = subprocess.STDOUT)
00:52:04 INFO - File "/home/cltbld/talos-slave/test/build/tests/reftest/b2gautomation.py", line 253, in Process
00:52:04 INFO - session = self.marionette.start_session()
00:52:04 INFO - File "/home/cltbld/talos-slave/test/build/venv/lib/python2.6/site-packages/marionette/marionette.py", line 306, in start_session
00:52:04 INFO - self.session = self._send_message('newSession', 'value')
00:52:04 INFO - File "/home/cltbld/talos-slave/test/build/venv/lib/python2.6/site-packages/marionette/marionette.py", line 212, in _send_message
00:52:04 ERROR - raise TimeoutException(message='socket.timeout', status=ErrorCodes.TIMEOUT, stacktrace=None)
00:52:04 ERROR - TimeoutException: socket.timeout
00:52:04 INFO - Automation Error: Exception caught while running tests
}
Comment 1•12 years ago
|
||
Comment 2•12 years ago
|
||
Comment 3•12 years ago
|
||
Comment 4•12 years ago
|
||
Comment 5•12 years ago
|
||
Reporter | ||
Comment 6•12 years ago
|
||
Comment 7•12 years ago
|
||
Reporter | ||
Comment 8•12 years ago
|
||
Reporter | ||
Comment 9•12 years ago
|
||
Comment 10•12 years ago
|
||
Comment 11•12 years ago
|
||
Comment 12•12 years ago
|
||
Comment 13•12 years ago
|
||
Comment 14•12 years ago
|
||
Comment 15•12 years ago
|
||
Comment 16•12 years ago
|
||
Comment 17•12 years ago
|
||
Comment 18•12 years ago
|
||
Comment 19•12 years ago
|
||
Comment 20•12 years ago
|
||
Comment 21•12 years ago
|
||
Comment 22•12 years ago
|
||
Comment 23•12 years ago
|
||
Comment 24•12 years ago
|
||
Comment 25•12 years ago
|
||
Comment 26•12 years ago
|
||
Comment 27•12 years ago
|
||
Comment 28•12 years ago
|
||
Comment 29•12 years ago
|
||
Comment 30•12 years ago
|
||
Comment 31•12 years ago
|
||
Comment 32•12 years ago
|
||
Comment 33•12 years ago
|
||
Comment 34•12 years ago
|
||
Comment 35•12 years ago
|
||
Comment 36•12 years ago
|
||
Comment 37•12 years ago
|
||
Comment 38•12 years ago
|
||
Comment 39•12 years ago
|
||
Comment 40•12 years ago
|
||
Comment 41•12 years ago
|
||
Comment 42•12 years ago
|
||
Comment 43•12 years ago
|
||
Comment 44•11 years ago
|
||
Comment 45•11 years ago
|
||
Comment 46•11 years ago
|
||
Comment 47•11 years ago
|
||
Comment 48•11 years ago
|
||
Comment 49•11 years ago
|
||
Comment 50•11 years ago
|
||
Comment 51•11 years ago
|
||
Comment 52•11 years ago
|
||
Comment 53•11 years ago
|
||
Comment 54•11 years ago
|
||
Comment 55•11 years ago
|
||
Comment 56•11 years ago
|
||
Comment 57•11 years ago
|
||
Comment 58•11 years ago
|
||
Comment 59•11 years ago
|
||
Comment 60•11 years ago
|
||
Comment 61•11 years ago
|
||
Comment 62•11 years ago
|
||
Comment 63•11 years ago
|
||
Comment 64•11 years ago
|
||
Comment 65•11 years ago
|
||
Comment 66•11 years ago
|
||
Comment 67•11 years ago
|
||
Comment 68•11 years ago
|
||
Comment 69•11 years ago
|
||
Comment 70•11 years ago
|
||
Comment 71•11 years ago
|
||
Comment 72•11 years ago
|
||
Comment 73•11 years ago
|
||
Reporter | ||
Comment 74•11 years ago
|
||
Comment 75•11 years ago
|
||
Comment 76•11 years ago
|
||
Comment 77•11 years ago
|
||
Comment 78•11 years ago
|
||
Comment 79•11 years ago
|
||
Comment 80•11 years ago
|
||
Comment 81•11 years ago
|
||
Comment 82•11 years ago
|
||
Comment 83•11 years ago
|
||
Comment 84•11 years ago
|
||
Comment 85•11 years ago
|
||
Comment 86•11 years ago
|
||
Comment 87•11 years ago
|
||
Comment 88•11 years ago
|
||
Comment 89•11 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=24163871&tree=Mozilla-Inbound
I'd be remiss if I didn't point out that basically every single one of these happens at the same point. Jonathan, any ideas?
13:17:58 INFO - copying /data/local/b2g/dictionaries/en-US.aff to /system/b2g/dictionaries/en-US.aff
13:17:58 INFO - copying /data/local/b2g/dictionaries/en-US.dic to /system/b2g/dictionaries/en-US.dic
13:17:58 INFO - restarting B2G
13:17:58 INFO - Traceback (most recent call last):
13:17:58 INFO - File "runreftestb2g.py", line 573, in <module>
13:17:58 INFO - sys.exit(main())
13:17:58 INFO - File "runreftestb2g.py", line 493, in main
13:17:58 INFO - marionette = Marionette.getMarionetteOrExit(**kwargs)
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette.py", line 291, in getMarionetteOrExit
13:17:58 INFO - m = cls(*args, **kwargs)
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette.py", line 266, in __init__
13:17:58 INFO - busybox=busybox)
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/emulator.py", line 353, in setup
13:17:58 INFO - self.wait_for_system_message(marionette)
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/emulator.py", line 256, in wait_for_system_message
13:17:58 INFO - marionette.start_session()
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette.py", line 444, in start_session
13:17:58 INFO - self.session = self._send_message('newSession', 'value')
13:17:58 INFO - File "/builds/slave/test/build/venv/local/lib/python2.7/site-packages/marionette/marionette.py", line 340, in _send_message
13:17:58 ERROR - raise TimeoutException(message='socket.timeout', status=ErrorCodes.TIMEOUT, stacktrace=None)
13:17:58 ERROR - marionette.errors.TimeoutException: socket.timeout
Flags: needinfo?(jgriffin)
Comment 90•11 years ago
|
||
This has something to do with the way we're updating gecko in these static emulator snapshots. The good news is, as soon as we get tests running against the full-stack emulator builds (which will be soon), this error will go away since we'll no longer be updating gecko.
Flags: needinfo?(jgriffin)
Comment 91•11 years ago
|
||
Comment 92•11 years ago
|
||
Comment 93•11 years ago
|
||
Comment 94•11 years ago
|
||
Reporter | ||
Comment 95•11 years ago
|
||
Reporter | ||
Comment 96•11 years ago
|
||
Reporter | ||
Comment 97•11 years ago
|
||
Reporter | ||
Comment 98•11 years ago
|
||
Reporter | ||
Comment 99•11 years ago
|
||
Comment 100•11 years ago
|
||
Comment 101•11 years ago
|
||
Comment 102•11 years ago
|
||
And another probably 30 per day - I can't be bothered to paste links into a "we're going to redo everything to get new and different bugs instead!" bug.
Comment 103•11 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=25100003&tree=Mozilla-Inbound
Weren't the full-stack emulator tests going to save us?
Comment 104•11 years ago
|
||
Comment 105•11 years ago
|
||
Comment 106•11 years ago
|
||
Comment 107•11 years ago
|
||
Comment 108•11 years ago
|
||
Flags: needinfo?(jgriffin)
Comment 109•11 years ago
|
||
It was our hope that this error had something to do with updating gecko in the emulator at the beginning of a run, but apparently that was not the case. :(
From the log, it looks like the emulator is hanging on startup.
I expect to see this in the logcat, indicating that Gaia has loaded:
I/Gecko ( 43): ###################################### forms.js loaded
I/Gecko ( 43): ############################### browserElementPanning.js loaded
I/Gecko ( 43): ######################## BrowserElementChildPreload.js loaded
But in these failing logs, this output never appears, which would seem to indicate that Gaia is never loaded.
I'll try to escalate this.
Flags: needinfo?(jgriffin)
Updated•11 years ago
|
Summary: Intermittent B2G "TimeoutException: socket.timeout" → Intermittent B2G "TimeoutException: socket.timeout" (apparent emulator hang on startup)
Comment 110•11 years ago
|
||
Reporter | ||
Comment 111•11 years ago
|
||
Summary: Intermittent B2G "TimeoutException: socket.timeout" (apparent emulator hang on startup) → Intermittent B2G "marionette.errors.TimeoutException: socket.timeout" (apparent emulator hang on startup)
Reporter | ||
Comment 112•11 years ago
|
||
Comment 113•11 years ago
|
||
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Comment hidden (Legacy TBPL/Treeherder Robot) |
Reporter | ||
Comment 138•10 years ago
|
||
Closing bugs where TBPLbot has previously commented, but have now not been modified for >3 months & do not contain the whiteboard strings for disabled/annotated tests or use the keyword leave-open. Filter on: mass-intermittent-bug-closure-2014-07
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → WORKSFORME
You need to log in
before you can comment on or make changes to this bug.
Description
•