1180948 - Windows 8 on Aurora spontaneously started permafailing in bc3 and dt and jp mochitests with too much recursion

Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)

Reporter

Description

•

9 years ago

bc3: https://treeherder.mozilla.org/logviewer.html#?job_id=936760&repo=mozilla-aurora dt: https://treeherder.mozilla.org/logviewer.html#?job_id=936761&repo=mozilla-aurora jp: https://treeherder.mozilla.org/logviewer.html#?job_id=936868&repo=mozilla-aurora These tests started permafailing this morning, when the only thing that's changed since Saturday was Bug 1160441 which doesn't seem related. The common failure between all three suites is "too much recursion". I've triggered a new Windows 8 build on the previous push to see if it fails, too. I guess if nothing else we can try to back out bug 1160441 but I don't see how it could have caused this. I'm closing Aurora until this can get looked at.

Ryan VanderMeulen [:RyanVM]

Comment 1

•

9 years ago

Naveed, do you have someone who can look into this soonish? :)

Severity: normal → blocker

tracking-firefox41: --- → ?

Flags: needinfo?(nihsanullah)

Shu-yu Guo [:shu]

Comment 2

•

9 years ago

The fact that these are all recursion errors and on PGO suggest that PGO builds keep getting larger and larger stack frames and are messing with the native stack limit. My hunch is that since JIT code and C++ share the same stack, the PGO frames are affecting the effective JS stack limit. I'm at a conference and PTO for the next 2 weeks. Jan, do you think you could take a look?

Shu-yu Guo [:shu]

Comment 3

•

9 years ago

See comment 2.

Flags: needinfo?(jdemooij)

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=936846 repository: mozilla-aurora start_time: 2015-07-06T14:28:44 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-117 buildname: Windows 8 64-bit mozilla-aurora pgo test mochitest-devtools-chrome revision: 8d4948dc0008 InternalError: too much recursion: Editor.prototype[name]@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/sourceeditor/editor.js:1108:12 399 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Got an error: too much recursion 411 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Test timed out - expected PASS InternalError: too much recursion: addResult@chrome://mochikit/content/browser-harness.xul:136:9 588 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Task.jsm:120 - Error: Stack overflow 589 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:138 - InternalError: too much recursion 591 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | Test timed out - expected PASS InternalError: too much recursion: Task.Debugging.generateReadableStack@resource://gre/modules/Task.jsm:503:24 764 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | Test timed out - expected PASS TEST-UNEXPECTED-TIMEOUT | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application timed out after 330 seconds with no output TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application terminated with exit code 1 URLError: <urlopen error [Errno 11002] getaddrinfo failed> 769 ERROR Automation Error: Received unexpected exception while running application Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=936845 repository: mozilla-aurora start_time: 2015-07-06T14:28:51 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-056 buildname: Windows 8 64-bit mozilla-aurora pgo test mochitest-devtools-chrome revision: 8d4948dc0008 InternalError: too much recursion: Editor.prototype[name]@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/sourceeditor/editor.js:1108:12 399 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Got an error: too much recursion 411 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Test timed out - expected PASS InternalError: too much recursion: addResult@chrome://mochikit/content/browser-harness.xul:136:9 588 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Task.jsm:120 - Error: Stack overflow 589 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:138 - InternalError: too much recursion 590 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:139 - InternalError: too much recursion 592 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | Test timed out - expected PASS InternalError: too much recursion: Task.Debugging.generateReadableStack@resource://gre/modules/Task.jsm:503:24 765 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | Test timed out - expected PASS TEST-UNEXPECTED-TIMEOUT | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application timed out after 330 seconds with no output TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application terminated with exit code 1 URLError: <urlopen error [Errno 11002] getaddrinfo failed> 770 ERROR Automation Error: Received unexpected exception while running application Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=936761 repository: mozilla-aurora start_time: 2015-07-06T14:07:23 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-059 buildname: Windows 8 64-bit mozilla-aurora pgo test mochitest-devtools-chrome revision: 8d4948dc0008 InternalError: too much recursion: Editor.prototype[name]@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/sourceeditor/editor.js:1108:5 399 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Got an error: too much recursion 411 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Test timed out - expected PASS InternalError: too much recursion: addResult@chrome://mochikit/content/browser-harness.xul:136:9 588 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Task.jsm:409 - InternalError: too much recursion 589 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:138 - InternalError: too much recursion 590 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:139 - InternalError: too much recursion 592 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | Test timed out - expected PASS InternalError: too much recursion: Task.Debugging.generateReadableStack@resource://gre/modules/Task.jsm:503:24 765 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | Test timed out - expected PASS TEST-UNEXPECTED-TIMEOUT | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application timed out after 330 seconds with no output TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application terminated with exit code 1 PROCESS-CRASH | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application crashed [@ CrashingThread(void *)] Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=936443 repository: mozilla-aurora start_time: 2015-07-06T13:13:59 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-051 buildname: Windows 8 64-bit mozilla-aurora pgo test mochitest-devtools-chrome revision: ab06e63763c0 InternalError: too much recursion: Editor.prototype[name]@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/sourceeditor/editor.js:1108:12 399 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Got an error: too much recursion 411 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Test timed out - expected PASS InternalError: too much recursion: addResult@chrome://mochikit/content/browser-harness.xul:139:1 588 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Task.jsm:409 - InternalError: too much recursion 589 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:139 - InternalError: too much recursion 591 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | Test timed out - expected PASS InternalError: too much recursion: Task.Debugging.generateReadableStack@resource://gre/modules/Task.jsm:503:24 764 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | Test timed out - expected PASS TEST-UNEXPECTED-TIMEOUT | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application timed out after 330 seconds with no output TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application terminated with exit code 1 PROCESS-CRASH | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application crashed [@ CrashingThread(void *)] Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

log: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-aurora&job_id=936442 repository: mozilla-aurora start_time: 2015-07-06T13:13:57 who: wkocher[at]mozilla[dot]com machine: t-w864-ix-134 buildname: Windows 8 64-bit mozilla-aurora pgo test mochitest-devtools-chrome revision: ab06e63763c0 InternalError: too much recursion: Editor.prototype[name]@resource://gre/modules/commonjs/toolkit/loader.js -> resource:///modules/devtools/sourceeditor/editor.js:1108:12 399 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Got an error: too much recursion 411 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_breadcrumbs-access.js | Test timed out - expected PASS InternalError: too much recursion: addResult@chrome://mochikit/content/browser-harness.xul:139:1 588 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Task.jsm:503 - InternalError: too much recursion 589 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:524 - InternalError: too much recursion 590 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | A promise chain failed to handle a rejection: - at resource://gre/modules/Promise.jsm -> resource://gre/modules/Promise-backend.js:139 - InternalError: too much recursion 592 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_conditional-breakpoints-01.js | Test timed out - expected PASS InternalError: too much recursion: Task.Debugging.generateReadableStack@resource://gre/modules/Task.jsm:503:24 765 INFO TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | Test timed out - expected PASS TEST-UNEXPECTED-TIMEOUT | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application timed out after 330 seconds with no output TEST-UNEXPECTED-FAIL | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application terminated with exit code 1 PROCESS-CRASH | browser/devtools/debugger/test/browser_dbg_location-changes-04-breakpoint.js | application crashed [@ CrashingThread(void *)] Return code: 1

Comment hidden (Legacy TBPL/Treeherder Robot)

Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)

Reporter

Comment 20

•

9 years ago

So it is build specific, and not permafail. A newer push's tests are green: https://treeherder.mozilla.org/#/jobs?repo=mozilla-aurora&filter-searchStr=Windows%208%20x64%20pgo%20Mochitest%20Mochitest%20Browser%20Chrome%20M%28bc3%29 https://treeherder.mozilla.org/#/jobs?repo=mozilla-aurora&filter-searchStr=Windows%208%20x64%20pgo%20Mochitest%20Mochitest%20DevTools%20Browser%20Chrome%20M%28dt%29 Fun.

Jan de Mooij [:jandem]

Assignee

Comment 21

•

9 years ago

See also bug 1167883 on Aurora Win64 PGO stack overflow issues.

Jan de Mooij [:jandem]

Assignee

Updated

•

9 years ago

Depends on: 1181040

Jan de Mooij [:jandem]

Assignee

Comment 22

•

9 years ago

I just started a PGO build locally to work around bug 1181040, hopefully it will finish. Fingers crossed I'll be able to reproduce one of these issues; apparently they are intermittent.

Jan de Mooij [:jandem]

Assignee

Comment 23

•

9 years ago

(In reply to Jan de Mooij [:jandem] from comment #22) > I just started a PGO build locally to work around bug 1181040, hopefully it > will finish. Fingers crossed I'll be able to reproduce one of these issues; > apparently they are intermittent. With this build I can't repro the bc3 or dt failures, but I can reproduce the Google Calendar issue in bug 1167883 comment 6. I'll focus on that one for now and hope these issues are related.

Kate Glazko

Comment 24

•

9 years ago

Setting Tracking for 41 Aurora and affected.

status-firefox41: --- → affected

tracking-firefox41: ? → +

Nicolas B. Pierron [:nbp]

Updated

•

9 years ago

Depends on: 1181558

Jan de Mooij [:jandem]

Assignee

Comment 25

•

9 years ago

I posted a patch in bug 1167883, hopefully it will fix this too.

Flags: needinfo?(nihsanullah)

Jan de Mooij [:jandem]

Assignee

Comment 26

•

9 years ago

(In reply to Jan de Mooij [:jandem] from comment #25) > I posted a patch in bug 1167883, hopefully it will fix this too. Clearing needinfo, let's see if this comes back after that lands.

Flags: needinfo?(jdemooij)

Jan de Mooij [:jandem]

Assignee

Comment 27

•

9 years ago

Bug 1167883 landed on Aurora so we can probably reopen the tree now.

Ryan VanderMeulen [:RyanVM]

Comment 28

•

9 years ago

Except e10s tests were turned on in the mean time and there's a Linux32 permafail :(

Ritu Kothari (:ritu) (Inactive, please n-i to RyanVM, jcristau, or pascal)

Comment 29

•

9 years ago

Ryan, I am trying to follow up on the FF41+ tracked bugs. Is this test failure still showing up on Beta41? IF it is e10s tests only, I would like to move this bug to FF42 tracking list. Please let me know.

Flags: needinfo?(ryanvm)

Ryan VanderMeulen [:RyanVM]

Comment 30

•

9 years ago

Yes, Linux32 still has a permafail being tracked in bug 1193096. This bug is safe to close, though. It was fixed by bug 1167883.

Assignee: nobody → jdemooij

Status: NEW → RESOLVED

Closed: 9 years ago

status-firefox40: --- → fixed

status-firefox41: affected → fixed

status-firefox42: --- → fixed

Flags: needinfo?(ryanvm)

Resolution: --- → FIXED

Target Milestone: --- → mozilla42