Closed Bug 1658172 Opened 4 years ago Closed 4 years ago

Intermittent A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down | Maximum number of clients reachedUnable to init server: Could not connect: Connection refused

Categories

(Core :: Widget: Gtk, defect, P5)

Product:
Core
Component:
Widget: Gtk
Type:
defect

Tracking

()

Status:
RESOLVED DUPLICATE of bug 1635451

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, Whiteboard: [stockwell unknown])

Filed by: ncsoregi [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=312496679&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/cD1W8eGESteswMcMEJ2VhQ/runs/0/artifacts/public/logs/live_backing.log

[task 2020-08-08T22:20:29.789Z] 22:20:29 INFO - TEST-START | http://mochi.test:8888/tests/dom/tests/mochitest/dom-level2-html/test_HTMLTableSectionElement14.html
[task 2020-08-08T22:20:29.953Z] 22:20:29 INFO - GECKO(9472) | [Child 24242, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp, line 3359
[task 2020-08-08T22:20:30.031Z] 22:20:30 INFO - GECKO(9472) | [Child 24242, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp, line 4343
[task 2020-08-08T22:20:30.031Z] 22:20:30 INFO - GECKO(9472) | [24350, Unnamed thread 7fa874f5d5e0] WARNING: XPCOM objects created/destroyed from static ctor/dtor: file /builds/worker/checkouts/gecko/xpcom/base/nsTraceRefcnt.cpp, line 202
[task 2020-08-08T22:20:30.031Z] 22:20:30 INFO - GECKO(9472) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmpEjDTS1.mozrunner/runtests_leaks.log
[task 2020-08-08T22:20:30.031Z] 22:20:30 INFO - GECKO(9472) | [24350, Unnamed thread 7fa874f5d5e0] WARNING: XPCOM objects created/destroyed from static ctor/dtor: file /builds/worker/checkouts/gecko/xpcom/base/nsTraceRefcnt.cpp, line 202
[task 2020-08-08T22:20:30.033Z] 22:20:30 INFO - GECKO(9472) | [24350, Main Thread] WARNING: XPCOM_MEM_BLOAT_LOG is set, disabling native allocations.: file /builds/worker/checkouts/gecko/tools/profiler/core/platform.cpp, line 246
[task 2020-08-08T22:20:30.034Z] 22:20:30 INFO - GECKO(9472) | Maximum number of clients reachedUnable to init server: Could not connect: Connection refused
[task 2020-08-08T22:20:30.036Z] 22:20:30 INFO - GECKO(9472) | (/builds/worker/workspace/build/application/firefox/firefox-bin:24350): Gtk-WARNING **: 22:20:30.032: cannot open display: :0
[task 2020-08-08T22:20:30.037Z] 22:20:30 INFO - GECKO(9472) | nsStringStats
[task 2020-08-08T22:20:30.037Z] 22:20:30 INFO - GECKO(9472) | => mAllocCount: 165
[task 2020-08-08T22:20:30.037Z] 22:20:30 INFO - GECKO(9472) | => mReallocCount: 0
[task 2020-08-08T22:20:30.039Z] 22:20:30 INFO - GECKO(9472) | => mFreeCount: 8 -- LEAKED 157 !!!
[task 2020-08-08T22:20:30.039Z] 22:20:30 INFO - GECKO(9472) | => mShareCount: 344
[task 2020-08-08T22:20:30.039Z] 22:20:30 INFO - GECKO(9472) | => mAdoptCount: 0
[task 2020-08-08T22:20:30.044Z] 22:20:30 INFO - GECKO(9472) | => mAdoptFreeCount: 0
[task 2020-08-08T22:20:30.044Z] 22:20:30 INFO - GECKO(9472) | => Process ID: 24350, Thread ID: 140361517369216
[task 2020-08-08T22:20:30.052Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.054Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.055Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.056Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.056Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.059Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Gecko_IOThread] WARNING: FileDescriptorSet destroyed with unconsumed descriptors: file /builds/worker/checkouts/gecko/ipc/chromium/src/chrome/common/file_descriptor_set_posix.cc, line 19
[task 2020-08-08T22:20:30.060Z] 22:20:30 INFO - GECKO(9472) | [Parent 9472, Main Thread] WARNING: content process pid = 24350 crashed without leaving a minidump behind: file /builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp, line 3681
[task 2020-08-08T22:20:30.060Z] 22:20:30 ERROR - GECKO(9472) | A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down

Bugbug thinks this bug should belong to this component, but please revert this change in case of error.

Component: Untriaged → Gecko Profiler
Product: Firefox → Core

I don't see any actionable evidence that the profiler is causing this, apart from being in use during these tests.
Looking at the treeherder link, it started in https://hg.mozilla.org/mozilla-central/pushloghtml?changeset=b579c12907dc3bb210177454a696ccc181c1ded0 , in which there are no profiler-related commits.

Looking at the two logs (so far), "A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down", and the last messages when that process exited are:

Maximum number of clients reachedUnable to init server: Could not connect: Connection refused
(/builds/worker/workspace/build/application/firefox/firefox-bin:24350): Gtk-WARNING **: 22:20:30.032: cannot open display: :0
nsStringStats [...]

So it looks like some Gtk issue. The closest candidate I can see from https://hg.mozilla.org/mozilla-central/pushloghtml?changeset=b579c12907dc3bb210177454a696ccc181c1ded0 would be bug 1657747 in the Gtk component ([Wayland] Remove DMABuf backend from SW compositor).
Martin, you worked on that bug, could you please have a look?

Component: Gecko Profiler → Widget: Gtk
Flags: needinfo?(stransky)

The Bug 1657747 is not related here as it's Wayland specific - we're going to add Wayland to test suite (Bug 1657289) but it's still pending.

(/builds/worker/workspace/build/application/firefox/firefox-bin:24350): Gtk-WARNING **: 22:20:30.032: cannot open display: :0
nsStringStats [...]

It looks like X server refuses another connection as the connection number is limited. May be related to Bug 1129492.

Flags: needinfo?(stransky)

Xorig failures here are bug 1629093

In the last 7 days there have been 28 occurrences on linux1804-64 debug and some on windows7-32-shippable opt.

Recent failure: https://treeherder.mozilla.org/logviewer?job_id=321024543&repo=mozilla-central&lineNumber=14720

Martin, could you, please, point this to someone who can take a look?

Flags: needinfo?(stransky)
Whiteboard: [stockwell needswork:owner]

On linux side it looks like a dupe of 1635451

Flags: needinfo?(stransky)

There are 18 total failures in the last 7 days on linux1804-64 and linux1804-64-qr debug

Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=323646337&repo=mozilla-central&lineNumber=19660

[task 2020-12-05T10:27:14.620Z] 10:27:14 INFO - TEST-START | http://mochi.test:8888/tests/dom/tests/mochitest/dom-level2-html/test_HTMLSelectElement09.html
[task 2020-12-05T10:27:14.869Z] 10:27:14 INFO - GECKO(8664) | [Parent 8664, IPDL Background] WARNING: Cannot record shutdown step, mConnection is nullptr: file /builds/worker/checkouts/gecko/dom/localstorage/ActorsParent.cpp:8027
[task 2020-12-05T10:27:14.889Z] 10:27:14 INFO - GECKO(8664) | [Child 20054, Main Thread] WARNING: Extra shutdown CC: 'i < NORMAL_SHUTDOWN_COLLECTIONS', file /builds/worker/checkouts/gecko/xpcom/base/nsCycleCollector.cpp:3360
[task 2020-12-05T10:27:14.905Z] 10:27:14 INFO - GECKO(8664) | ### XPCOM_MEM_BLOAT_LOG defined -- logging bloat/leaks to /tmp/tmpKyKeRF.mozrunner/runtests_leaks_tab_pid20170.log
[task 2020-12-05T10:27:14.906Z] 10:27:14 INFO - GECKO(8664) | [20170, Main Thread] WARNING: XPCOM_MEM_BLOAT_LOG is set, disabling native allocations.: file /builds/worker/checkouts/gecko/tools/profiler/core/platform.cpp:251
[task 2020-12-05T10:27:14.921Z] 10:27:14 INFO - GECKO(8664) | Maximum number of clients reachedUnable to init server: Could not connect: Connection refused
[task 2020-12-05T10:27:14.921Z] 10:27:14 INFO - GECKO(8664) | (/builds/worker/workspace/build/application/firefox/firefox-bin:20170): Gtk-WARNING **: 10:27:14.913: cannot open display: :0
[task 2020-12-05T10:27:14.922Z] 10:27:14 INFO - GECKO(8664) | nsStringStats[Child 20170, Chrome_ChildThread] ###!!! ABORT: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/message_loop.cc:333
[task 2020-12-05T10:27:14.957Z] 10:27:14 INFO - Initializing stack-fixing for the first stack frame, this may take a while...
[task 2020-12-05T10:27:23.753Z] 10:27:23 INFO - GECKO(8664) | #01: MessageLoop::RunInternal() [ipc/chromium/src/base/message_loop.cc:334]
[task 2020-12-05T10:27:23.755Z] 10:27:23 INFO - GECKO(8664) | => mAllocCount: 158
[task 2020-12-05T10:27:23.756Z] 10:27:23 INFO - GECKO(8664) | => mReallocCount: 0
[task 2020-12-05T10:27:23.756Z] 10:27:23 INFO - GECKO(8664) | => mFreeCount: 10 -- LEAKED 148 !!!
[task 2020-12-05T10:27:23.757Z] 10:27:23 INFO - GECKO(8664) | => mShareCount: 322
[task 2020-12-05T10:27:23.758Z] 10:27:23 INFO - GECKO(8664) | #02: MessageLoop::Run() [ipc/chromium/src/base/message_loop.cc:310]
[task 2020-12-05T10:27:23.759Z] 10:27:23 INFO - GECKO(8664) | => mAdoptCount: 0
[task 2020-12-05T10:27:23.760Z] 10:27:23 INFO - GECKO(8664) | => mAdoptFreeCount: 0
[task 2020-12-05T10:27:23.761Z] 10:27:23 INFO - GECKO(8664) | => Process ID: 20170, Thread ID: 140041468028800
[task 2020-12-05T10:27:23.762Z] 10:27:23 INFO - GECKO(8664) | #03: base::Thread::ThreadMain() [ipc/chromium/src/base/thread.cc:194]
[task 2020-12-05T10:27:23.763Z] 10:27:23 INFO - GECKO(8664) | [Child 20054, Main Thread] WARNING: NS_ENSURE_TRUE(Preferences::InitStaticMembers()) failed: file /builds/worker/checkouts/gecko/modules/libpref/Preferences.cpp:4339
[task 2020-12-05T10:27:23.765Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, Main Thread] WARNING: content process pid = 20170 crashed without leaving a minidump behind: file /builds/worker/checkouts/gecko/dom/ipc/ContentParent.cpp:3861
[task 2020-12-05T10:27:23.766Z] 10:27:23 ERROR - GECKO(8664) | A content process crashed and MOZ_CRASHREPORTER_SHUTDOWN is set, shutting down
[task 2020-12-05T10:27:23.767Z] 10:27:23 INFO - GECKO(8664) | [Child 8747, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:40
[task 2020-12-05T10:27:23.769Z] 10:27:23 INFO - GECKO(8664) | [Child 8747, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:40
[task 2020-12-05T10:27:23.770Z] 10:27:23 INFO - GECKO(8664) | [Child 8747, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:40
[task 2020-12-05T10:27:23.771Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: '!topWindow', file /builds/worker/checkouts/gecko/dom/html/HTMLIFrameElement.cpp:240
[task 2020-12-05T10:27:23.771Z] 10:27:23 INFO - GECKO(8664) | [Child 8747, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:40
[task 2020-12-05T10:27:23.772Z] 10:27:23 INFO - GECKO(8664) | [Child 8747, Main Thread] WARNING: '!CanSend() || !mManager || !mManager->CanSend()', file /builds/worker/checkouts/gecko/dom/ipc/jsactor/JSWindowActorChild.cpp:40
[task 2020-12-05T10:27:23.773Z] 10:27:23 INFO - GECKO(8664) | JavaScript error: resource://gre/modules/AsyncShutdown.jsm, line 573: NotFoundError: No such JSWindowActor 'SpecialPowers'
[task 2020-12-05T10:27:23.774Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.774Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.775Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.776Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.777Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.778Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.778Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.779Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.780Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.781Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, URL Classifier] WARNING: 'NS_FAILED(rv)', file /builds/worker/checkouts/gecko/netwerk/url-classifier/AsyncUrlChannelClassifier.cpp:250
[task 2020-12-05T10:27:23.782Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_TRUE(mContentViewer) failed: file /builds/worker/checkouts/gecko/docshell/base/nsDocShell.cpp:6533
[task 2020-12-05T10:27:23.783Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: '!topWindow', file /builds/worker/checkouts/gecko/dom/html/HTMLIFrameElement.cpp:240
[task 2020-12-05T10:27:23.784Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_TRUE(!HasUnloadedParent()) failed: file /builds/worker/checkouts/gecko/docshell/base/nsDocShell.cpp:9097
[task 2020-12-05T10:27:23.785Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x8000FFFF (NS_ERROR_UNEXPECTED): file /builds/worker/checkouts/gecko/docshell/base/nsDocShell.cpp:873
[task 2020-12-05T10:27:23.788Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x8000FFFF (NS_ERROR_UNEXPECTED): file /builds/worker/checkouts/gecko/dom/base/nsFrameLoader.cpp:750
[task 2020-12-05T10:27:23.789Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_TRUE(currentInner) failed: file /builds/worker/checkouts/gecko/dom/base/WindowDestroyedEvent.cpp:108
[task 2020-12-05T10:27:23.790Z] 10:27:23 INFO - GECKO(8664) | [Child 20083, Main Thread] WARNING: NS_ENSURE_TRUE(currentInner) failed: file /builds/worker/checkouts/gecko/dom/base/WindowDestroyedEvent.cpp:108
[task 2020-12-05T10:27:23.791Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, Main Thread] WARNING: Received load event on unbridged BrowserParent!: file /builds/worker/checkouts/gecko/dom/ipc/BrowserParent.cpp:4080
[task 2020-12-05T10:27:23.792Z] 10:27:23 INFO - GECKO(8664) | [Parent 8664, Main Thread] WARNING: Received load event on unbridged BrowserParent!: file /builds/worker/checkouts/gecko/dom/ipc/BrowserParent.cpp:4080
[task 2020-12-05T10:27:23.793Z] 10:27:23 INFO - GECKO(8664) | ###!!! [Parent][RunMessage] Error: Channel closing: too late to send/recv, messages will be lost

Closing as a dupe of Bug 1635451 as the win failure seem to be misclassifications.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.