1689184 - Perma [OSX][esr78] xpcshell selftest OSError: [Errno 24] Too many open files

Reporter

Description

•

4 years ago

treeherder

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=328002336&repo=mozilla-esr78
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/O6zu_YE9T6yssIR3-OmJkQ/runs/0/artifacts/public/logs/live_backing.log

[task 2021-01-27T18:15:15.114Z] 18:15:15     INFO -  '__PYVENV_LAUNCHER__': '/usr/local/bin/python3'}
[task 2021-01-27T18:15:15.115Z] 18:15:15     INFO - Calling ['/Users/cltbld/tasks/task_1611770787/build/venv/bin/python', '-u', '/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py', u'browser/components/about/test/unit/xpcshell.ini', u'browser/components/attribution/test/xpcshell/xpcshell.ini', u'browser/components/extensions/test/xpcshell/xpcshell.ini', u'browser/components/installerprefs/test/unit/xpcshell.ini', u'browser/components/newtab/test/xpcshell/xpcshell.ini', u'browser/components/payments/test/unit/xpcshell.ini', u'browser/components/places/tests/unit/xpcshell.ini', u'browser/components/search/test/unit/xpcshell.ini', u'browser/components/sessionstore/test/unit/xpcshell.ini', u'browser/components/shell/test/unit/xpcshell.ini', u'browser/components/ssb/tests/xpcshell/xpcshell.ini', u'browser/components/tests/unit/xpcshell.ini', u'browser/modules/test/unit/xpcshell.ini', u'browser/tools/mozscreenshots/tests/xpcshell/xpcshell.ini', u'chrome/test/unit_ipc/xpcshell.ini', u'devtools/client/aboutdebugging/test/xpcshell/xpcshell.ini', u'devtools/client/application/test/xpcshell/xpcshell.ini', u'devtools/client/framework/test/xpcshell/xpcshell.ini', u'devtools/client/netmonitor/test/xpcshell/xpcshell.ini', u'devtools/client/responsive/test/xpcshell/xpcshell.ini', u'devtools/client/shared/redux/middleware/xpcshell/xpcshell.ini', u'devtools/client/shared/remote-debugging/test/xpcshell/xpcshell.ini', u'devtools/shared/heapsnapshot/tests/xpcshell/xpcshell.ini', u'devtools/shared/performance/xpcshell/xpcshell.ini', u'devtools/shared/protocol/tests/xpcshell/xpcshell.ini', u'devtools/shared/security/tests/xpcshell/xpcshell.ini', u'devtools/shared/storage/vendor/stringvalidator/tests/xpcshell/xpcshell.ini', u'devtools/shared/transport/tests/xpcshell/xpcshell.ini', u'devtools/startup/tests/xpcshell/xpcshell.ini', u'docshell/test/unit_ipc/xpcshell.ini', u'dom/cache/test/xpcshell/xpcshell.ini', u'dom/console/tests/xpcshell/xpcshell.ini', u'dom/encoding/test/unit/xpcshell.ini', u'dom/file/tests/xpcshell.ini', u'dom/ipc/tests/xpcshell.ini', u'dom/media/webvtt/tests/xpcshell.ini', u'dom/notification/test/unit/xpcshell.ini', u'dom/promise/tests/unit/xpcshell.ini', u'dom/push/test/xpcshell/xpcshell.ini', u'dom/security/test/unit/xpcshell.ini', u'dom/workers/test/xpcshell/xpcshell.ini', u'extensions/permissions/test/unit/xpcshell.ini', u'extensions/pref/autoconfig/test/unit/xpcshell.ini', u'intl/l10n/test/xpcshell.ini', u'intl/strres/tests/unit/xpcshell.ini', u'intl/uconv/tests/unit/xpcshell.ini', u'ipc/testshell/tests/xpcshell.ini', u'js/ductwork/debugger/tests/xpcshell.ini', u'js/xpconnect/tests/unit/xpcshell.ini', u'modules/libjar/zipwriter/test/unit/xpcshell.ini', u'modules/libmar/tests/unit/xpcshell.ini', u'modules/libpref/test/unit_ipc/xpcshell.ini', u'netwerk/test/httpserver/test/xpcshell.ini', u'netwerk/test/unit/xpcshell.ini', u'netwerk/test/unit_ipc/xpcshell.ini', u'remote/test/unit/xpcshell.ini', u'security/manager/ssl/tests/unit/xpcshell-smartcards.ini', u'security/manager/ssl/tests/unit/xpcshell.ini', u'services/common/tests/unit/xpcshell.ini', u'services/settings/test/unit/xpcshell.ini', u'services/sync/tests/unit/xpcshell.ini', u'testing/marionette/test/unit/xpcshell.ini', u'toolkit/components/aboutmemory/tests/xpcshell/xpcshell.ini', u'toolkit/components/asyncshutdown/tests/xpcshell/xpcshell.ini', u'toolkit/components/autocomplete/tests/unit/xpcshell.ini', u'toolkit/components/backgroundhangmonitor/tests/xpcshell.ini', u'toolkit/components/captivedetect/test/unit/xpcshell.ini', u'toolkit/components/cascade_bloom_filter/test/xpcshell/xpcshell.ini', u'toolkit/components/cleardata/tests/unit/xpcshell.ini', u'toolkit/components/commandlines/test/unit_unix/xpcshell.ini', u'toolkit/components/contentprefs/tests/unit_cps2/xpcshell.ini', u'toolkit/components/crashmonitor/test/unit/xpcshell.ini', u'toolkit/components/ctypes/tests/unit/xpcshell.ini', u'toolkit/components/extensions/test/xpcshell/native_messaging.ini', u'toolkit/components/extensions/test/xpcshell/xpcshell-e10s.ini', u'toolkit/components/extensions/test/xpcshell/xpcshell-remote.ini', u'toolkit/components/featuregates/test/unit/xpcshell.ini', u'toolkit/components/filewatcher/tests/xpcshell/xpcshell.ini', u'toolkit/components/kvstore/test/xpcshell/xpcshell.ini', u'toolkit/components/messaging-system/test/unit/xpcshell.ini', u'toolkit/components/normandy/test/unit/xpcshell.ini', u'toolkit/components/osfile/tests/xpcshell/xpcshell.ini', u'toolkit/components/passwordmgr/test/unit/xpcshell.ini', u'toolkit/components/places/tests/favicons/xpcshell.ini', u'toolkit/components/places/tests/history/xpcshell.ini', u'toolkit/components/places/tests/unifiedcomplete/xpcshell.ini', u'toolkit/components/promiseworker/tests/xpcshell/xpcshell.ini', u'toolkit/components/reputationservice/test/unit/xpcshell.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-1.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-2.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-3.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-4.ini', u'toolkit/components/search/tests/xpcshell/xpcshell.ini', u'toolkit/components/terminator/tests/xpcshell/xpcshell.ini', u'toolkit/components/thumbnails/test/xpcshell.ini', u'toolkit/components/timermanager/tests/unit/xpcshell.ini', u'toolkit/components/urlformatter/tests/unit/xpcshell.ini', u'toolkit/components/windowcreator/tests/unit/xpcshell.ini', u'toolkit/components/xulstore/tests/xpcshell/xpcshell.ini', u'toolkit/crashreporter/test/unit/xpcshell-phc.ini', u'toolkit/crashreporter/test/unit/xpcshell.ini', u'toolkit/crashreporter/test/unit_ipc/xpcshell-phc.ini', u'toolkit/modules/tests/xpcshell/xpcshell.ini', u'toolkit/mozapps/downloads/tests/unit/xpcshell.ini', u'toolkit/mozapps/extensions/test/xpcshell/xpcshell.ini', u'toolkit/mozapps/update/tests/unit_aus_update/xpcshell.ini', u'toolkit/mozapps/update/tests/unit_service_updater/xpcshell.ini', u'toolkit/profile/xpcshell/xpcshell.ini', u'toolkit/xre/test/xpcshell.ini', u'widget/headless/tests/xpcshell.ini', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--self-test', '--symbols-path=/Users/cltbld/tasks/task_1611770787/build/symbols', '--test-plugin-path=/Users/cltbld/tasks/task_1611770787/build/application/Firefox NightlyDebug.app/Contents/Resources/plugins', '--log-raw=/Users/cltbld/tasks/task_1611770787/build/blobber_upload_dir/xpcshell_raw.log', '--log-errorsummary=/Users/cltbld/tasks/task_1611770787/build/blobber_upload_dir/xpcshell_errorsummary.log', '--utility-path=tests/bin', '--xpcshell=/Users/cltbld/tasks/task_1611770787/build/application/Firefox NightlyDebug.app/Contents/MacOS/xpcshell', '--manifest=tests/xpcshell/tests/xpcshell.ini'] with output_timeout 1000
[task 2021-01-27T18:15:16.450Z] 18:15:16     INFO -  testAddTaskRunNextTest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:17.185Z] 18:15:17     INFO -  testAddTaskSkip (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:17.917Z] 18:15:17     INFO -  testAddTaskSkipAll (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:18.630Z] 18:15:18     INFO -  testAddTaskStackTrace (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:19.352Z] 18:15:19     INFO -  testAddTaskTestFailureInside (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:20.076Z] 18:15:20     INFO -  testAddTaskTestMultiple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:20.837Z] 18:15:20     INFO -  testAddTaskTestRejected (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:21.542Z] 18:15:21     INFO -  testAddTaskTestSingle (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:22.323Z] 18:15:22     INFO -  testAddTestFailing (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:23.028Z] 18:15:23     INFO -  testAddTestSimple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:23.759Z] 18:15:23     INFO -  testAddTestUncaughtRejection (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:24.500Z] 18:15:24     INFO -  testAddTestUncaughtRejectionJSM (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:33.866Z] 18:15:33     INFO -  testAssertStack (__main__.XPCShellTestsTests) ... FAIL
[task 2021-01-27T18:15:34.586Z] 18:15:34     INFO -  testAsyncCleanup (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:35.916Z] 18:15:35     INFO -  testChild (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:36.940Z] 18:15:36     INFO -  testChildFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:38.085Z] 18:15:38     INFO -  testChildHang (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:39.274Z] 18:15:39     INFO -  testChildMozinfo (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:40.617Z] 18:15:40     INFO -  testChildPass (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:48.523Z] 18:15:48     INFO -  testCrashLogging (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:49.224Z] 18:15:49     INFO -  testDoPrintWhenVerboseExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:49.966Z] 18:15:49     INFO -  testDoPrintWhenVerboseInManifest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:50.673Z] 18:15:50     INFO -  testDoPrintWhenVerboseNotExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:51.246Z] 18:15:51     INFO -  testDoReportForeignObject (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:51.989Z] 18:15:51     INFO -  testDoReportNonSyntaxError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:52.730Z] 18:15:52     INFO -  testDoReportRefError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:53.478Z] 18:15:53     INFO -  testDoReportSyntaxError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:54.233Z] 18:15:54     INFO -  testDoThrowForeignObject (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:54.985Z] 18:15:54     INFO -  testDoThrowString (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:55.728Z] 18:15:55     INFO -  testFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:55.728Z] 18:15:55     INFO -  testHangingTimeout (__main__.XPCShellTestsTests) ... skipped 'Timeout code path occasionally times out (bug 1098121)'
[task 2021-01-27T18:15:56.496Z] 18:15:56     INFO -  testHeadlessWhenHeadlessExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:57.247Z] 18:15:57     INFO -  testHeadlessWhenHeadlessTrueInManifest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:57.972Z] 18:15:57     INFO -  testKnownFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:58.725Z] 18:15:58     INFO -  testLogCorrectFileName (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:58.920Z] 18:15:58     INFO -  testMissingHeadFile (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:59.724Z] 18:15:59     INFO -  testMozinfo (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:00.472Z] 18:16:00     INFO -  testNoRunTestAddTask (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:01.253Z] 18:16:01     INFO -  testNoRunTestAddTaskFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:01.973Z] 18:16:01     INFO -  testNoRunTestAddTaskMultiple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTestAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTestFail (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNoRunTestEmptyTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotHeadlessByDefault (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotHeadlessWhenHeadlessFalseInManifest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotSkipForAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.765Z] 18:16:02     INFO -  testNotSkipForAddTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.765Z] 18:16:02     INFO -  testPass (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.768Z] 18:16:02     INFO -  testPassFail (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.770Z] 18:16:02     INFO -  testPrefsInManifest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.775Z] 18:16:02     INFO -  testRandomExecution (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testReturnNonzero (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testSkip (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testSkipForAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.789Z] 18:16:02     INFO -  testSkipForAddTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.789Z] 18:16:02     INFO -  testSyntaxError (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.795Z] 18:16:02     INFO -  testUncaughtRejection (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.795Z] 18:16:02     INFO -  testUncaughtRejectionJSM (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.801Z] 18:16:02     INFO -  testUnexpectedPass (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.801Z] 18:16:02     INFO -  testUnicodeInAssertMethods (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ERROR: testNoRunTestAddTestAddTask (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1358, in testNoRunTestAddTestAddTask
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -      self.assertTestResult(True)
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.805Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.805Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ERROR: testNoRunTestAddTestFail (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1387, in testNoRunTestAddTestFail
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.assertTestResult(False)
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  ERROR: testNoRunTestEmptyTest (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1373, in testNoRunTestEmptyTest
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.assertTestResult(True)
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  ERROR: testNotHeadlessByDefault (__main__.XPCShellTestsTests)```

Ryan VanderMeulen [:RyanVM]

Comment 1

•

4 years ago

More fallout from the virtualenv uplifts. This is macOS-only.

Flags: needinfo?(mhentges)

Ryan VanderMeulen [:RyanVM]

Updated

•

4 years ago

Summary: Perma [OSX][esr78] OSError: [Errno 24] Too many open files → Perma [OSX][esr78] xpcshell selftest OSError: [Errno 24] Too many open files

Mitchell Hentges [:mhentges] 🦀

Assignee

Updated

•

4 years ago

Assignee: nobody → mhentges

Status: NEW → ASSIGNED

Flags: needinfo?(mhentges)

Comment hidden (Intermittent Failures Robot)

Mitchell Hentges [:mhentges] 🦀

Assignee

Comment 3

•

4 years ago

Though I'm unable to trigger this problem locally, :dhouse has been a champ and quarantined me a CI worker that reproduces the issue.
I'm digging into the cause shortly here.

Julien Cristau [:jcristau]

Updated

•

4 years ago

status-firefox-esr78: --- → affected

tracking-firefox-esr78: --- → 86+

Mitchell Hentges [:mhentges] 🦀

Assignee

Comment 4

•

4 years ago

Progress update: I've got an interactive reproduce on the quarantined worker 👍.

Mitchell Hentges [:mhentges] 🦀

Assignee

Updated

•

4 years ago

Regressed by: 1654457

Mitchell Hentges [:mhentges] 🦀

Assignee

Updated

•

4 years ago

See Also: → https://bugzilla.mozilla.org/show_bug.cgi?id=1654479

Mitchell Hentges [:mhentges] 🦀

Assignee

Comment 5

•

4 years ago

When I requested XPCShell test changes for uplift (because it blocked running test in general with py3), I missed its dependents, including one involving leaked file descriptors (sound familiar?).

Adding those two dependents and pushing to try.

Mitchell Hentges [:mhentges] 🦀

Assignee

Comment 6

•

4 years ago

Hmm, when I originally set up the uplift for that virtualenv bug, I tried to move the minimal amount of patches so that at least the build would still work and hopefully CI would be happy.

However, going through the list of patches again and looking at their associated regressions and dependents (in central), I think that I should broaden my scope a bit. My new criteria for evaluating each patch is "was this it's issue caused by <uplift stack> and is it still relevant on the ESR tree?". (For example, this bug is ignored because python-test with --python is no longer possible on ESR).

The new stack is:

1670788 - Remove virtualenv from third_party/python/requirements.in r=firefox-build-system-reviewers,glandium
-> Resolves issue where mach vendor python makes too many changes
1670784 - Upgrade vendored pip-tools r=firefox-build-system-reviewers,glandium
-> Fixes mach vendor python
1661790 - Allow configuring the name of the virtualenv used for builds r=nalexander
-> Isn't related to failures, but based on Ricky's comments, this avoids an unnecessary virtualenv creation. This
should've been part of the initial virtualenv uplift stack 😅
1654483 - Enable the CFI directives for NS_InvokeByIndex on macOS. r=froydnj
-> Needed for xpcshell tests to pass
1654479 - Clear up processes after shutting them down in XPCShellTests. r=gbrown
-> Needed for this bug!
1654457 - Use pip list --format freeze instead of pip freeze. r=ahal
-> Needed because mozharness' version of virtualenv was really old, and the one under /third_party/python/ has a new pip.
1408051 - Remove mozharness' copy of virtualenv and use the one under /third_party/python instead r=ahal,rail
-> Resolves the pyvenv.cfg intermittent.

Mitchell Hentges [:mhentges] 🦀

Assignee

Comment 7

•

4 years ago

Ran into an issue caused by a bad merge conflict resolution from before, but that's resolved in this little patch.

Try job is here.
@RelMan: two things are needed to resolve this bug:

Uplift the new set of patches.
Uplift this little patch (do you want it on Phabricator?).

Thanks!

Ryan VanderMeulen [:RyanVM]

Comment 8

•

4 years ago

Fixed by the latest round of uplifts. ESR78 is open again.

Status: ASSIGNED → RESOLVED

Closed: 4 years ago

status-firefox-esr78: affected → fixed

Resolution: --- → FIXED

Bugzilla

Perma [OSX][esr78] xpcshell selftest OSError: [Errno 24] Too many open files

Categories

(Testing :: XPCShell Harness, defect, P5)

Tracking

(firefox-esr7886+ fixed)

People

(Reporter: intermittent-bug-filer, Assigned: mhentges)

References

(Regression)

Details

(Keywords: intermittent-failure)

Crash Data

Security

(public)

User Story

Description

Comment 1

Updated

Updated

Comment 2

Comment 3

Updated

Comment 4

Updated

Updated

Comment 5

Comment 6

Comment 7

Comment 8