Closed Bug 1764534 Opened 3 years ago Closed 3 years ago

bootstrap fails because of unexpected pth file

Categories

(Firefox Build System :: Mach Core, defect)

defect

Tracking

(firefox-esr91 unaffected, firefox99 unaffected, firefox100 unaffected, firefox101 fixed)

RESOLVED FIXED
101 Branch
Tracking Status
firefox-esr91 --- unaffected
firefox99 --- unaffected
firefox100 --- unaffected
firefox101 --- fixed

People

(Reporter: emilio, Assigned: mhentges)

References

(Blocks 1 open bug, Regression)

Details

(Keywords: regression)

Attachments

(1 file)

Updating bootstrapped toolchain in /home/emilio/.mozbuild/minidump-stackwalk
Traceback (most recent call last):
  File "/home/emilio/src/moz/gecko/mach", line 96, in <module>
    main(sys.argv[1:])
  File "/home/emilio/src/moz/gecko/mach", line 88, in main
    mach = check_and_get_mach(os.path.dirname(os.path.realpath(__file__)))
  File "/home/emilio/src/moz/gecko/mach", line 35, in check_and_get_mach
    return load_mach(dir_path, mach_path)
  File "/home/emilio/src/moz/gecko/mach", line 21, in load_mach
    return mach_initialize.initialize(dir_path)
  File "/home/emilio/src/moz/gecko/build/mach_initialize.py", line 153, in initialize
    _activate_python_environment(
  File "/home/emilio/src/moz/gecko/build/mach_initialize.py", line 99, in _activate_python_environment
    mach_environment.activate()
  File "/home/emilio/src/moz/gecko/python/mach/mach/site.py", line 359, in activate
    self.ensure()
  File "/home/emilio/src/moz/gecko/python/mach/mach/site.py", line 345, in ensure
    raise VirtualenvOutOfDateException(result.reason)
mach.site.VirtualenvOutOfDateException: The pthfile at "/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib64/python3.10/site-packages/mach.pth" does not match the expected value.
# --- on-disk pthfile: ---
/home/emilio/src/moz/gecko/build
/home/emilio/src/moz/gecko/config
/home/emilio/src/moz/gecko/config/mozunit
/home/emilio/src/moz/gecko/dom/bindings
/home/emilio/src/moz/gecko/dom/bindings/parser
/home/emilio/src/moz/gecko/layout/tools/reftest
/home/emilio/src/moz/gecko/python/l10n
/home/emilio/src/moz/gecko/python/mach
/home/emilio/src/moz/gecko/python/mozboot
/home/emilio/src/moz/gecko/python/mozbuild
/home/emilio/src/moz/gecko/python/mozlint
/home/emilio/src/moz/gecko/python/mozperftest
/home/emilio/src/moz/gecko/python/mozrelease
/home/emilio/src/moz/gecko/python/mozterm
/home/emilio/src/moz/gecko/python/mozversioncontrol
/home/emilio/src/moz/gecko/security/manager/tools
/home/emilio/src/moz/gecko/taskcluster
/home/emilio/src/moz/gecko/testing
/home/emilio/src/moz/gecko/testing/awsy
/home/emilio/src/moz/gecko/testing/condprofile
/home/emilio/src/moz/gecko/testing/firefox-ui/harness
/home/emilio/src/moz/gecko/testing/marionette/client
/home/emilio/src/moz/gecko/testing/marionette/harness
/home/emilio/src/moz/gecko/testing/mozbase/manifestparser
/home/emilio/src/moz/gecko/testing/mozbase/mozcrash
/home/emilio/src/moz/gecko/testing/mozbase/mozdebug
/home/emilio/src/moz/gecko/testing/mozbase/mozdevice
/home/emilio/src/moz/gecko/testing/mozbase/mozfile
/home/emilio/src/moz/gecko/testing/mozbase/mozhttpd
/home/emilio/src/moz/gecko/testing/mozbase/mozgeckoprofiler
/home/emilio/src/moz/gecko/testing/mozbase/mozinfo
/home/emilio/src/moz/gecko/testing/mozbase/mozinstall
/home/emilio/src/moz/gecko/testing/mozbase/mozleak
/home/emilio/src/moz/gecko/testing/mozbase/mozlog
/home/emilio/src/moz/gecko/testing/mozbase/moznetwork
/home/emilio/src/moz/gecko/testing/mozbase/mozpower
/home/emilio/src/moz/gecko/testing/mozbase/mozprocess
/home/emilio/src/moz/gecko/testing/mozbase/mozprofile
/home/emilio/src/moz/gecko/testing/mozbase/mozproxy
/home/emilio/src/moz/gecko/testing/mozbase/mozrunner
/home/emilio/src/moz/gecko/testing/mozbase/mozsystemmonitor
/home/emilio/src/moz/gecko/testing/mozbase/mozscreenshot
/home/emilio/src/moz/gecko/testing/mozbase/moztest
/home/emilio/src/moz/gecko/testing/mozbase/mozversion
/home/emilio/src/moz/gecko/testing/raptor
/home/emilio/src/moz/gecko/testing/talos
/home/emilio/src/moz/gecko/testing/web-platform
/home/emilio/src/moz/gecko/testing/xpcshell
/home/emilio/src/moz/gecko/toolkit/components/telemetry/tests/marionette/harness
/home/emilio/src/moz/gecko/tools
/home/emilio/src/moz/gecko/tools/moztreedocs
/home/emilio/src/moz/gecko/xpcom/ds/tools
/home/emilio/src/moz/gecko/xpcom/geckoprocesstypes_generator
/home/emilio/src/moz/gecko/xpcom/idl-parser
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/funcsigs
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/h2
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/hpack
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/html5lib
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/hyperframe
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/pywebsocket3
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/webencodings
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/wptserve
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/wptrunner
/home/emilio/src/moz/gecko/third_party/python/aiohttp
/home/emilio/src/moz/gecko/third_party/python/appdirs
/home/emilio/src/moz/gecko/third_party/python/async_timeout
/home/emilio/src/moz/gecko/third_party/python/attrs
/home/emilio/src/moz/gecko/third_party/python/blessings
/home/emilio/src/moz/gecko/third_party/python/cbor2
/home/emilio/src/moz/gecko/third_party/python/certifi
/home/emilio/src/moz/gecko/third_party/python/chardet
/home/emilio/src/moz/gecko/third_party/python/click
/home/emilio/src/moz/gecko/third_party/python/colorama
/home/emilio/src/moz/gecko/third_party/python/compare_locales
/home/emilio/src/moz/gecko/third_party/python/cookies
/home/emilio/src/moz/gecko/third_party/python/cram
/home/emilio/src/moz/gecko/third_party/python/diskcache
/home/emilio/src/moz/gecko/third_party/python/distro
/home/emilio/src/moz/gecko/third_party/python/dlmanager
/home/emilio/src/moz/gecko/third_party/python/ecdsa
/home/emilio/src/moz/gecko/third_party/python/esprima
/home/emilio/src/moz/gecko/third_party/python/fluent.migrate
/home/emilio/src/moz/gecko/third_party/python/fluent.syntax
/home/emilio/src/moz/gecko/third_party/python/gyp/pylib
/home/emilio/src/moz/gecko/third_party/python/idna
/home/emilio/src/moz/gecko/third_party/python/idna-ssl
/home/emilio/src/moz/gecko/third_party/python/importlib_metadata
/home/emilio/src/moz/gecko/third_party/python/iso8601
/home/emilio/src/moz/gecko/third_party/python/Jinja2
/home/emilio/src/moz/gecko/third_party/python/jsmin
/home/emilio/src/moz/gecko/third_party/python/json-e
/home/emilio/src/moz/gecko/third_party/python/jsonschema
/home/emilio/src/moz/gecko/third_party/python/MarkupSafe/src
/home/emilio/src/moz/gecko/third_party/python/mohawk
/home/emilio/src/moz/gecko/third_party/python/mozilla_version
/home/emilio/src/moz/gecko/third_party/python/multidict
/home/emilio/src/moz/gecko/third_party/python/packaging
/home/emilio/src/moz/gecko/third_party/python/pathspec
/home/emilio/src/moz/gecko/third_party/python/pip
/home/emilio/src/moz/gecko/third_party/python/pip_tools
/home/emilio/src/moz/gecko/third_party/python/ply
/home/emilio/src/moz/gecko/third_party/python/pyasn1
/home/emilio/src/moz/gecko/third_party/python/pyasn1_modules
/home/emilio/src/moz/gecko/third_party/python/pylru
/home/emilio/src/moz/gecko/third_party/python/pyparsing
/home/emilio/src/moz/gecko/third_party/python/pyrsistent
/home/emilio/src/moz/gecko/third_party/python/python-hglib
/home/emilio/src/moz/gecko/third_party/python/pytoml
/home/emilio/src/moz/gecko/third_party/python/PyYAML/lib3
/home/emilio/src/moz/gecko/third_party/python/redo
/home/emilio/src/moz/gecko/third_party/python/requests
/home/emilio/src/moz/gecko/third_party/python/requests_unixsocket
/home/emilio/src/moz/gecko/third_party/python/responses
/home/emilio/src/moz/gecko/third_party/python/rsa
/home/emilio/src/moz/gecko/third_party/python/setuptools
/home/emilio/src/moz/gecko/third_party/python/sentry_sdk
/home/emilio/src/moz/gecko/third_party/python/six
/home/emilio/src/moz/gecko/third_party/python/slugid
/home/emilio/src/moz/gecko/third_party/python/taskcluster
/home/emilio/src/moz/gecko/third_party/python/taskcluster_taskgraph
/home/emilio/src/moz/gecko/third_party/python/taskcluster_urls
/home/emilio/src/moz/gecko/third_party/python/tqdm
/home/emilio/src/moz/gecko/third_party/python/typing_extensions
/home/emilio/src/moz/gecko/third_party/python/urllib3
/home/emilio/src/moz/gecko/third_party/python/voluptuous
/home/emilio/src/moz/gecko/third_party/python/wheel
/home/emilio/src/moz/gecko/third_party/python/yamllint
/home/emilio/src/moz/gecko/third_party/python/yarl
/home/emilio/src/moz/gecko/third_party/python/zipp
import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib/python3.10/site-packages'.lower()]
import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib/python3.10/site-packages')
import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib64/python3.10/site-packages'.lower()]
import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib64/python3.10/site-packages')
# --- expected pthfile contents ---
/home/emilio/src/moz/gecko/build
/home/emilio/src/moz/gecko/config
/home/emilio/src/moz/gecko/config/mozunit
/home/emilio/src/moz/gecko/dom/bindings
/home/emilio/src/moz/gecko/dom/bindings/parser
/home/emilio/src/moz/gecko/layout/tools/reftest
/home/emilio/src/moz/gecko/python/l10n
/home/emilio/src/moz/gecko/python/mach
/home/emilio/src/moz/gecko/python/mozboot
/home/emilio/src/moz/gecko/python/mozbuild
/home/emilio/src/moz/gecko/python/mozlint
/home/emilio/src/moz/gecko/python/mozperftest
/home/emilio/src/moz/gecko/python/mozrelease
/home/emilio/src/moz/gecko/python/mozterm
/home/emilio/src/moz/gecko/python/mozversioncontrol
/home/emilio/src/moz/gecko/security/manager/tools
/home/emilio/src/moz/gecko/taskcluster
/home/emilio/src/moz/gecko/testing
/home/emilio/src/moz/gecko/testing/awsy
/home/emilio/src/moz/gecko/testing/condprofile
/home/emilio/src/moz/gecko/testing/firefox-ui/harness
/home/emilio/src/moz/gecko/testing/marionette/client
/home/emilio/src/moz/gecko/testing/marionette/harness
/home/emilio/src/moz/gecko/testing/mozbase/manifestparser
/home/emilio/src/moz/gecko/testing/mozbase/mozcrash
/home/emilio/src/moz/gecko/testing/mozbase/mozdebug
/home/emilio/src/moz/gecko/testing/mozbase/mozdevice
/home/emilio/src/moz/gecko/testing/mozbase/mozfile
/home/emilio/src/moz/gecko/testing/mozbase/mozhttpd
/home/emilio/src/moz/gecko/testing/mozbase/mozgeckoprofiler
/home/emilio/src/moz/gecko/testing/mozbase/mozinfo
/home/emilio/src/moz/gecko/testing/mozbase/mozinstall
/home/emilio/src/moz/gecko/testing/mozbase/mozleak
/home/emilio/src/moz/gecko/testing/mozbase/mozlog
/home/emilio/src/moz/gecko/testing/mozbase/moznetwork
/home/emilio/src/moz/gecko/testing/mozbase/mozpower
/home/emilio/src/moz/gecko/testing/mozbase/mozprocess
/home/emilio/src/moz/gecko/testing/mozbase/mozprofile
/home/emilio/src/moz/gecko/testing/mozbase/mozproxy
/home/emilio/src/moz/gecko/testing/mozbase/mozrunner
/home/emilio/src/moz/gecko/testing/mozbase/mozsystemmonitor
/home/emilio/src/moz/gecko/testing/mozbase/mozscreenshot
/home/emilio/src/moz/gecko/testing/mozbase/moztest
/home/emilio/src/moz/gecko/testing/mozbase/mozversion
/home/emilio/src/moz/gecko/testing/raptor
/home/emilio/src/moz/gecko/testing/talos
/home/emilio/src/moz/gecko/testing/web-platform
/home/emilio/src/moz/gecko/testing/xpcshell
/home/emilio/src/moz/gecko/toolkit/components/telemetry/tests/marionette/harness
/home/emilio/src/moz/gecko/tools
/home/emilio/src/moz/gecko/tools/moztreedocs
/home/emilio/src/moz/gecko/xpcom/ds/tools
/home/emilio/src/moz/gecko/xpcom/geckoprocesstypes_generator
/home/emilio/src/moz/gecko/xpcom/idl-parser
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/funcsigs
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/h2
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/hpack
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/html5lib
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/hyperframe
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/pywebsocket3
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/third_party/webencodings
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/wptserve
/home/emilio/src/moz/gecko/testing/web-platform/tests/tools/wptrunner
/home/emilio/src/moz/gecko/third_party/python/aiohttp
/home/emilio/src/moz/gecko/third_party/python/appdirs
/home/emilio/src/moz/gecko/third_party/python/async_timeout
/home/emilio/src/moz/gecko/third_party/python/attrs
/home/emilio/src/moz/gecko/third_party/python/blessings
/home/emilio/src/moz/gecko/third_party/python/cbor2
/home/emilio/src/moz/gecko/third_party/python/certifi
/home/emilio/src/moz/gecko/third_party/python/chardet
/home/emilio/src/moz/gecko/third_party/python/click
/home/emilio/src/moz/gecko/third_party/python/colorama
/home/emilio/src/moz/gecko/third_party/python/compare_locales
/home/emilio/src/moz/gecko/third_party/python/cookies
/home/emilio/src/moz/gecko/third_party/python/cram
/home/emilio/src/moz/gecko/third_party/python/diskcache
/home/emilio/src/moz/gecko/third_party/python/distro
/home/emilio/src/moz/gecko/third_party/python/dlmanager
/home/emilio/src/moz/gecko/third_party/python/ecdsa
/home/emilio/src/moz/gecko/third_party/python/esprima
/home/emilio/src/moz/gecko/third_party/python/fluent.migrate
/home/emilio/src/moz/gecko/third_party/python/fluent.syntax
/home/emilio/src/moz/gecko/third_party/python/gyp/pylib
/home/emilio/src/moz/gecko/third_party/python/idna
/home/emilio/src/moz/gecko/third_party/python/idna-ssl
/home/emilio/src/moz/gecko/third_party/python/importlib_metadata
/home/emilio/src/moz/gecko/third_party/python/iso8601
/home/emilio/src/moz/gecko/third_party/python/Jinja2
/home/emilio/src/moz/gecko/third_party/python/jsmin
/home/emilio/src/moz/gecko/third_party/python/json-e
/home/emilio/src/moz/gecko/third_party/python/jsonschema
/home/emilio/src/moz/gecko/third_party/python/MarkupSafe/src
/home/emilio/src/moz/gecko/third_party/python/mohawk
/home/emilio/src/moz/gecko/third_party/python/mozilla_version
/home/emilio/src/moz/gecko/third_party/python/multidict
/home/emilio/src/moz/gecko/third_party/python/packaging
/home/emilio/src/moz/gecko/third_party/python/pathspec
/home/emilio/src/moz/gecko/third_party/python/pip
/home/emilio/src/moz/gecko/third_party/python/pip_tools
/home/emilio/src/moz/gecko/third_party/python/ply
/home/emilio/src/moz/gecko/third_party/python/pyasn1
/home/emilio/src/moz/gecko/third_party/python/pyasn1_modules
/home/emilio/src/moz/gecko/third_party/python/pylru
/home/emilio/src/moz/gecko/third_party/python/pyparsing
/home/emilio/src/moz/gecko/third_party/python/pyrsistent
/home/emilio/src/moz/gecko/third_party/python/python-hglib
/home/emilio/src/moz/gecko/third_party/python/pytoml
/home/emilio/src/moz/gecko/third_party/python/PyYAML/lib3
/home/emilio/src/moz/gecko/third_party/python/redo
/home/emilio/src/moz/gecko/third_party/python/requests
/home/emilio/src/moz/gecko/third_party/python/requests_unixsocket
/home/emilio/src/moz/gecko/third_party/python/responses
/home/emilio/src/moz/gecko/third_party/python/rsa
/home/emilio/src/moz/gecko/third_party/python/setuptools
/home/emilio/src/moz/gecko/third_party/python/sentry_sdk
/home/emilio/src/moz/gecko/third_party/python/six
/home/emilio/src/moz/gecko/third_party/python/slugid
/home/emilio/src/moz/gecko/third_party/python/taskcluster
/home/emilio/src/moz/gecko/third_party/python/taskcluster_taskgraph
/home/emilio/src/moz/gecko/third_party/python/taskcluster_urls
/home/emilio/src/moz/gecko/third_party/python/tqdm
/home/emilio/src/moz/gecko/third_party/python/typing_extensions
/home/emilio/src/moz/gecko/third_party/python/urllib3
/home/emilio/src/moz/gecko/third_party/python/voluptuous
/home/emilio/src/moz/gecko/third_party/python/wheel
/home/emilio/src/moz/gecko/third_party/python/yamllint
/home/emilio/src/moz/gecko/third_party/python/yarl
/home/emilio/src/moz/gecko/third_party/python/zipp
import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib64/python3.10/site-packages'.lower()]
import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib64/python3.10/site-packages')
import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib/python3.10/site-packages'.lower()]
import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/lib/python3.10/site-packages')
# ---
ERROR: Command '['/home/emilio/.mozbuild/srcdirs/gecko-8079af95cd5b/_virtualenvs/mach/bin/python', '/home/emilio/src/moz/gecko/mach', '--log-no-times', 'artifact', 'toolchain', '--from-task', 'Cir1JqkdT5OYT9bTS1AszA:public/build/minidump-stackwalk.tar.zst']' returned non-zero exit status 1.
diff --git a/actual.txt b/expected.txt
index fd37646a51b49..5f56a0f01db4d 100644
--- a/actual.txt
+++ b/expected.txt
@@ -127,7 +127,7 @@
 /home/emilio/src/moz/gecko-2/third_party/python/yamllint
 /home/emilio/src/moz/gecko-2/third_party/python/yarl
 /home/emilio/src/moz/gecko-2/third_party/python/zipp
-import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib/python3.10/site-packages'.lower()]
-import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib/python3.10/site-packages')
 import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib64/python3.10/site-packages'.lower()]
 import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib64/python3.10/site-packages')
+import sys; sys.path = [p for p in sys.path if p.lower() != '/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib/python3.10/site-packages'.lower()]
+import sys; sys.path.append('/home/emilio/.mozbuild/srcdirs/gecko-2-fab9452aa406/_virtualenvs/mach/lib/python3.10/site-packages')
Flags: needinfo?(mhentges)

I had to revert bug 1761150 as well to get a working android bootstrap.

(This is not on rawhide, this is on Fedora 36, ftr)

Has Regression Range: --- → yes

Set release status flags based on info from the regressing bug 1763244

Flags: needinfo?(mhentges)

De-duping with set causes order to no longer be maintained when the
items are distinct. Use the OrderedDict technique to de-dupe
consistently instead.

Assignee: nobody → mhentges
Status: NEW → ASSIGNED
Pushed by mhentges@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/149c155a250b Maintain site_packages_dir order r=emilio
Pushed by nfay@mozilla.com: https://hg.mozilla.org/mozilla-central/rev/4f936f5e57c8 Maintain site_packages_dir order r=emilio
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
Target Milestone: --- → 101 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: