Closed Bug 1672499 Opened 4 years ago Closed 4 years ago

Perma cargotest [taskcluster:error] exit status 1

Categories

(Firefox Build System :: Toolchains, defect, P5)

defect

Tracking

(firefox84 fixed)

RESOLVED FIXED
84 Branch
Tracking Status
firefox84 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: glandium)

References

Details

(Keywords: intermittent-failure)

Attachments

(1 file)

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=319294667&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/eGUnBTJGTAGGdFP5-vA1Hg/runs/0/artifacts/public/logs/live_backing.log


[taskcluster 2020-10-21T20:27:57.798Z] Worker Type (gecko-t-osx-1014) settings:
[taskcluster 2020-10-21T20:27:57.800Z] {
[taskcluster 2020-10-21T20:27:57.800Z] "config": {
[taskcluster 2020-10-21T20:27:57.800Z] "deploymentId": "",
[taskcluster 2020-10-21T20:27:57.800Z] "runTasksAsCurrentUser": true
[taskcluster 2020-10-21T20:27:57.800Z] },
[taskcluster 2020-10-21T20:27:57.800Z] "generic-worker": {
[taskcluster 2020-10-21T20:27:57.800Z] "go-arch": "amd64",
[taskcluster 2020-10-21T20:27:57.800Z] "go-os": "darwin",
[taskcluster 2020-10-21T20:27:57.800Z] "go-version": "go1.10.3",
[taskcluster 2020-10-21T20:27:57.800Z] "release": "https://github.com/taskcluster/generic-worker/releases/tag/v13.0.3",
[taskcluster 2020-10-21T20:27:57.800Z] "revision": "4790b3e4a8b726daa41aa102091b53b192aa79ef",
[taskcluster 2020-10-21T20:27:57.800Z] "source": "https://github.com/taskcluster/generic-worker/commits/4790b3e4a8b726daa41aa102091b53b192aa79ef",
[taskcluster 2020-10-21T20:27:57.800Z] "version": "13.0.3"
[taskcluster 2020-10-21T20:27:57.800Z] },
[taskcluster 2020-10-21T20:27:57.800Z] "machine-setup": {
[taskcluster 2020-10-21T20:27:57.800Z] "config": "https://github.com/mozilla-platform-ops/ronin_puppet/raw/master/modules/generic_worker/templates/generic-worker.config.erb",
[taskcluster 2020-10-21T20:27:57.800Z] "docs": "https://wiki.mozilla.org/ReleaseEngineering/PuppetAgain/Modules/generic_worker"
[taskcluster 2020-10-21T20:27:57.800Z] }
[taskcluster 2020-10-21T20:27:57.800Z] }
[taskcluster 2020-10-21T20:27:57.800Z] Task ID: elGKlWh9SMGOEXbaIZBjOg
[taskcluster 2020-10-21T20:27:57.800Z] === Task Starting ===
[taskcluster 2020-10-21T20:27:57.876Z] [mounts] Moving existing writable directory cache gecko-level-3-checkouts-sparse from /Users/cltbld/caches/OkJwFdttQkuMOpy6WvzfcA to /Users/cltbld/tasks/task_1603309259/checkouts
[taskcluster 2020-10-21T20:27:57.876Z] [mounts] Creating directory /Users/cltbld/tasks/task_1603309259 with permissions 0700
[taskcluster 2020-10-21T20:27:57.876Z] [mounts] Successfully mounted writable directory cache '/Users/cltbld/tasks/task_1603309259/checkouts'
[taskcluster 2020-10-21T20:27:57.876Z] [mounts] Downloading url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/run-task to /Users/cltbld/downloads/AIeyIeZCRG-lcqnQZtv0IA
[taskcluster 2020-10-21T20:27:59.029Z] [mounts] Downloaded 35842 bytes with SHA256 ce115c4ec883f2e4f1544079d68b8e96260fda231a8523db60bc55daceefd754 from url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/run-task to /Users/cltbld/downloads/AIeyIeZCRG-lcqnQZtv0IA
[taskcluster:warn 2020-10-21T20:27:59.029Z] [mounts] Download /Users/cltbld/downloads/AIeyIeZCRG-lcqnQZtv0IA of url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/run-task has SHA256 ce115c4ec883f2e4f1544079d68b8e96260fda231a8523db60bc55daceefd754 but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2020-10-21T20:27:59.029Z] [mounts] Creating directory /Users/cltbld/tasks/task_1603309259 with permissions 0700
[taskcluster 2020-10-21T20:27:59.029Z] [mounts] Copying /Users/cltbld/downloads/AIeyIeZCRG-lcqnQZtv0IA to /Users/cltbld/tasks/task_1603309259/run-task
[taskcluster 2020-10-21T20:27:59.029Z] [mounts] Downloading url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/misc/fetch-content to /Users/cltbld/downloads/bQmqMGytSRCusAU75qHjfQ
[taskcluster 2020-10-21T20:27:59.825Z] [mounts] Downloaded 25804 bytes with SHA256 c3e084f90d9b034149c9be7ada12fc0ee41c0e66080ce463654e6ab3ff634c0d from url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/misc/fetch-content to /Users/cltbld/downloads/bQmqMGytSRCusAU75qHjfQ
[taskcluster:warn 2020-10-21T20:27:59.825Z] [mounts] Download /Users/cltbld/downloads/bQmqMGytSRCusAU75qHjfQ of url https://hg.mozilla.org/integration/autoland/raw-file/c061dfcf1598aece0fe343783b351d0a280bf67d/taskcluster/scripts/misc/fetch-content has SHA256 c3e084f90d9b034149c9be7ada12fc0ee41c0e66080ce463654e6ab3ff634c0d but task payload does not declare a required value, so content authenticity cannot be verified
[taskcluster 2020-10-21T20:27:59.825Z] [mounts] Creating directory /Users/cltbld/tasks/task_1603309259 with permissions 0700
[taskcluster 2020-10-21T20:27:59.825Z] [mounts] Copying /Users/cltbld/downloads/bQmqMGytSRCusAU75qHjfQ to /Users/cltbld/tasks/task_1603309259/fetch-content
[taskcluster 2020-10-21T20:27:59.826Z] Executing command 0: chmod '+x' run-task
[taskcluster 2020-10-21T20:27:59.829Z] Exit Code: 0
[taskcluster 2020-10-21T20:27:59.829Z] User Time: 602µs
[taskcluster 2020-10-21T20:27:59.829Z] Kernel Time: 668µs
[taskcluster 2020-10-21T20:27:59.829Z] Wall Time: 3.388046ms
[taskcluster 2020-10-21T20:27:59.829Z] Result: SUCCEEDED
[taskcluster 2020-10-21T20:27:59.829Z] Executing command 1: /usr/local/bin/python3 run-task '--gecko-checkout=./checkouts/gecko' --gecko-sparse-profile=build/sparse-profiles/webrender --task-cwd checkouts/gecko/gfx/wr -- bash -cx 'mv cargo-test-binaries target && cd target && for i in debug/; do $i; done'
[setup 2020-10-21T20:27:59.918Z] run-task started in /Users/cltbld/tasks/task_1603309259
[vcs 2020-10-21T20:27:59.921Z] WARNING: vcs checkout path (./checkouts/gecko) not in cache or volume; performance will likely suffer
[vcs 2020-10-21T20:27:59.922Z] WARNING: HG_STORE_PATH (./checkouts/hg-shared) not in cache or volume; performance will likely suffer
[vcs 2020-10-21T20:27:59.922Z] TASKCLUSTER_WORKER_LOCATION environment variable not set; using public hg.mozilla.org service
[vcs 2020-10-21T20:27:59.922Z] executing ['hg', 'robustcheckout', '--sharebase', '/Users/cltbld/tasks/task_1603309259/checkouts/hg-shared', '--purge', '--upstream', 'https://hg.mozilla.org/mozilla-unified', '--sparseprofile', 'build/sparse-profiles/webrender', '--revision', 'c061dfcf1598aece0fe343783b351d0a280bf67d', 'https://hg.mozilla.org/integration/autoland', '/Users/cltbld/tasks/task_1603309259/checkouts/gecko']
[vcs 2020-10-21T20:28:00.186Z] (using Mercurial 5.1)
[vcs 2020-10-21T20:28:00.187Z] ensuring https://hg.mozilla.org/integration/autoland@c061dfcf1598aece0fe343783b351d0a280bf67d is available at /Users/cltbld/tasks/task_1603309259/checkouts/gecko
[vcs 2020-10-21T20:28:00.190Z] (existing repository shared store: /Users/cltbld/tasks/task_1597708332/checkouts/hg-shared/8ba995b74e18334ab3707f27e9eb8f4e37ba3d29/.hg)
[vcs 2020-10-21T20:28:00.190Z] (shared store does not exist; deleting destination)
[vcs 2020-10-21T20:28:13.582Z] (cloning from upstream repo https://hg.mozilla.org/mozilla-unified)
[vcs 2020-10-21T20:28:13.788Z] (sharing from existing pooled repository 8ba995b74e18334ab3707f27e9eb8f4e37ba3d29)
[vcs 2020-10-21T20:28:14.212Z] searching for changes
[vcs 2020-10-21T20:28:15.013Z] adding changesets
[vcs 2020-10-21T20:28:16.521Z] adding manifests
<...>
[vcs 2020-10-21T20:29:09.820Z] files [=====================================> ] 25705/36270 13s
[vcs 2020-10-21T20:29:09.830Z]
[vcs 2020-10-21T20:29:09.830Z] added 10300 changesets with 58718 changes to 26231 files (+1 heads)
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark aurora
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark autoland
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark beta
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark central
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr10
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr17
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr24
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr31
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr38
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr45
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr52
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr60
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr68
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark esr78
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark fx-team
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark inbound
[vcs 2020-10-21T20:29:10.301Z] adding remote bookmark release
[vcs 2020-10-21T20:29:10.716Z] new changesets d3a15148670c:fe968df74545
[vcs 2020-10-21T20:29:11.125Z] (setting sparse config to profile build/sparse-profiles/webrender)
[vcs 2020-10-21T20:29:11.131Z] 0 files added, 0 files dropped, 0 files conflicting
[vcs 2020-10-21T20:29:11.132Z] (sparse refresh complete)
[vcs 2020-10-21T20:29:13.057Z] warning: sparse profile 'build/sparse-profiles/webrender' not found in rev 000000000000 - ignoring it
[vcs 2020-10-21T20:29:17.445Z] (warning: large working directory being used without fsmonitor enabled; enable fsmonitor to improve performance; see "hg help -e fsmonitor")
[vcs 2020-10-21T20:29:17.770Z]
[vcs 2020-10-21T20:29:18.815Z] updating [ ] 100/95374
[vcs 2020-10-21T20:29:19.835Z] updating [> ] 2900/95374 35s
[vcs 2020-10-21T20:29:20.837Z] updating [==> ] 5700/95374 34s
[vcs 2020-10-21T20:29:21.887Z] updating [===> ] 8500/95374 32s
[vcs 2020-10-21T20:29:22.931Z] updating [=====> ] 11600/95374 31s
[vcs 2020-10-21T20:29:24.059Z] updating [======> ] 14500/95374 29s
[vcs 2020-10-21T20:29:25.151Z] updating [========> ] 17700/95374 28s
[vcs 2020-10-21T20:29:26.152Z] updating [=========> ] 20100/95374 28s
[vcs 2020-10-21T20:29:27.186Z] updating [===========> ] 23200/95374 27s
[vcs 2020-10-21T20:29:28.293Z] updating [=============> ] 25700/95374 26s
[vcs 2020-10-21T20:29:29.426Z] updating [==============> ] 28900/95374 25s
[vcs 2020-10-21T20:29:30.540Z] updating [================> ] 32100/95374 24s
[vcs 2020-10-21T20:29:31.651Z] updating [==================> ] 35300/95374 22s
[vcs 2020-10-21T20:29:32.751Z] updating [===================> ] 38500/95374 21s
[vcs 2020-10-21T20:29:33.850Z] updating [=====================> ] 41700/95374 20s
[vcs 2020-10-21T20:29:34.891Z] updating [=======================> ] 44900/95374 19s
[vcs 2020-10-21T20:29:35.939Z] updating [=========================> ] 47700/95374 18s
[vcs 2020-10-21T20:29:37.040Z] updating [==========================> ] 50500/95374 17s
[vcs 2020-10-21T20:29:38.173Z] updating [============================> ] 53700/95374 15s
[vcs 2020-10-21T20:29:39.280Z] updating [==============================> ] 56900/95374 14s
[vcs 2020-10-21T20:29:40.297Z] updating [===============================> ] 60100/95374 13s
[vcs 2020-10-21T20:29:41.387Z] updating [=================================> ] 62900/95374 12s
[vcs 2020-10-21T20:29:42.422Z] updating [==================================> ] 65700/95374 11s
[vcs 2020-10-21T20:29:43.455Z] updating [====================================> ] 68500/95374 10s
[vcs 2020-10-21T20:29:44.517Z] updating [=====================================> ] 71300/95374 09s
[vcs 2020-10-21T20:29:45.561Z] updating [=======================================> ] 74100/95374 08s
[vcs 2020-10-21T20:29:46.661Z] updating [========================================> ] 76800/95374 07s
[vcs 2020-10-21T20:29:47.768Z] updating [==========================================> ] 79700/95374 06s
[vcs 2020-10-21T20:29:48.803Z] updating [===========================================> ] 82500/95374 05s
[vcs 2020-10-21T20:29:49.821Z] updating [=============================================> ] 84900/95374 04s
[vcs 2020-10-21T20:29:50.827Z] updating [==============================================> ] 87700/95374 03s
[vcs 2020-10-21T20:29:51.879Z] updating [================================================> ] 90500/95374 02s
[vcs 2020-10-21T20:30:08.998Z] updating [=================================================> ] 93300/95374 01s
[vcs 2020-10-21T20:30:11.287Z]
[vcs 2020-10-21T20:30:11.287Z] 95374 files updated, 0 files merged, 0 files removed, 0 files unresolved
[vcs 2020-10-21T20:30:11.429Z] updated to c061dfcf1598aece0fe343783b351d0a280bf67d
[vcs 2020-10-21T20:30:11.745Z] TinderboxPrint:<a href=https://hg.mozilla.org/integration/autoland/rev/c061dfcf1598aece0fe343783b351d0a280bf67d title='Built from autoland revision c061dfcf1598aece0fe343783b351d0a280bf67d'>c061dfcf1598aece0fe343783b351d0a280bf67d</a>
[setup 2020-10-21T20:30:11.745Z] GECKO_PATH is /Users/cltbld/tasks/task_1603309259/checkouts/gecko
[setup 2020-10-21T20:30:11.745Z] MOZ_FETCHES_DIR is /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr
[fetches 2020-10-21T20:30:11.745Z] fetching artifacts
[fetches 2020-10-21T20:30:11.746Z] executing ['/usr/local/bin/python3', '-u', '/Users/cltbld/tasks/task_1603309259/checkouts/gecko/taskcluster/scripts/misc/fetch-content', 'task-artifacts']
[fetches 2020-10-21T20:30:11.931Z] attempt 1/5
[fetches 2020-10-21T20:30:11.931Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EKf5rFUbTPCuIytcuQAPmQ/artifacts/public/build/cargo-test-binaries.tar.bz2 to /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr/cargo-test-binaries.tar.bz2
[fetches 2020-10-21T20:30:11.931Z] Downloading https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EKf5rFUbTPCuIytcuQAPmQ/artifacts/public/build/cargo-test-binaries.tar.bz2
[fetches 2020-10-21T20:30:11.931Z] /Users/cltbld/tasks/task_1603309259/checkouts/gecko/taskcluster/scripts/misc/fetch-content:180: DeprecationWarning: cafile, capath and cadefault are deprecated, use a custom context instead.
[fetches 2020-10-21T20:30:11.931Z] with urllib.request.urlopen(url, cafile=certifi.where()) if certifi else urllib.request.urlopen(url) as fh:
[fetches 2020-10-21T20:30:12.425Z] https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/EKf5rFUbTPCuIytcuQAPmQ/artifacts/public/build/cargo-test-binaries.tar.bz2 resolved to 46 bytes with sha256 f4fad25a0e7a451ed906b76846efd6d2699a65b40795b29553addc35bf9a75c8 in 0.494s
[fetches 2020-10-21T20:30:12.426Z] Extracting /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr/cargo-test-binaries.tar.bz2 to /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr
[fetches 2020-10-21T20:30:12.435Z] /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr/cargo-test-binaries.tar.bz2 extracted in 0.008s
[fetches 2020-10-21T20:30:12.435Z] Removing /Users/cltbld/tasks/task_1603309259/checkouts/gecko/gfx/wr/cargo-test-binaries.tar.bz2
[fetches 2020-10-21T20:30:12.435Z] PERFHERDER_DATA: {"framework": {"name": "build_metrics"}, "suites": [{"name": "fetch_content", "value": 0.506511414, "lowerIsBetter": true, "shouldAlert": false, "subtests": []}]}
[fetches 2020-10-21T20:30:12.452Z] finished fetching artifacts
[task 2020-10-21T20:30:12.452Z] executing ['bash', '-cx', 'mv cargo-test-binaries target && cd target && for i in debug/
; do $i; done']in checkouts/gecko/gfx/wr
[task 2020-10-21T20:30:12.455Z] + mv cargo-test-binaries target
[task 2020-10-21T20:30:12.458Z] mv: rename cargo-test-binaries to target: No such file or directory
[taskcluster 2020-10-21T20:30:12.469Z] Exit Code: 1
[taskcluster 2020-10-21T20:30:12.469Z] User Time: 2m7.295289s
[taskcluster 2020-10-21T20:30:12.469Z] Kernel Time: 1m26.270771s
[taskcluster 2020-10-21T20:30:12.469Z] Wall Time: 2m12.639565672s
[taskcluster 2020-10-21T20:30:12.469Z] Result: FAILED
[taskcluster 2020-10-21T20:30:12.469Z] === Task Finished ===
[taskcluster 2020-10-21T20:30:12.469Z] Task Duration: 2m12.643309107s
[taskcluster 2020-10-21T20:30:12.469Z] [mounts] Preserving cache: Moving "/Users/cltbld/tasks/task_1603309259/checkouts" to "/Users/cltbld/caches/OkJwFdttQkuMOpy6WvzfcA"
[taskcluster:error] exit status 1

Summary: Intermittent [taskcluster:error] exit status 1 → Perma cargotest [taskcluster:error] exit status 1

As of cargo 1.44.0, the test binaries are not copied into
target/$target/debug, but they are in target/$target/debug/deps (they
were there too before). Cargo test runs the tests from there now
instead, so change the scripts accordingly.

Assignee: nobody → mh+mozilla
Status: NEW → ASSIGNED
Pushed by rmaries@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/e2de1a6179aa Get wrench cargo tests from the deps subdirectory. r=kats
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → 84 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: