Closed Bug 1838742 Opened 1 year ago Closed 1 year ago

`web-platform-tests` jobs should not run WebGPU's WPT tests (for now)

Categories

(Testing :: web-platform-tests, defect, P1)

Product:
Testing
Component:
web-platform-tests
Type:
defect

Tracking

(firefox-esr102 unaffected, firefox-esr115 wontfix, firefox114 wontfix, firefox115 wontfix, firefox116 fixed)

Status:
RESOLVED FIXED
Milestone:
116 Branch
Tracking Flags:
Tracking Status
firefox-esr102 --- unaffected
firefox-esr115 --- wontfix
firefox114 --- wontfix
firefox115 --- wontfix
firefox116 --- fixed

People

(Reporter: ErichDonGubler, Assigned: ErichDonGubler)

References

(Regression)

Details

(Keywords: regression)

Attachments

(3 files)

Bug 1838742: feat(wpt): add `--exclude-tag` r=jgraham
(deleted), text/x-phabricator-request
Details
Bug 1838742: test(wpt): use `--exclude-tag=webgpu` instead of `--exclude=…` for `web-platform-tests` r?#webgpu-reviewers r=jgraham
(deleted), text/x-phabricator-request
Details
Bug 1838742: test(wpt): add commentary as ctx. for tag filter tests r=jgraham
(deleted), text/x-phabricator-request
Details

Bug 1829715 attempted to move WebGPU's WPT tests (i.e., webgpu tasks in TreeHerder like these) to its own set of CI jobs. However, I've discovered that it did not succeed in its intent to stop WebGPU's WPT tests from running in the main body of WPT tests. I have confirmed with :jgraham that this is because WPT currently does not have the filtering power to eliminate --includes more specific than --excludes; CI's decision task bakes several inclusions as positional arguments to the WPT runner when orchestrating chunked web-platform-tests tasks. 😭

We need to stop running WebGPU tests in the main web-platform-tests. In addition to duplicating work scoped to WebGPU WPT jobs, the WebGPU team will start using an environment with higher different hardware/software requirements in order to unblock work to bring WebGPU's compliance up to spec. See also dependencies of webgpu-v1-cts-blockers.

Set release status flags based on info from the regressing bug 1829715

status-firefox114: --- → affected
status-firefox115: --- → affected
status-firefox116: --- → affected
status-firefox-esr102: --- → unaffected
Attachment #9339421 - Attachment description: WIP: Bug 1838742: feat(wpt): add `--exclude-tag` r=jgraham → Bug 1838742: feat(wpt): add `--exclude-tag` r=jgraham
Pushed by egubler@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/492197502967
test(wpt): add commentary as ctx. for tag filter tests r=jgraham
https://hg.mozilla.org/integration/autoland/rev/215562ff5dac
feat(wpt): add `--exclude-tag` r=jgraham
https://hg.mozilla.org/integration/autoland/rev/b63c85346aa0
test(wpt): use `--exclude-tag=webgpu` instead of `--exclude=…` for `web-platform-tests` r=jgraham
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/40646 for changes under testing/web-platform/tests
Priority: -- → P1

https://hg.mozilla.org/mozilla-central/rev/492197502967
https://hg.mozilla.org/mozilla-central/rev/215562ff5dac
https://hg.mozilla.org/mozilla-central/rev/b63c85346aa0

Status: ASSIGNED → RESOLVED
Closed: 1 year ago
status-firefox116: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 116 Branch

Set release status flags based on info from the regressing bug 1829715

status-firefox-esr115: --- → affected
Upstream PR merged by moz-wptsync-bot
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/55b8e9879db7
[wpt PR 40646] - [Gecko Bug 1838742] test(wpt): add commentary as ctx. for tag filter tests, a=testonly

https://hg.mozilla.org/mozilla-central/rev/55b8e9879db7

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: