Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Description

•

2 years ago

Sync web-platform-tests PR 34803 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/34803
Details from upstream follow.

Add resultOwnership tests for script.evaluate

Added tests for resultOwnership parameter of script.evaluate: script/evaluate/result_ownership.py

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

2 years ago

Component: web-platform-tests → geckodriver

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

2 years ago

Whiteboard: [wptsync downstream] → [wptsync downstream error]

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Comment 1

•

2 years ago

PR 34803 applied with additional changes from upstream: 0453b5346e43e6cd6d7a1c0ba05a7607536ff1b7, 114e6d13139eb06dd4f899b185cb715ed2d84ba9

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

2 years ago

Whiteboard: [wptsync downstream error] → [wptsync downstream]

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Comment 2

•

2 years ago

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=9bc2856e984036dde5bd8ad9fde406f775f0261f

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Comment 3

•

2 years ago

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 10 tests and 15 subtests

Status Summary

Firefox

OK : 10
PASS : 137[GitHub] 144[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt]
FAIL : 46[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] 85[GitHub]

Chrome

TIMEOUT: 10

Safari

OK : 10
ERROR : 222

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

/webdriver/tests/bidi/script/call_function/call_function.py [wpt.fyi]
- test_invalid_function: FAIL (Safari: ERROR)
- test_arguments: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_this: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_default_this: FAIL (Safari: ERROR)
- test_remote_value_argument: FAIL (Safari: ERROR)
- test_async_arrow_await_promise[False]: FAIL (Safari: ERROR)
- test_async_classic_await_promise[False]: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/call_function/invalid.py [wpt.fyi]
- test_params_realm_unknown: FAIL (Safari: ERROR)
- test_params_this_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_this_invalid_type[SOME_STRING]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_this_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_this_invalid_type[this3]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_this_invalid_type[this4]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_single_argument_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_single_argument_invalid_type[SOME_STRING]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_single_argument_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_single_argument_invalid_type[argument3]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
- test_params_single_argument_invalid_type[argument4]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-2004-qr-debug, Gecko-windows10-32-2004-qr-opt, Gecko-windows10-64-2004-qr-debug, Gecko-windows10-64-2004-qr-opt] (Safari: ERROR)
/webdriver/tests/bidi/script/call_function/result.py [wpt.fyi]
- test_primitive_values[Infinity-expected6]: FAIL (Safari: ERROR)
- test_remote_values[(Symbol('foo'))-expected0]: FAIL (Safari: ERROR)
- test_remote_values[({'foo': {'bar': 'baz'}, 'qux': 'quux'})-expected2]: FAIL (Safari: ERROR)
- test_remote_values[(()=>{})-expected3]: FAIL (Safari: ERROR)
- test_remote_values[(function(){})-expected4]: FAIL (Safari: ERROR)
- test_remote_values[(async ()=>{})-expected5]: FAIL (Safari: ERROR)
- test_remote_values[(async function(){})-expected6]: FAIL (Safari: ERROR)
- test_remote_values[new WeakMap()-expected11]: FAIL (Safari: ERROR)
- test_remote_values[new WeakSet()-expected12]: FAIL (Safari: ERROR)
- test_remote_values[new Error('SOME_ERROR_TEXT')-expected13]: FAIL (Safari: ERROR)
- test_remote_values[Promise.resolve()-expected14]: FAIL (Safari: ERROR)
- test_remote_values[new Int32Array()-expected15]: FAIL (Safari: ERROR)
- test_remote_values[new ArrayBuffer()-expected16]: FAIL (Safari: ERROR)
- test_remote_values[document.createElement('div')-expected17]: FAIL (Safari: ERROR)
- test_remote_values[window-expected18]: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/call_function/result_ownership.py [wpt.fyi]
- test_throw_exception[root-True]: FAIL (Safari: ERROR)
- test_throw_exception[none-False]: FAIL (Safari: ERROR)
- test_throw_exception[None-False]: FAIL (Safari: ERROR)
- test_invalid_script[root-True]: FAIL (Safari: ERROR)
- test_invalid_script[none-False]: FAIL (Safari: ERROR)
- test_invalid_script[None-False]: FAIL (Safari: ERROR)
- test_rejected_promise[root-True]: FAIL (Safari: ERROR)
- test_rejected_promise[none-False]: FAIL (Safari: ERROR)
- test_rejected_promise[None-False]: FAIL (Safari: ERROR)
- test_return_value[root-True-True]: FAIL (Safari: ERROR)
- test_return_value[root-True-False]: FAIL (Safari: ERROR)
- test_return_value[none-False-True]: FAIL (Safari: ERROR)
- test_return_value[none-False-False]: FAIL (Safari: ERROR)
- test_return_value[None-False-True]: FAIL (Safari: ERROR)
- test_return_value[None-False-False]: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/evaluate/await_promise.py [wpt.fyi]
- test_await_resolve_primitive[Infinity-Infinity-number]: FAIL (Safari: ERROR)
- test_no_await_promise_rejected: FAIL (Safari: ERROR)
- test_no_await_promise_resolved: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/evaluate/exception_details.py [wpt.fyi]
- test_invalid_script: FAIL (Safari: ERROR)
- test_reject_error: FAIL (Safari: ERROR)
- test_throw_error: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/evaluate/invalid.py [wpt.fyi]
- test_params_realm_unknown: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/evaluate/result.py [wpt.fyi]
- test_primitive_values[Infinity-expected6]: FAIL (Safari: ERROR)
- test_remote_values[object]: FAIL
- test_remote_values[(Symbol('foo'))-expected0]: FAIL (Safari: ERROR)
- test_remote_values[({'foo': {'bar': 'baz'}, 'qux': 'quux'})-expected2]: FAIL (Safari: ERROR)
- test_remote_values[(()=>{})-expected3]: FAIL (Safari: ERROR)
- test_remote_values[(function(){})-expected4]: FAIL (Safari: ERROR)
- test_remote_values[(async ()=>{})-expected5]: FAIL (Safari: ERROR)
- test_remote_values[(async function(){})-expected6]: FAIL (Safari: ERROR)
- test_remote_values[new WeakMap()-expected11]: FAIL (Safari: ERROR)
- test_remote_values[new WeakSet()-expected12]: FAIL (Safari: ERROR)
- test_remote_values[new Error('SOME_ERROR_TEXT')-expected13]: FAIL (Safari: ERROR)
- test_remote_values[Promise.resolve()-expected14]: FAIL (Safari: ERROR)
- test_remote_values[new Int32Array()-expected15]: FAIL (Safari: ERROR)
- test_remote_values[new ArrayBuffer()-expected16]: FAIL (Safari: ERROR)
- test_remote_values[document.createElement('div')-expected17]: FAIL (Safari: ERROR)
- test_remote_values[window-expected18]: FAIL (Safari: ERROR)
/webdriver/tests/bidi/script/evaluate/result_ownership.py [wpt.fyi]
- test_throw_exception[root-True]: FAIL (Safari: ERROR)
- test_throw_exception[none-False]: FAIL (Safari: ERROR)
- test_throw_exception[None-False]: FAIL (Safari: ERROR)
- test_invalid_script[root-True]: FAIL (Safari: ERROR)
- test_invalid_script[none-False]: FAIL (Safari: ERROR)
- test_invalid_script[None-False]: FAIL (Safari: ERROR)
- test_rejected_promise[root-True]: FAIL (Safari: ERROR)
- test_rejected_promise[none-False]: FAIL (Safari: ERROR)
- test_rejected_promise[None-False]: FAIL (Safari: ERROR)
- test_return_value[root-True-True]: FAIL (Safari: ERROR)
- test_return_value[root-True-False]: FAIL (Safari: ERROR)
- test_return_value[none-False-True]: FAIL (Safari: ERROR)
- test_return_value[none-False-False]: FAIL (Safari: ERROR)
- test_return_value[None-False-True]: FAIL (Safari: ERROR)
- test_return_value[None-False-False]: FAIL (Safari: ERROR)

Web Platform Test Sync Bot (Matrix: #interop:mozilla.org)

Assignee

Updated

•

2 years ago

Depends on: 1780373

Pulsebot

Comment 4

•

2 years ago

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/e66a5be46f58 [wpt PR 34803] - Add `resultOwnership` tests for `script.evaluate`, a=testonly https://hg.mozilla.org/integration/autoland/rev/341f20140e72 [wpt PR 34803] - Update wpt metadata, a=testonly

Marian-Vasile Laza

Comment 5

•

2 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/e66a5be46f58
https://hg.mozilla.org/mozilla-central/rev/341f20140e72

Status: NEW → RESOLVED

Closed: 2 years ago

status-firefox104: --- → fixed

Resolution: --- → FIXED

Target Milestone: --- → 104 Branch

Henrik Skupin [:whimboo][⌚️UTC+2]

Updated

•

2 years ago

Blocks: 1783820

Bugzilla

[wpt-sync] Sync PR 34803 - Add `resultOwnership` tests for `script.evaluate`

Categories

(Testing :: geckodriver, task, P4)

Tracking

(firefox104 fixed)

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Crash Data

Security

(public)

User Story

Description

Updated

Updated

Comment 1

Updated

Comment 2

Comment 3

CI Results

Status Summary

Firefox

Chrome

Safari

Links

Details

New Tests That Don't Pass

Updated

Comment 4

Comment 5

Updated