Closed Bug 1678044 Opened 4 years ago Closed 3 years ago

wdspec tests don't honour the --enable-webrender (and lack thereof) switch in automation

Categories

(Testing :: web-platform-tests, defect, P3)

defect

Tracking

(Fission Milestone:M8, firefox90 fixed)

RESOLVED FIXED
90 Branch
Fission Milestone M8
Tracking Status
firefox90 --- fixed

People

(Reporter: aosmond, Assigned: jgraham)

References

(Blocks 1 open bug)

Details

Attachments

(6 files, 1 obsolete file)

No description provided.

Hopefully this doesn't cause any failures in wdspec tests:

try: https://treeherder.mozilla.org/#/jobs?repo=try&revision=1034e3a0e81589a0f9619051269ca5d15bedc1d9

Blocks: 1677293

wdspec launches Firefox using geckodriver. This was going through a
different codepath to the other wpt tests and in particular it wasn't
setting the correct environment variables.

This patch factors the environment variable setting out into a
function that can be called both when starting Firefox normally and
before invoking pytest. This isn't perfect, but does allow more code
sharing between the two paths.

Attachment #9188593 - Attachment is obsolete: true
Assignee: aosmond → james
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/c4756cf7f5f1
Ensure we set environment variables when running wdspec tests, r=maja_zf
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/26572 for changes under testing/web-platform/tests

I'm still seeing the issue with wdspec tests:

https://treeherder.mozilla.org/jobs?repo=try&revision=5fcbc4c7121894133f09f9945e5af8c6745046e1&selectedTaskRun=KDrcrnd8Sd-MbDDHOBuXzQ.0&searchStr=Linux%2C18.04%2Cx64%2CWebRender%2Copt%2CWeb%2Cplatform%2Ctests%2Ctest-linux1804-64-qr%2Fopt-web-platform-tests-wdspec-e10s%2CWd1

I added logs:

[task 2020-11-19T16:15:41.680Z] 16:15:41 INFO - PID 911 | [AO] wr=1 sw_wr=1; ee=0 ed=0 ps=0

which show MOZ_WEBRENDER=1 wasn't set (ee=0).

Flags: needinfo?(james)

The previous patch set the variables too late, after the webdriver server was already
started. Pass them down into the server startup code instead

Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → 85 Branch

This ensures that we always pass a profile in the capabilitites. When
we're running with a single process it simply unpacks the profile to a
temporary folder and passes in that path as a firefox argument. When
we're running with multiple processes, that won't work. We could
invent a mechanism to get one profile per process, but for simplicity
we instead pass in the profile as a base64-encoded string.

This bug is fixed. James, should all these revisions actually be part of bug 1680963?

As mentioned by James this bug isn't fixed. So lets reopen. It will also block bug 1680963.

Blocks: 1680963
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Target Milestone: 85 Branch → ---
Status: REOPENED → ASSIGNED
Component: Graphics: WebRender → web-platform-tests
Product: Core → Testing

try: https://treeherder.mozilla.org/jobs?repo=try&selectedTaskRun=K57ozD7uSdKjbm1LB_mynA.0&revision=0d9368f856f1f0a709e8560156891b6baffa19f1

The debug prints show we aren't getting the MOZ_WEBRENDER envvar set in the qr and non-qr variations.

Upstream PR was closed without merging
Upstream PR merged by jgraham
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0e5887add977
[wpt PR 26572] - [Gecko Bug 1678044] Ensure we set environment variables when running wdspec tests, a=testonly
Flags: needinfo?(james)
Keywords: leave-open
Blocks: 1682180
Depends on: 1686707

This requires passing the test_environment into the get_executor_kwargs function
so that in the firefox wdspec case we can add a cleanup function to the environment
when running wdspec tests. That seems reasonable since we were previously using
a variety of data in the environment to setup the kwargs anyway

Otherwise it seems to interfere with the rest of the test.

Blocks: 1686946
Attachment #9193080 - Attachment description: Bug 1678044 - Fix disabling location services for geckodriver, → Bug 1678044 - Fix disabling location services and new tab for geckodriver,

Setting Fission Milestone to M8 because this bug blocks Fission M8 bug 1680963.

Fission Milestone: --- → M8
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/659084e40ec2
Fix setting environment variables for wdspec tests, r=maja_zf,marionette-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/c5914548a084
Use correct profile for wdspec tests, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/43cf7957ed78
Fix disabling location services and new tab for geckodriver, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/708bdb00db84
Switch to explicit profile cleanup rather than using __del__, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/2f91386cca8e
Unmaximize window before starting a new session, r=webdriver-reviewers,whimboo
Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/28640 for changes under testing/web-platform/tests
Upstream PR was closed without merging

Backout changeset for causing marionette failures at test_fission_autostart.py .

Push with failures

Failure log

also failes here python/test_mochitest_integration.py
Failure log

Backout link

Flags: needinfo?(james)
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/d5f5359358fd
Fix setting environment variables for wdspec tests, r=maja_zf,marionette-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/0eeb2f149770
Use correct profile for wdspec tests, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/6aeb03df54bb
Fix disabling location services and new tab for geckodriver, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/5281b7443a89
Switch to explicit profile cleanup rather than using __del__, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/023e75831c48
Unmaximize window before starting a new session, r=webdriver-reviewers,whimboo
Pushed by james@hoppipolla.co.uk:
https://hg.mozilla.org/integration/autoland/rev/222c0fda8126
Fix setting environment variables for wdspec tests, r=maja_zf,marionette-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/6dc4d87d1b65
Use correct profile for wdspec tests, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/1f77f1f4241f
Fix disabling location services and new tab for geckodriver, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/0a5ac7d40966
Switch to explicit profile cleanup rather than using __del__, r=webdriver-reviewers,whimboo
https://hg.mozilla.org/integration/autoland/rev/98347e378726
Unmaximize window before starting a new session, r=webdriver-reviewers,whimboo
Upstream PR merged by jgraham

James, I think that we can close this bug now, right? If not please reopen.

Status: ASSIGNED → RESOLVED
Closed: 4 years ago3 years ago
Flags: needinfo?(james)
Keywords: leave-open
Resolution: --- → FIXED
Target Milestone: --- → 90 Branch
Regressions: 1712907
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/394dc041d6f5
[wpt PR 28640] - [Gecko Bug 1678044] Fix setting environment variables for wdspec tests, a=testonly
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5257b1387889
[wpt PR 28640] - [Gecko Bug 1678044] Fix setting environment variables for wdspec tests, a=testonly
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/2b2ea8650148
[wpt PR 28640] - [Gecko Bug 1678044] Fix setting environment variables for wdspec tests, a=testonly
No longer regressions: 1849972
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: