Closed
Bug 1762776
Opened 3 years ago
Closed 3 years ago
Perma TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/protocol/allow_hosts.py | test_allow_hosts_passed_to_remote_agent[allowed] - assert None is not None when Gecko 100 merges to Beta on 2022-04-04
Categories
(Remote Protocol :: Marionette, defect, P2)
Remote Protocol
Marionette
Tracking
(firefox-esr91 unaffected, firefox98 unaffected, firefox99 unaffected, firefox100+ fixed, firefox101 verified)
VERIFIED
FIXED
101 Branch
| Tracking | Status | |
|---|---|---|
| firefox-esr91 | --- | unaffected |
| firefox98 | --- | unaffected |
| firefox99 | --- | unaffected |
| firefox100 | + | fixed |
| firefox101 | --- | verified |
People
(Reporter: ctuns, Assigned: whimboo)
References
(Regression)
Details
(Keywords: intermittent-failure, regression, Whiteboard: [bidi-m3-mvp])
Attachments
(1 file)
|
(deleted),
text/x-phabricator-request
|
Details |
[Tracking Requested - why for this release]:
Central-as-beta simulation:
How to run these simulations:
Failure log
[task 2022-04-03T11:26:05.143Z] 11:26:05 INFO - TEST-PASS | /_mozilla/webdriver/protocol/allow_hosts.py | test_allow_hosts[allow_hosts4-localhost-server_port-500]
[task 2022-04-03T11:26:05.143Z] 11:26:05 INFO - TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/protocol/allow_hosts.py | test_allow_hosts_passed_to_remote_agent[allowed] - assert None is not None
[task 2022-04-03T11:26:05.143Z] 11:26:05 INFO - configuration = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile', '/tmp/tmpd0zjmow3.mozrunner'], 'binary': '/builds/worke...}}, 'host': '127.0.0.1', 'port': 53344, 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.144Z] 11:26:05 INFO - geckodriver = <function geckodriver.<locals>._geckodriver at 0x7f3cf4b06f28>
[task 2022-04-03T11:26:05.144Z] 11:26:05 INFO - allow_hosts = ['mozilla.org', 'testhost'], hostname = 'testhost', status = 101
[task 2022-04-03T11:26:05.144Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.144Z] 11:26:05 INFO - @pytest.mark.parametrize(
[task 2022-04-03T11:26:05.144Z] 11:26:05 INFO - "allow_hosts, hostname, status",
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - [
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - (["mozilla.org", "testhost"], "testhost", 101),
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - (["mozilla.org"], "testhost", 400),
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - ],
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - ids=["allowed", "not allowed"],
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - )
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - def test_allow_hosts_passed_to_remote_agent(
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - configuration, geckodriver, allow_hosts, hostname, status
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - ):
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - config = deepcopy(configuration)
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - config["capabilities"]["webSocketUrl"] = True
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.145Z] 11:26:05 INFO - extra_args = ["--allow-hosts"] + allow_hosts
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - driver = geckodriver(config=config, extra_args=extra_args)
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - driver.new_session()
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - > host = get_host("default_port", hostname, driver.remote_agent_port)
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - allow_hosts = ['mozilla.org', 'testhost']
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - config = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile',
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - '/tmp/tmpd0zjmow3.mozrunner'],
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - 'binary': '/builds/worker/workspace/build/application/firefox/firefox'},
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - 'webSocketUrl': True},
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - 'host': '127.0.0.1',
[task 2022-04-03T11:26:05.146Z] 11:26:05 INFO - 'port': 53344,
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - configuration = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile',
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - '/tmp/tmpd0zjmow3.mozrunner'],
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - 'binary': '/builds/worker/workspace/build/application/firefox/firefox'}},
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - 'host': '127.0.0.1',
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - 'port': 53344,
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - driver = <support.fixtures.Geckodriver object at 0x7f3ce259dac8>
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - extra_args = ['--allow-hosts', 'mozilla.org', 'testhost']
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - geckodriver = <function geckodriver.<locals>._geckodriver at 0x7f3cf4b06f28>
[task 2022-04-03T11:26:05.147Z] 11:26:05 INFO - hostname = 'testhost'
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - status = 101
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - tests/web-platform/mozilla/tests/webdriver/protocol/allow_hosts.py:50:
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - self = <support.fixtures.Geckodriver object at 0x7f3ce259dac8>
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - @property
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - def remote_agent_port(self):
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - webSocketUrl = self.session.capabilities.get("webSocketUrl")
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - > assert webSocketUrl is not None
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO - E assert None is not None
[task 2022-04-03T11:26:05.148Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.149Z] 11:26:05 INFO - self = <support.fixtures.Geckodriver object at 0x7f3ce259dac8>
[task 2022-04-03T11:26:05.149Z] 11:26:05 INFO - webSocketUrl = None
[task 2022-04-03T11:26:05.149Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.149Z] 11:26:05 INFO - tests/web-platform/mozilla/tests/webdriver/support/fixtures.py:140: AssertionError
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/protocol/allow_hosts.py | test_allow_hosts_passed_to_remote_agent[not allowed] - assert None is not None
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - configuration = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile', '/tmp/tmpd0zjmow3.mozrunner'], 'binary': '/builds/worke...}}, 'host': '127.0.0.1', 'port': 53344, 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - geckodriver = <function geckodriver.<locals>._geckodriver at 0x7f3ce1124400>
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - allow_hosts = ['mozilla.org'], hostname = 'testhost', status = 400
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - @pytest.mark.parametrize(
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - "allow_hosts, hostname, status",
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - [
[task 2022-04-03T11:26:05.151Z] 11:26:05 INFO - (["mozilla.org", "testhost"], "testhost", 101),
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - (["mozilla.org"], "testhost", 400),
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - ],
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - ids=["allowed", "not allowed"],
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - )
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - def test_allow_hosts_passed_to_remote_agent(
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - configuration, geckodriver, allow_hosts, hostname, status
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - ):
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - config = deepcopy(configuration)
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - config["capabilities"]["webSocketUrl"] = True
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - extra_args = ["--allow-hosts"] + allow_hosts
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - driver = geckodriver(config=config, extra_args=extra_args)
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO - driver.new_session()
[task 2022-04-03T11:26:05.152Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - > host = get_host("default_port", hostname, driver.remote_agent_port)
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - allow_hosts = ['mozilla.org']
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - config = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile',
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - '/tmp/tmpd0zjmow3.mozrunner'],
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'binary': '/builds/worker/workspace/build/application/firefox/firefox'},
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'webSocketUrl': True},
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'host': '127.0.0.1',
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'port': 53344,
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - configuration = {'capabilities': {'moz:firefoxOptions': {'args': ['--profile',
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - '/tmp/tmpd0zjmow3.mozrunner'],
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'binary': '/builds/worker/workspace/build/application/firefox/firefox'}},
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'host': '127.0.0.1',
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'port': 53344,
[task 2022-04-03T11:26:05.153Z] 11:26:05 INFO - 'webdriver': {'args': ['-vv'], 'binary': '/builds/worker/fetches/geckodriver'}}
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - driver = <support.fixtures.Geckodriver object at 0x7f3ce259d320>
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - extra_args = ['--allow-hosts', 'mozilla.org']
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - geckodriver = <function geckodriver.<locals>._geckodriver at 0x7f3ce1124400>
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - hostname = 'testhost'
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - status = 400
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - tests/web-platform/mozilla/tests/webdriver/protocol/allow_hosts.py:50:
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - self = <support.fixtures.Geckodriver object at 0x7f3ce259d320>
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - @property
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - def remote_agent_port(self):
[task 2022-04-03T11:26:05.154Z] 11:26:05 INFO - webSocketUrl = self.session.capabilities.get("webSocketUrl")
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - > assert webSocketUrl is not None
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - E assert None is not None
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - self = <support.fixtures.Geckodriver object at 0x7f3ce259d320>
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - webSocketUrl = None
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO -
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - tests/web-platform/mozilla/tests/webdriver/support/fixtures.py:140: AssertionError
[task 2022-04-03T11:26:05.155Z] 11:26:05 INFO - TEST-OK | /_mozilla/webdriver/protocol/allow_hosts.py | took 13459ms
[task 2022-04-03T11:26:05.156Z] 11:26:05 INFO - PID 2064 | 1648985165109 webdriver::server DEBUG -> GET /status
[task 2022-04-03T11:26:05.157Z] 11:26:05 INFO - PID 2064 | 1648985165109 webdriver::server DEBUG <- 200 OK {"value":{"message":"","ready":true}}
[task 2022-04-03T11:26:05.173Z] 11:26:05 INFO - Closing logging queue
[task 2022-04-03T11:26:05.174Z] 11:26:05 INFO - queue closed
[task 2022-04-03T11:26:05.184Z] 11:26:05 INFO - PID 2628 | 1648985165182 geckodriver INFO Listening on 127.0.0.1:53344
[task 2022-04-03T11:26:05.184Z] 11:26:05 INFO - Starting runner
[task 2022-04-03T11:26:05.403Z] 11:26:05 INFO - TEST-START | /_mozilla/webdriver/protocol/allow_origins.py
Hello Whimboo, I think this might be caused by this push (Bug 1761436 or Bug 1759994). Can you please take a look?
Flags: needinfo?(hskupin)
|
||
Updated•3 years ago
|
| Comment hidden (Intermittent Failures Robot) |
|
Assignee | |
Comment 2•3 years ago
|
||
Nah, please not again. We forgot to set the right meta data for that updated test file. :( Coming up with a patch in a moment.
Flags: needinfo?(hskupin)
|
|
Assignee | |
Updated•3 years ago
|
Component: General → geckodriver
|
|
Assignee | |
Comment 3•3 years ago
|
||
|
||
Updated•3 years ago
|
Assignee: nobody → hskupin
Status: NEW → ASSIGNED
Pushed by hskupin@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/b9abcba32c70
[wdspec] Add missing meta data for expected failures in allow_hosts.py and allow_origins.py r=webdriver-reviewers,jdescottes
|
||
Updated•3 years ago
|
Has Regression Range: --- → yes
|
|
Assignee | |
Updated•3 years ago
|
Severity: -- → S3
Points: --- → 1
Priority: -- → P5
Whiteboard: [bidi-m3-mvp]
|
||
Comment 5•3 years ago
|
||
The patch seems to be working as of today's central as beta sim
|
|
||
Comment 6•3 years ago
|
||
| bugherder uplift | ||
|
||
Comment 7•3 years ago
|
||
| bugherder | ||
Status: ASSIGNED → RESOLVED
Closed: 3 years ago
status-firefox101:
--- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 101 Branch
|
||
Updated•3 years ago
|
Priority: P5 → P2
|
||
Comment 8•3 years ago
|
||
Verified fixed in latest beta sim: https://treeherder.mozilla.org/jobs?repo=try&group_state=expanded&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=0df18cb35437bec6cbc96e7ea53932b4c496d807&searchStr=wd
Status: RESOLVED → VERIFIED
| Comment hidden (Intermittent Failures Robot) |
|
|
Assignee | |
Updated•3 years ago
|
Keywords: intermittent-failure
|
||
Comment 10•2 years ago
|
||
Moving bug to Remote Protocol::Marionette component per bug 1815831.
Component: geckodriver → Marionette
Product: Testing → Remote Protocol
You need to log in
before you can comment on or make changes to this bug.
Description
•