Closed Bug 1631112 Opened 5 years ago Closed 5 years ago

Intermittent testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py <random> | AssertionError: UnexpectedAlertOpen not raised

Categories

(Testing :: Marionette Client and Harness, defect, P5)

Version 3
defect

Tracking

(firefox77 wontfix, firefox78 fixed)

RESOLVED FIXED
mozilla78
Tracking Status
firefox77 --- wontfix
firefox78 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: pbz)

References

Details

(Keywords: intermittent-failure)

Filed by: malexandru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=298145397&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WKzsXB4CRmyMD7mWBBmXxw/runs/0/artifacts/public/logs/live_backing.log


[task 2020-04-17T19:37:17.300Z] 19:37:17     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py TestUnhandledPromptBehavior.test_ignore_confirm
[task 2020-04-17T19:37:17.302Z] 19:37:17     INFO -  1587152237300	Marionette	DEBUG	Closed connection 64
[task 2020-04-17T19:37:17.302Z] 19:37:17     INFO -  1587152237301	Marionette	DEBUG	Accepted connection 65 from 127.0.0.1:52958
[task 2020-04-17T19:37:17.304Z] 19:37:17     INFO -  1587152237302	Marionette	DEBUG	65 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
[task 2020-04-17T19:37:17.304Z] 19:37:17     INFO -  1587152237303	Marionette	TRACE	[4] Frame script loaded
[task 2020-04-17T19:37:17.306Z] 19:37:17     INFO -  1587152237304	Marionette	TRACE	[4] Frame script registered
[task 2020-04-17T19:37:17.306Z] 19:37:17     INFO -  1587152237305	Marionette	DEBUG	65 <- [1,1,null,{"sessionId":"89cd8ab3-4c19-4ae6-9da6-0dfd6266bf36","capabilities":{"browserName":"firefox","browserVersion":"77.0a ... p\\tmpwuznwy.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true}}]
[task 2020-04-17T19:37:17.308Z] 19:37:17     INFO -  1587152237306	Marionette	DEBUG	65 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
[task 2020-04-17T19:37:17.308Z] 19:37:17     INFO -  1587152237306	Marionette	DEBUG	65 <- [1,2,null,{"value":null}]
[task 2020-04-17T19:37:17.308Z] 19:37:17     INFO -  1587152237307	Marionette	DEBUG	65 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
[task 2020-04-17T19:37:17.308Z] 19:37:17     INFO -  1587152237307	Marionette	DEBUG	65 <- [1,3,null,{"value":null}]
[task 2020-04-17T19:37:17.310Z] 19:37:17     INFO -  1587152237308	Marionette	DEBUG	65 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
[task 2020-04-17T19:37:17.310Z] 19:37:17     INFO -  1587152237308	Marionette	DEBUG	65 <- [1,4,null,{"value":null}]
[task 2020-04-17T19:37:17.312Z] 19:37:17     INFO -  1587152237310	Marionette	DEBUG	65 -> [0,5,"WebDriver:DeleteSession",{}]
[task 2020-04-17T19:37:17.312Z] 19:37:17     INFO -  1587152237311	Marionette	DEBUG	65 <- [1,5,null,{"value":null}]
[task 2020-04-17T19:37:17.314Z] 19:37:17     INFO -  1587152237312	Marionette	DEBUG	Closed connection 65
[task 2020-04-17T19:37:17.314Z] 19:37:17     INFO -  1587152237313	Marionette	DEBUG	Accepted connection 66 from 127.0.0.1:52959
[task 2020-04-17T19:37:17.316Z] 19:37:17     INFO -  1587152237314	Marionette	DEBUG	66 -> [0,1,"WebDriver:NewSession",{"unhandledPromptBehavior":"ignore"}]
[task 2020-04-17T19:37:17.318Z] 19:37:17     INFO -  1587152237317	Marionette	TRACE	[4] Frame script loaded
[task 2020-04-17T19:37:17.320Z] 19:37:17     INFO -  1587152237318	Marionette	TRACE	[4] Frame script registered
[task 2020-04-17T19:37:17.320Z] 19:37:17     INFO -  1587152237319	Marionette	DEBUG	66 <- [1,1,null,{"sessionId":"e2c21b69-b707-41f0-9340-4e18feb203f0","capabilities":{"browserName":"firefox","browserVersion":"77.0a ... p\\tmpwuznwy.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true}}]
[task 2020-04-17T19:37:17.322Z] 19:37:17     INFO -  1587152237320	Marionette	DEBUG	66 -> [0,2,"WebDriver:ExecuteAsyncScript",{"scriptTimeout":null,"newSandbox":true,"args":["confirm","foo confirm"],"filename":"Z:\\ ... .return_value = null;\n            window.return_value = window[arguments[0]](arguments[1]);","sandbox":"default","line":45}]
[task 2020-04-17T19:37:17.327Z] 19:37:17     INFO -  1587152237326	Marionette	TRACE	Received observer notification tabmodal-dialog-loaded
[task 2020-04-17T19:37:17.329Z] 19:37:17     INFO -  1587152237326	Marionette	DEBUG	66 <- [1,2,null,{"value":null}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237338	Marionette	TRACE	Received event DOMModalDialogClosed
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237339	Marionette	DEBUG	66 -> [0,3,"WebDriver:GetTitle",{}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  JavaScript error: resource://gre/modules/Prompter.jsm, line 642: NS_ERROR_NOT_AVA1587152237340	Marionette	DEBUG	66 <- [1,3,null,{"value":"Marionette Test"}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  ILABLE: prompt aborted by user
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237341	Marionette	DEBUG	66 -> [0,4,"Marionette:GetContext",{}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237341	Marionette	DEBUG	66 <- [1,4,null,{"value":"content"}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237342	Marionette	DEBUG	66 -> [0,5,"Marionette:SetContext",{"value":"chrome"}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237342	Marionette	DEBUG	66 <- [1,5,null,{"value":null}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  1587152237344	Marionette	DEBUG	66 -> [0,6,"WebDriver:TakeScreenshot",{"full":true,"hash":false,"id":null,"scroll":true}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237397	Marionette	DEBUG	66 <- [1,6,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAQHCAYAAACjlsT7AAAgAElEQVR4nOzdf4zU933n8f2zuvxxp/ujqvrPWUr/QYSrXMmW4ijq8UeVl ... AAAAAAMCYAAQAAAGBMAAIAAADAmAAEAAAAgDEBCAAAAABjAhAAAAAAxgQgAAAAAIwJQAAAAAAYE4AAAAAAMCYAAQAAAGAsl3RBQlM+Ul8AAAAASUVORK5CYII="}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237399	Marionette	DEBUG	66 -> [0,7,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237399	Marionette	DEBUG	66 <- [1,7,null,{"value":null}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237400	Marionette	DEBUG	66 -> [0,8,"Marionette:GetContext",{}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237400	Marionette	DEBUG	66 <- [1,8,null,{"value":"content"}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237401	Marionette	DEBUG	66 -> [0,9,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237401	Marionette	DEBUG	66 <- [1,9,null,{"value":null}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237402	Marionette	DEBUG	66 -> [0,10,"WebDriver:GetPageSource",{}]
[task 2020-04-17T19:37:17.408Z] 19:37:17     INFO -  1587152237404	Marionette	DEBUG	66 <- [1,10,null,{"value":"<html><head>\n<title>Marionette Test</title>\n</head>\n<body>\n\n \n</body></html>"}]
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -  1587152237405	Marionette	DEBUG	66 -> [0,11,"Marionette:SetContext",{"value":"content"}]
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -  1587152237405	Marionette	DEBUG	66 <- [1,11,null,{"value":null}]
[task 2020-04-17T19:37:17.409Z] 19:37:17    ERROR -  TEST-UNEXPECTED-FAIL | testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py TestUnhandledPromptBehavior.test_ignore_confirm | AssertionError: UnexpectedAlertOpen not raised
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -  Traceback (most recent call last):
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -    File "Z:\task_1587150788\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 159, in run
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -      testMethod()
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -    File "Z:\task_1587150788\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 33, in wrapper
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -      return func(self, *args, **kwargs)
[task 2020-04-17T19:37:17.409Z] 19:37:17     INFO -    File "Z:\task_1587150788\build\tests\marionette\tests\testing\marionette\harness\marionette_harness\tests\unit\test_unhandled_prompt_behavior.py", line 103, in test_ignore
[task 2020-04-17T19:37:17.410Z] 19:37:17     INFO -      expected_close=False)
[task 2020-04-17T19:37:17.410Z] 19:37:17     INFO -    File "Z:\task_1587150788\build\tests\marionette\tests\testing\marionette\harness\marionette_harness\tests\unit\test_unhandled_prompt_behavior.py", line 49, in perform_user_prompt_check
[task 2020-04-17T19:37:17.410Z] 19:37:17     INFO -      self.marionette.title
[task 2020-04-17T19:37:17.410Z] 19:37:17     INFO -  TEST-INFO took 106ms
[task 2020-04-17T19:37:17.410Z] 19:37:17     INFO -  1587152237407	Marionette	DEBUG	66 -> [0,12,"WebDriver:DismissAlert",{}]
[task 2020-04-17T19:37:17.411Z] 19:37:17     INFO -  1587152237408	Marionette	DEBUG	66 <- [1,12,{"error":"no such alert","message":"","stacktrace":"WebDriverError@chrome://marionette/content/error.js:175:5\nNoSuchAl ... t@chrome://marionette/content/server.js:249:9\n_onJSONObjectReady/<@chrome://marionette/content/transport.js:501:20\n"},null]
[task 2020-04-17T19:37:17.411Z] 19:37:17     INFO -  1587152237409	Marionette	DEBUG	66 -> [0,13,"WebDriver:DeleteSession",{}]
[task 2020-04-17T19:37:17.411Z] 19:37:17     INFO -  1587152237410	Marionette	DEBUG	66 <- [1,13,null,{"value":null}]
[task 2020-04-17T19:37:17.413Z] 19:37:17     INFO -  TEST-START | testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py TestUnhandledPromptBehavior.test_ignore_prompt

There is the following failure:

[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  JavaScript error: resource://gre/modules/Prompter.jsm, line 642: NS_ERROR_NOT_AVA1587152237340	Marionette	DEBUG	66 <- [1,3,null,{"value":"Marionette Test"}]
[task 2020-04-17T19:37:17.347Z] 19:37:17     INFO -  ILABLE: prompt aborted by user

Looks like a regression from bug 1615588.

Flags: needinfo?(pbz)
Regressed by: 1615588

We track this via bug 1631362 now.

Flags: needinfo?(pbz)
Summary: Intermittent testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py TestUnhandledPromptBehavior.test_ignore_confirm | AssertionError: UnexpectedAlertOpen not raised → Intermittent testing/marionette/harness/marionette_harness/tests/unit/test_unhandled_prompt_behavior.py <random> | AssertionError: UnexpectedAlertOpen not raised
No longer regressed by: 1615588

No more failures since the patch on bug 1631362 got landed.

Assignee: nobody → pbz
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla78
Product: Testing → Remote Protocol
Moving bug to Testing::Marionette Client and Harness component per bug 1815831.
Component: Marionette → Marionette Client and Harness
Product: Remote Protocol → Testing
You need to log in before you can comment on or make changes to this bug.