Closed Bug 1536370 Opened 6 years ago Closed 6 years ago

Intermittent windows/aarch64 testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_additional_capabilities | AssertionError: u'c:\\users\\testdroid\\appdata\\local\\temp\\tmpveypgf.mozrunner' != u'c:\\users\\

Categories

(Testing :: Marionette Client and Harness, defect, P5)

Version 3
ARM64
Windows
defect

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1533221

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

#[markdown(off)]
Filed by: egao [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=233751473&repo=try

https://queue.taskcluster.net/v1/task/YDEqmUBsS6mikaAVnzHWUA/runs/0/artifacts/public/logs/live_backing.log

Test: Mn

Platform: windows10-aarch64

Context:
01:09:22 INFO - TEST-START | testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_additional_capabilities
01:09:22 INFO - 1552525762499 Marionette DEBUG Accepted connection 17 from 127.0.0.1:50048
01:09:22 INFO - 1552525762501 Marionette DEBUG 17 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
01:09:22 INFO - 1552525762503 Marionette TRACE [6442450945] Frame script loaded
01:09:22 INFO - 1552525762504 Marionette TRACE [6442450945] Frame script registered
01:09:22 INFO - 1552525762506 Marionette DEBUG 17 <- [1,1,null,{"sessionId":"4abdb17c-6433-4cff-bbc7-b29324750c90","capabilities":{"browserName":"firefox","browserVersion":"67.0a ... p\\tmpveypgf.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true}}]
01:09:22 INFO - 1552525762508 Marionette DEBUG 17 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
01:09:22 INFO - 1552525762508 Marionette DEBUG 17 <- [1,2,null,{"value":null}]
01:09:22 INFO - 1552525762510 Marionette DEBUG 17 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
01:09:22 INFO - 1552525762510 Marionette DEBUG 17 <- [1,3,null,{"value":null}]
01:09:22 INFO - 1552525762511 Marionette DEBUG 17 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
01:09:22 INFO - 1552525762512 Marionette DEBUG 17 <- [1,4,null,{"value":null}]
01:09:22 INFO - 1552525762514 Marionette DEBUG 17 -> [0,5,"Marionette:GetContext",{}]
01:09:22 INFO - 1552525762515 Marionette DEBUG 17 <- [1,5,null,{"value":"content"}]
01:09:22 INFO - 1552525762516 Marionette DEBUG 17 -> [0,6,"Marionette:SetContext",{"value":"chrome"}]
01:09:22 INFO - 1552525762516 Marionette DEBUG 17 <- [1,6,null,{"value":null}]
01:09:22 INFO - 1552525762520 Marionette DEBUG 17 -> [0,7,"WebDriver:ExecuteScript",{"script":"return {\n name: Services.appinfo.name,\n version ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":24}]
01:09:22 INFO - 1552525762523 Marionette DEBUG 17 <- [1,7,null,{"value":{"name":"Firefox","version":"67.0a1","processID":9112,"buildID":"20190313215841"}}]
01:09:22 INFO - 1552525762527 Marionette DEBUG 17 -> [0,8,"WebDriver:ExecuteScript",{"script":"let name = Services.sysinfo.getProperty(\"name\");\n switch (name) { ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":35}]
01:09:22 INFO - 1552525762529 Marionette DEBUG 17 <- [1,8,null,{"value":"windows"}]
01:09:22 INFO - 1552525762533 Marionette DEBUG 17 -> [0,9,"WebDriver:ExecuteScript",{"script":"return Services.sysinfo.getProperty('version')","newSandbox":true,"args":[],"filena ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":37}]
01:09:22 INFO - 1552525762535 Marionette DEBUG 17 <- [1,9,null,{"value":"10.0"}]
01:09:22 INFO - 1552525762537 Marionette DEBUG 17 -> [0,10,"Marionette:SetContext",{"value":"content"}]
01:09:22 INFO - 1552525762537 Marionette DEBUG 17 <- [1,10,null,{"value":null}]
01:09:22 INFO - 1552525762541 Marionette DEBUG 17 -> [0,11,"Marionette:GetContext",{}]
01:09:22 INFO - 1552525762542 Marionette DEBUG 17 <- [1,11,null,{"value":"content"}]
01:09:22 INFO - 1552525762543 Marionette DEBUG 17 -> [0,12,"Marionette:SetContext",{"value":"chrome"}]
01:09:22 INFO - 1552525762543 Marionette DEBUG 17 <- [1,12,null,{"value":null}]
01:09:22 INFO - 1552525762544 Marionette DEBUG 17 -> [0,13,"WebDriver:TakeScreenshot",{"highlights":null,"full":true,"hash":false,"id":null,"scroll":true}]
01:09:22 INFO - 1552525762612 Marionette DEBUG 17 <- [1,13,null,{"value":"iVBORw0KGgoAAAANSUhEUgAABQAAAAPgCAYAAABtcNFPAAAgAElEQVR4nOzdT2yb953ncR0HO4fd02BuGyDXrdFTDr3Mnlqgc7JgYA6t ... IAAADAmAAEAAAAgDEBCAAAAABjAhAAAAAAxgQgAAAAAIwJQAAAAAAYE4AAAAAAMCYAAQAAAGBMAAIAAADAmAAEAAAAgLEARZiukKsy1WsAAAAASUVORK5CYII="}]
01:09:22 INFO - 1552525762615 Marionette DEBUG 17 -> [0,14,"Marionette:SetContext",{"value":"content"}]
01:09:22 INFO - 1552525762616 Marionette DEBUG 17 <- [1,14,null,{"value":null}]
01:09:22 INFO - 1552525762617 Marionette DEBUG 17 -> [0,15,"Marionette:GetContext",{}]
01:09:22 INFO - 1552525762617 Marionette DEBUG 17 <- [1,15,null,{"value":"content"}]
01:09:22 INFO - 1552525762619 Marionette DEBUG 17 -> [0,16,"Marionette:SetContext",{"value":"content"}]
01:09:22 INFO - 1552525762619 Marionette DEBUG 17 <- [1,16,null,{"value":null}]
01:09:22 INFO - 1552525762622 Marionette DEBUG 17 -> [0,17,"WebDriver:GetPageSource",{}]
01:09:22 INFO - 1552525762626 Marionette DEBUG 17 <- [1,17,null,{"value":"<html><head></head><body></body></html>"}]
01:09:22 INFO - 1552525762628 Marionette DEBUG 17 -> [0,18,"Marionette:SetContext",{"value":"content"}]
01:09:22 INFO - 1552525762628 Marionette DEBUG 17 <- [1,18,null,{"value":null}]
01:09:22 ERROR - TEST-UNEXPECTED-FAIL | testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_additional_capabilities | AssertionError: u'c:\\users\\testdroid\\appdata\\local\\temp\\tmpveypgf.mozrunner' != u'c:\\users\\testdr~1\\appdata\\local\\temp\\tmpveypgf.mozrunner'
01:09:22 INFO - - c:\users\testdroid\appdata\local\temp\tmpveypgf.mozrunner
01:09:22 INFO - ? ^^^
01:09:22 INFO - + c:\users\testdr~1\appdata\local\temp\tmpveypgf.mozrunner
01:09:22 INFO - ? ^^
01:09:22 INFO - Traceback (most recent call last):
01:09:22 INFO - File "C:\tasks\task_1552525409\build\venv\lib\site-packages\marionette_harness\marionette_test\testcases.py", line 159, in run
01:09:22 INFO - testMethod()
01:09:22 INFO - File "C:\tasks\task_1552525409\build\tests\marionette\tests\testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py", line 102, in test_additional_capabilities
01:09:22 INFO - self.assertEqual(self.caps["moz:profile"].lower(), current_profile.lower())
01:09:22 INFO - TEST-INFO took 133ms
01:09:22 INFO - TEST-START | testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_disable_webdriver_click
01:09:22 INFO - 1552525762637 Marionette DEBUG 17 -> [0,19,"WebDriver:DeleteSession",{}]
01:09:22 INFO - 1552525762638 Marionette DEBUG 17 <- [1,19,null,{"value":null}]
01:09:22 INFO - 1552525762640 Marionette DEBUG Closed connection 17
01:09:22 INFO - 1552525762643 Marionette DEBUG Accepted connection 18 from 127.0.0.1:50049
01:09:22 INFO - 1552525762645 Marionette DEBUG 18 -> [0,1,"WebDriver:NewSession",{"strictFileInteractability":true}]
01:09:22 INFO - 1552525762646 Marionette TRACE [6442450945] Frame script loaded
01:09:22 INFO - 1552525762647 Marionette TRACE [6442450945] Frame script registered
01:09:22 INFO - 1552525762649 Marionette DEBUG 18 <- [1,1,null,{"sessionId":"79b76952-66c6-48e3-8c94-e9250fd75af4","capabilities":{"browserName":"firefox","browserVersion":"67.0a ... p\\tmpveypgf.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":true}}]
01:09:22 INFO - 1552525762651 Marionette DEBUG 18 -> [0,2,"WebDriver:SetTimeouts",{"script":30000}]
01:09:22 INFO - 1552525762651 Marionette DEBUG 18 <- [1,2,null,{"value":null}]
01:09:22 INFO - 1552525762653 Marionette DEBUG 18 -> [0,3,"WebDriver:SetTimeouts",{"pageLoad":300000}]
01:09:22 INFO - 1552525762654 Marionette DEBUG 18 <- [1,3,null,{"value":null}]
01:09:22 INFO - 1552525762655 Marionette DEBUG 18 -> [0,4,"WebDriver:SetTimeouts",{"implicit":0}]
01:09:22 INFO - 1552525762655 Marionette DEBUG 18 <- [1,4,null,{"value":null}]
01:09:22 INFO - 1552525762657 Marionette DEBUG 18 -> [0,5,"Marionette:GetContext",{}]
01:09:22 INFO - 1552525762658 Marionette DEBUG 18 <- [1,5,null,{"value":"content"}]
01:09:22 INFO - 1552525762659 Marionette DEBUG 18 -> [0,6,"Marionette:SetContext",{"value":"chrome"}]
01:09:22 INFO - 1552525762659 Marionette DEBUG 18 <- [1,6,null,{"value":null}]
01:09:22 INFO - 1552525762662 Marionette DEBUG 18 -> [0,7,"WebDriver:ExecuteScript",{"script":"return {\n name: Services.appinfo.name,\n version ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":24}]
01:09:22 INFO - 1552525762665 Marionette DEBUG 18 <- [1,7,null,{"value":{"name":"Firefox","version":"67.0a1","processID":9112,"buildID":"20190313215841"}}]
01:09:22 INFO - 1552525762669 Marionette DEBUG 18 -> [0,8,"WebDriver:ExecuteScript",{"script":"let name = Services.sysinfo.getProperty(\"name\");\n switch (name) { ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":35}]
01:09:22 INFO - 1552525762671 Marionette DEBUG 18 <- [1,8,null,{"value":"windows"}]
01:09:22 INFO - 1552525762675 Marionette DEBUG 18 -> [0,9,"WebDriver:ExecuteScript",{"script":"return Services.sysinfo.getProperty('version')","newSandbox":true,"args":[],"filena ... \\tests\\testing\\marionette\\harness\\marionette_harness\\tests\\unit\\test_capabilities.py","sandbox":"default","line":37}]
01:09:22 INFO - 1552525762677 Marionette DEBUG 18 <- [1,9,null,{"value":"10.0"}]
01:09:22 INFO - 1552525762678 Marionette DEBUG 18 -> [0,10,"Marionette:SetContext",{"value":"content"}]
01:09:22 INFO - 1552525762679 Marionette DEBUG 18 <- [1,10,null,{"value":null}]
01:09:22 INFO - 1552525762680 Marionette DEBUG 18 -> [0,11,"WebDriver:DeleteSession",{}]
01:09:22 INFO - 1552525762682 Marionette DEBUG 18 <- [1,11,null,{"value":null}]
01:09:22 INFO - 1552525762683 Marionette DEBUG Closed connection 18
01:09:22 INFO - 1552525762684 Marionette DEBUG Accepted connection 19 from 127.0.0.1:50050
01:09:22 INFO - 1552525762685 Marionette DEBUG 19 -> [0,1,"WebDriver:NewSession",{"moz:webdriverClick":false}]
01:09:22 INFO - 1552525762687 Marionette TRACE [6442450945] Frame script loaded
01:09:22 INFO - 1552525762688 Marionette TRACE [6442450945] Frame script registered
01:09:22 INFO - 1552525762690 Marionette DEBUG 19 <- [1,1,null,{"sessionId":"3ef1032b-1e88-46bd-acce-489fe1c71ec7","capabilities":{"browserName":"firefox","browserVersion":"67.0a ... \\tmpveypgf.mozrunner","moz:shutdownTimeout":60000,"moz:useNonSpecCompliantPointerOrigin":false,"moz:webdriverClick":false}}]
01:09:22 INFO - 1552525762692 Marionette DEBUG 19 -> [0,2,"WebDriver:DeleteSession",{}]
01:09:22 INFO - 1552525762693 Marionette DEBUG 19 <- [1,2,null,{"value":null}]

No longer blocks: 1536284
Depends on: 1536284
OS: Unspecified → Windows
Hardware: Unspecified → ARM64

Via bug 1536284 this test will be disabled for aarch64.

Depends on: 1536284

Also do all the tests in this module fail, or only this specific test? If it is only this test please do not skip the full test file.

Flags: needinfo?(egao)
Summary: windows/aarch64 - testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_additional_capabilities | AssertionError → Intermittent windows/aarch64 testing\marionette\harness\marionette_harness\tests\unit\test_capabilities.py TestCapabilities.test_additional_capabilities | AssertionError: u'c:\\users\\testdroid\\appdata\\local\\temp\\tmpveypgf.mozrunner' != u'c:\\users\\

I've updated the patch at https://phabricator.services.mozilla.com/D23991 with a MarionetteTestCase.skipTest clause, but I imagine that skips the test for all platform combinations as well. Is there no provision for a skipIf?

Flags: needinfo?(egao)

Edwin, please note that this failure will no longer happen once bug 1533221 is fixed. The patch may land the next hours.

I'm actually going to mark it as duplicate of bug 1533221.

Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → DUPLICATE
Product: Testing → Remote Protocol
Moving bug to Testing::Marionette Client and Harness component per bug 1815831.
Component: Marionette → Marionette Client and Harness
Product: Remote Protocol → Testing
You need to log in before you can comment on or make changes to this bug.