1579388 - Perma dom/media/tests/mochitest/test_enumerateDevices.html | undefined assertion name - got 2, expected +0 - when Gecko 71 merges to Beta on 2019-10-14

Reporter

Description

•

5 years ago

[Tracking Requested - why for this release]:

Central as Beta:
https://treeherder.mozilla.org/#/jobs?repo=try&selectedJob=265315129&resultStatus=testfailed%2Cbusted%2Cexception&revision=cb853226098e88a353228488821cf30d3c106ad0&searchStr=mochitest-media

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=265315129&repo=try&lineNumber=11297

[task 2019-09-06T11:12:48.245Z] 11:12:48 [task 2019-09-06T11:12:48.321Z] 11:12:48 [task 2019-09-06T11:12:48.321Z] 11:12:48 [task 2019-09-06T11:12:48.846Z] 11:12:48 [task 2019-09-06T11:12:49.271Z] 11:12:49 [task 2019-09-06T11:12:49.272Z] 11:12:49 [task 2019-09-06T11:12:49.273Z] 11:12:49 [task 2019-09-06T11:12:49.274Z] 11:12:49 [task 2019-09-06T11:12:49.275Z] 11:12:49 [task 2019-09-06T11:12:49.276Z] 11:12:49 [task 2019-09-06T11:12:49.277Z] 11:12:49 [task 2019-09-06T11:12:49.278Z] 11:12:49 [task 2019-09-06T11:12:49.279Z] 11:12:49 [task 2019-09-06T11:12:49.279Z] 11:12:49 [task 2019-09-06T11:12:49.283Z] 11:12:49 [task 2019-09-06T11:12:49.283Z] 11:12:49 [task 2019-09-06T11:12:49.284Z] 11:12:49 [task 2019-09-06T11:12:49.287Z] 11:12:49 [task 2019-09-06T11:12:49.288Z] 11:12:49 [task 2019-09-06T11:12:49.288Z] 11:12:49 [task 2019-09-06T11:12:49.289Z] 11:12:49 [task 2019-09-06T11:12:49.289Z] 11:12:49 [task 2019-09-06T11:12:49.290Z] 11:12:49 [task 2019-09-06T11:12:49.290Z] 11:12:49 [task 2019-09-06T11:12:49.291Z] 11:12:49 [task 2019-09-06T11:12:49.292Z] 11:12:49 [task 2019-09-06T11:12:49.292Z] 11:12:49 [task 2019-09-06T11:12:49.293Z] 11:12:49 [task 2019-09-06T11:12:49.293Z] 11:12:49 [task 2019-09-06T11:12:49.294Z] 11:12:49 [task 2019-09-06T11:12:49.294Z] 11:12:49 [task 2019-09-06T11:12:49.295Z] 11:12:49 [task 2019-09-06T11:12:49.295Z] 11:12:49 [task 2019-09-06T11:12:49.296Z] 11:12:49 [task 2019-09-06T11:12:49.296Z] 11:12:49 [task 2019-09-06T11:12:49.296Z] 11:12:49 [task 2019-09-06T11:12:49.297Z] 11:12:49 [task 2019-09-06T11:12:49.297Z] 11:12:49 [task 2019-09-06T11:12:49.298Z] 11:12:49 [task 2019-09-06T11:12:49.298Z] 11:12:49 [task 2019-09-06T11:12:49.298Z] 11:12:49 [task 2019-09-06T11:12:49.299Z] 11:12:49 [task 2019-09-06T11:12:49.299Z] 11:12:49 [task 2019-09-06T11:12:49.300Z] 11:12:49 [task 2019-09-06T11:12:49.300Z] 11:12:49 [task 2019-09-06T11:12:49.301Z] 11:12:49 [task 2019-09-06T11:12:49.301Z] 11:12:49 [task 2019-09-06T11:12:49.302Z] 11:12:49 [task 2019-09-06T11:12:49.302Z] 11:12:49 [task 2019-09-06T11:12:49.303Z] 11:12:49 [task 2019-09-06T11:12:49.303Z] 11:12:49 [task 2019-09-06T11:12:49.304Z] 11:12:49 [task 2019-09-06T11:12:49.304Z] 11:12:49 [task 2019-09-06T11:12:49.304Z] 11:12:49 [task 2019-09-06T11:12:49.305Z] 11:12:49 [task 2019-09-06T11:12:49.305Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 [task 2019-09-06T11:12:49.306Z] 11:12:49 INFO - TEST-START | dom/media/tests/mochitest/test_enumerateDevices.html
INFO - GECKO(3628) | TEST DEVICES: Got loopback audio: Monitor of Null Output
INFO - GECKO(3628) | TEST DEVICES: Got loopback video: Dummy video device (0x0000)
INFO - TEST-INFO | started process screentopng
INFO - TEST-INFO | screentopng: exit 0
INFO - Buffered messages logged at 11:12:48
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | A valid string reason is expected
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Reason cannot be empty
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | At least one device found
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | kind survived serializer
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId survived serializer
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Dummy video device (0x0000)
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Track label is a string
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Track label is the device label
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Monitor of Null Output
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Track label is a string
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Track label is the device label
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown plain deviceId on video must succeed
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown plain deviceId on audio must succeed
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown exact deviceId on video must fail: Constraints could be not satisfied.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown exact deviceId on video must fail w/correct constraint.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown exact deviceId on audio must fail: Constraints could be not satisfied.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | unknown exact deviceId on audio must fail w/correct constraint.
INFO - https://example.com/tests/dom/media/tests/mochitest/test_enumerateDevices.html
INFO - https://example.com/tests/dom/media/tests/mochitest/test_enumerateDevices_iframe.html
INFO - https://test1.example.com/tests/dom/media/tests/mochitest/test_enumerateDevices_iframe.html
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Got message from expected origin
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Got message from expected origin
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | undefined assertion name
INFO - Buffered messages finished
INFO - TEST-UNEXPECTED-FAIL | dom/media/tests/mochitest/test_enumerateDevices.html | undefined assertion name - got 2, expected +0
INFO - SimpleTest.is@https://example.com/tests/SimpleTest/SimpleTest.js:322:16
INFO - @https://example.com/tests/dom/media/tests/mochitest/test_enumerateDevices.html:111:5
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Dummy video device (0x0000)
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Monitor of Null Output
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Dummy video device (0x0000)
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Known device kind
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | deviceId length id as expected for Firefox
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Device label: Monitor of Null Output
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | groupId must be present.
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Same origin deviceId for Dummy video device (0x0000) must match
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Same origin deviceId for Monitor of Null Output must match
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Different origin deviceId for Dummy video device (0x0000) must be different
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | Different origin deviceId for Monitor of Null Output must be different
INFO - TEST-PASS | dom/media/tests/mochitest/test_enumerateDevices.html | No devices found
INFO - GECKO(3628) | MEMORY STAT | vsize 20974693MB | residentFast 829MB
INFO - TEST-OK | dom/media/tests/mochitest/test_enumerateDevices.html | took 644ms

This seems to be a regressin from https://bugzilla.mozilla.org/show_bug.cgi?id=1548087

Thomas, could you please take a look at this?

Flags: needinfo?(tnguyen)

Thomas Nguyen (:tnguyen)

Assignee

Comment 1

•

5 years ago

Attached file Bug 1579388 - Enable featurepolicy pref in beta test_enumerateDevices. (deleted) — Details

dom.security.featurePolicy.enabled is enable only in nightly, so some
tests in beta will be failed. We should manually enable the pref in test.

Thomas Nguyen (:tnguyen)

Assignee

Comment 2

•

5 years ago

That is because dom.security.featurePolicy.enabled is disabled in beta.
We should manually enable in the test.

Flags: needinfo?(tnguyen)

Natalia Csoregi [:nataliaCs]

Comment 3

•

5 years ago

Still failing with the patch imported: https://treeherder.mozilla.org/#/jobs?repo=try&revision=0511424b95c084ee467d0062b774a88b6d518750&searchStr=mda2&selectedJob=265509668

Thomas Nguyen (:tnguyen)

Assignee

Comment 4

•

5 years ago

Can you try again?
https://treeherder.mozilla.org/#/jobs?repo=try&revision=ea7c08fc32f87d8b83971e94d69c3a18a594489a

Thomas Nguyen (:tnguyen)

Assignee

Comment 5

•

5 years ago

https://treeherder.mozilla.org/#/jobs?repo=try&revision=8831de5ead83b4ccac6935c2fd721452145118b8

Razvan Maries

Comment 6

•

5 years ago

No occurrences on today's beta sims: https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=success%2Ctestfailed%2Cbusted%2Cexception&revision=8b9df9d369664f714ece4e9b2450a773d331d2bd&searchStr=mda2

Alexandru Michis [:malexandru]

Comment 7

•

5 years ago

Thomas, can you get your patch reviewed so we can proceed to land it?

Flags: needinfo?(tnguyen)

Thomas Nguyen (:tnguyen)

Assignee

Comment 8

•

5 years ago

Not yet, I will ping reviewer about this bug

Flags: needinfo?(tnguyen)

Thomas Nguyen (:tnguyen)

Assignee

Comment 9

•

5 years ago

It is reviewed, can anyone help me push to nightly and beta? Thanks

Thomas Nguyen (:tnguyen)

Assignee

Updated

•

5 years ago

Keywords: checkin-needed

Pulsebot

Comment 10

•

5 years ago

Pushed by nbeleuzu@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/5e165ef7d318
Enable featurepolicy pref in beta test_enumerateDevices. r=baku

Keywords: checkin-needed

Stefan Hindli [:stefan_hindli]

Comment 11

•

5 years ago

bugherder

https://hg.mozilla.org/mozilla-central/rev/5e165ef7d318

Status: NEW → RESOLVED

Closed: 5 years ago

status-firefox71: affected → fixed

Resolution: --- → FIXED

Target Milestone: --- → mozilla71

BugBot [:suhaib / :marco/ :calixte]

Updated

•

5 years ago

Assignee: nobody → tnguyen

Alexandru Michis [:malexandru]

Comment 12

•

5 years ago

Marking this verified fixed as of yesterday's central as beta simulation:
https://treeherder.mozilla.org/#/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cusercancel%2Crunnable&revision=af202c84bd6e00997585902a7a7ff2fc06e28df5&searchStr=mochitest-media

Status: RESOLVED → VERIFIED

status-firefox71: fixed → verified

Thomas Nguyen (:tnguyen)

Assignee

Comment 13

•

5 years ago

:malexandru could you please tell me how I could run a try test on beta? The same way with nightly?
Thanks

Flags: needinfo?(malexandru)

Alexandru Michis [:malexandru]

Comment 14

•

5 years ago

You can find all the information you need here under "trunk as early beta" and "trunk as late beta" mainly:
https://wiki.mozilla.org/Sheriffing/How_To/Beta_simulations

This has already been tested on beta, as the try pushes where I mention it's fixed are from beta simulations, which is what we are doing here.

Flags: needinfo?(malexandru)

Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)

Comment 15

•

5 years ago

If you don't want to run all the tests, append --no-push to the command which modifies the configurations and hg commit -m 'Early beta config'. Select the jobs to run afterwards with ./mach try chooser

Thomas Nguyen (:tnguyen)

Assignee

Comment 16

•

5 years ago

Noted it, thanks. There are different prefs in nightly and beta in my several patches, there would fail in beta and I need a way to check it.

Pascal Chevrel:pascalc (PTO until August 21)

Updated

•

5 years ago

tracking-firefox71: ? → ---

Thomas Nguyen (:tnguyen)

Assignee

Updated

•

5 years ago

Blocks: 1572461

BugBot [:suhaib / :marco/ :calixte]

Updated

•

3 years ago

Has Regression Range: --- → yes

BMO Automation

Updated

•

3 years ago

Keywords: regression