Filed by: btara [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=247331889&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/KF4-bJ15Tcy_KFoks1Solw/runs/0/artifacts/public/logs/live_backing.log

[task 2019-05-20T12:10:17.567Z] 12:10:17 INFO - TEST-START | dom/base/test/test_audioNotificationSilent_audioFile.html
[task 2019-05-20T12:10:17.686Z] 12:10:17 INFO - TEST-INFO | started process screentopng
[task 2019-05-20T12:10:18.282Z] 12:10:18 INFO - TEST-INFO | screentopng: exit 0
[task 2019-05-20T12:10:18.283Z] 12:10:18 INFO - Buffered messages logged at 12:10:17
[task 2019-05-20T12:10:18.284Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer set
[task 2019-05-20T12:10:18.284Z] 12:10:18 INFO - Audio playing start
[task 2019-05-20T12:10:18.285Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
[task 2019-05-20T12:10:18.286Z] 12:10:18 INFO - Buffered messages finished
[task 2019-05-20T12:10:18.286Z] 12:10:18 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "inactive-pause", expected "active"
[task 2019-05-20T12:10:18.287Z] 12:10:18 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
[task 2019-05-20T12:10:18.287Z] 12:10:18 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
[task 2019-05-20T12:10:18.289Z] 12:10:18 INFO - Audio would become silent during playing
[task 2019-05-20T12:10:18.290Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
[task 2019-05-20T12:10:18.290Z] 12:10:18 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-05-20T12:10:18.291Z] 12:10:18 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "active", expected "inactive-nonaudible"
[task 2019-05-20T12:10:18.292Z] 12:10:18 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
[task 2019-05-20T12:10:18.292Z] 12:10:18 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer removed
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - GECKO(5378) | MEMORY STAT | vsize 2754MB | residentFast 176MB | heapAllocated 30MB
[task 2019-05-20T12:10:18.293Z] 12:10:18 INFO - TEST-OK | dom/base/test/test_audioNotificationSilent_audioFile.html | took 160ms

Edwin can you take a look at this? I believe it's from bug 1555454

https://treeherder.mozilla.org/#/jobs?repo=autoland&group_state=expanded&searchStr=os%2Cx%2C10.14%2Cdebug%2Cmochitests%2Ctest-macosx1014-64%2Fdebug-mochitest-e10s-1%2Cm%281%29&tochange=a914cf0cb9362d6b8f55ad1dce5660d838cb09bd&fromchange=be82b2bd60e53730ff880428f17000df9c5af047&selectedJob=253699217

There are 42 total failures in the last 4 days on macosx1014-64 debug and macosx1014-64-shippable opt.

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=253829368&repo=autoland&lineNumber=3509

00:06:04 INFO - TEST-START | dom/base/test/test_audioNotificationSilent_audioFile.html
00:06:04 INFO - TEST-INFO | started process screencapture
00:06:04 INFO - TEST-INFO | screencapture: exit 0
00:06:04 INFO - Buffered messages logged at 00:06:04
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer set
00:06:04 INFO - Audio playing start
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
00:06:04 INFO - Buffered messages finished
00:06:04 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "inactive-pause", expected "active"
00:06:04 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
00:06:04 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
00:06:04 INFO - Audio would become silent during playing
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | audio-playback received
00:06:04 INFO - Not taking screenshot here: see the one that was previously logged
00:06:04 INFO - TEST-UNEXPECTED-FAIL | dom/base/test/test_audioNotificationSilent_audioFile.html | Corrrect audible state - got "active", expected "inactive-nonaudible"
00:06:04 INFO - SimpleTest.is@SimpleTest/SimpleTest.js:320:16
00:06:04 INFO - observe@dom/base/test/test_audioNotificationSilent_audioFile.html:25:5
00:06:04 INFO - TEST-PASS | dom/base/test/test_audioNotificationSilent_audioFile.html | Observer removed
00:06:04 INFO - GECKO(1851) | MEMORY STAT | vsize 7281MB | residentFast 127MB | heapAllocated 32MB
00:06:04 INFO - TEST-OK | dom/base/test/test_audioNotificationSilent_audioFile.html | took 174ms

:alwu - I see that you added this test back in 2016. We are seeing higher than expected intermittent rate for this test on macosx1014 platform. Could you take a look, or point to someone that may know about this test? In the meantime, I am proposing to disable this test on macosx1014.

Sure, I can take a look on it. Keep NI.

This test will leak one audio-playback notification to next test, because when we close this test, we would close iframe and send the inaudible-pause notification.

It would somehow affect the following test if the next one is also listening the audio-playback notification.

Using async and await form can increase the readability of the test.

https://hg.mozilla.org/mozilla-central/rev/e56260118399
https://hg.mozilla.org/mozilla-central/rev/e349eb0585f7

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

ESR Uplift Approval Request

• If this is not a sec:{high,crit} bug, please state case for ESR consideration: testonly change to get tests running on osx 10.14 instead of 10.10
• User impact if declined:
• Fix Landed on Version: 69
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky):
• String or UUID changes made by this patch:

Comment on attachment 9075247 [details]
Bug 1552818 - part1 : prevent to leak audio-playback notification.

Test-only change needed to run OSX 10.14 tests on ESR68. Approved for 68.1esr.

https://hg.mozilla.org/releases/mozilla-esr68/rev/0ddbde0b74fb
https://hg.mozilla.org/releases/mozilla-esr68/rev/16410020f7e1