Intermittent TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpTransceiver.https.html | expected OK
Categories
(Core :: WebRTC, defect, P5)
Tracking
()
People
(Reporter: intermittent-bug-filer, Assigned: aryx)
References
Details
(Keywords: intermittent-failure, leave-open)
Attachments
(2 files)
Comment 1•6 years ago
|
||
Assignee | ||
Comment 3•6 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 6•6 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 16•4 years ago
|
||
Sure would be nice if we had a stack here...
Comment hidden (Intermittent Failures Robot) |
Comment 18•4 years ago
|
||
(In reply to Byron Campen [:bwc] from comment #16)
Sure would be nice if we had a stack here...
This is all we have:
[task 2020-08-09T12:31:16.661Z] 12:31:16 INFO - TEST-START | /webrtc/RTCRtpTransceiver.https.html
[task 2020-08-09T12:31:16.662Z] 12:31:16 INFO - Clearing pref media.navigator.permission.disabled
[task 2020-08-09T12:31:16.678Z] 12:31:16 INFO - Clearing pref media.navigator.streams.fake
[task 2020-08-09T12:31:16.686Z] 12:31:16 INFO - Clearing pref privacy.resistFingerprinting.reduceTimerPrecision.jitter
[task 2020-08-09T12:31:16.702Z] 12:31:16 INFO - Clearing pref privacy.reduceTimerPrecision
[task 2020-08-09T12:31:16.710Z] 12:31:16 INFO - Clearing pref media.peerconnection.ice.trickle_grace_period
[task 2020-08-09T12:31:16.730Z] 12:31:16 INFO - Setting pref media.navigator.permission.disabled (true)
[task 2020-08-09T12:31:16.746Z] 12:31:16 INFO - Setting pref media.navigator.streams.fake (true)
[task 2020-08-09T12:31:16.762Z] 12:31:16 INFO - Setting pref privacy.resistFingerprinting.reduceTimerPrecision.jitter (false)
[task 2020-08-09T12:31:16.778Z] 12:31:16 INFO - Setting pref privacy.reduceTimerPrecision (false)
[task 2020-08-09T12:31:16.799Z] 12:31:16 INFO - Setting pref media.peerconnection.ice.trickle_grace_period (10000)
[task 2020-08-09T12:31:16.815Z] 12:31:16 INFO - Closing window 38
[task 2020-08-09T12:31:17.774Z] 12:31:17 INFO - Browser not responding, setting status to CRASH
[task 2020-08-09T12:31:18.243Z] 12:31:18 INFO - TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpTransceiver.https.html | expected OK
[task 2020-08-09T12:31:18.243Z] 12:31:18 INFO - TEST-INFO took 1581ms
[task 2020-08-09T12:31:19.168Z] 12:31:19 INFO - Closing logging queue
[task 2020-08-09T12:31:19.168Z] 12:31:19 INFO - queue closed
[task 2020-08-09T12:31:19.191Z] 12:31:19 INFO - Setting up ssl
[task 2020-08-09T12:31:19.215Z] 12:31:19 INFO - certutil |
[task 2020-08-09T12:31:19.239Z] 12:31:19 INFO - certutil |
[task 2020-08-09T12:31:19.260Z] 12:31:19 INFO - certutil |
[task 2020-08-09T12:31:19.260Z] 12:31:19 INFO - Certificate Nickname Trust Attributes
[task 2020-08-09T12:31:19.260Z] 12:31:19 INFO - SSL,S/MIME,JAR/XPI
[task 2020-08-09T12:31:19.260Z] 12:31:19 INFO -
[task 2020-08-09T12:31:19.261Z] 12:31:19 INFO - web-platform-tests CT,,
[task 2020-08-09T12:31:19.261Z] 12:31:19 INFO -
[task 2020-08-09T12:31:22.749Z] 12:31:22 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2020-08-09T12:31:24.145Z] 12:31:24 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env8 R_LOG_DESTINATION=stderr --es args "-no-remote -profile /data/local/tmp/test_root/profile --marionette about:blank" --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env2 R_LOG_VERBOSE=1 --es env1 MOZ_WEBRENDER=0 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env6 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env4 STYLO_THREADS=1 --ez use_multiprocess True --es env12 R_LOG_LEVEL=6 --es env11 MOZ_PROCESS_LOG=/tmp/tmpMcDDUKpidlog --es env10 MOZ_CRASHREPORTER_NO_REPORT=1
[task 2020-08-09T12:31:26.015Z] 12:31:26 INFO - Starting runner
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Comment 24•4 years ago
|
||
There's almost nothing in the logs to go on here. The only thing I can find is this:
09-03 19:39:49.380 22301 22320 I Gecko : [Parent 22301, Unnamed thread 7cb4c0f3e460] WARNING: waitpid failed pid:22325 errno:10: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_posix.cc, line 237
But that seems to happen after the tab has died.
I should note that this seems to be happening after this test is done running:
[task 2020-09-03T18:39:47.944Z] 18:39:47 INFO - Closing window 35
[task 2020-09-03T18:39:48.785Z] 18:39:48 INFO - TEST-OK | /webrtc/RTCRtpTransceiver-stop.html | took 845ms
[task 2020-09-03T18:39:48.785Z] 18:39:48 INFO - TEST-START | /webrtc/RTCRtpTransceiver.https.html
[task 2020-09-03T18:39:48.789Z] 18:39:48 INFO - Clearing pref media.navigator.permission.disabled
[task 2020-09-03T18:39:48.804Z] 18:39:48 INFO - Clearing pref media.navigator.streams.fake
[task 2020-09-03T18:39:48.808Z] 18:39:48 INFO - Clearing pref privacy.resistFingerprinting.reduceTimerPrecision.jitter
[task 2020-09-03T18:39:48.824Z] 18:39:48 INFO - Clearing pref privacy.reduceTimerPrecision
[task 2020-09-03T18:39:48.828Z] 18:39:48 INFO - Clearing pref media.peerconnection.ice.trickle_grace_period
[task 2020-09-03T18:39:48.849Z] 18:39:48 INFO - Setting pref media.navigator.permission.disabled (true)
[task 2020-09-03T18:39:48.865Z] 18:39:48 INFO - Setting pref media.navigator.streams.fake (true)
[task 2020-09-03T18:39:48.885Z] 18:39:48 INFO - Setting pref privacy.resistFingerprinting.reduceTimerPrecision.jitter (false)
[task 2020-09-03T18:39:48.906Z] 18:39:48 INFO - Setting pref privacy.reduceTimerPrecision (false)
[task 2020-09-03T18:39:48.921Z] 18:39:48 INFO - Setting pref media.peerconnection.ice.trickle_grace_period (10000)
[task 2020-09-03T18:39:48.929Z] 18:39:48 INFO - Closing window 38
[task 2020-09-03T18:39:50.255Z] 18:39:50 INFO - Browser not responding, setting status to CRASH
[task 2020-09-03T18:39:50.732Z] 18:39:50 INFO - TEST-UNEXPECTED-CRASH | /webrtc/RTCRtpTransceiver.https.html | expected OK
[task 2020-09-03T18:39:50.732Z] 18:39:50 INFO - TEST-INFO took 1944ms
And I should also note that we restart the browser after this test is done on android (to work around bug 1641237):
There are other tests where we restart the browser because of bug 1641237:
https://searchfox.org/mozilla-central/search?q=1641237&case=true&path=
But all of these these other tests run just fine, before this test runs, so I doubt the restart-after is the cause of this problem.
Comment 25•4 years ago
|
||
Interesting. We aren't just having a single tab crash on this test. We are having around 50 or so tab crashes, starting pretty much at the very beginning of the wpt suite (css tests), and happening up until the end of the suite (content-security-policy tests). This seems pretty broken to me...
09-03 23:15:03.144 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 2900) has died
09-03 23:15:12.524 1616 1627 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 3233) has died
09-03 23:15:37.714 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 3530) has died
09-03 23:15:46.921 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 3942) has died
09-03 23:15:59.898 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 4244) has died
09-03 23:16:24.774 1616 1646 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 4573) has died
09-03 23:17:03.194 1616 1799 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 4972) has died
09-03 23:17:44.078 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 5429) has died
09-03 23:17:59.424 1616 2101 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 6138) has died
09-03 23:18:49.494 1616 1628 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 6507) has died
09-03 23:19:04.724 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 6823) has died
09-03 23:19:20.944 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 7206) has died
09-03 23:19:30.364 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 7545) has died
09-03 23:19:43.104 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 7849) has died
09-03 23:20:46.324 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 8184) has died
09-03 23:21:11.814 1616 1799 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 8643) has died
09-03 23:24:25.714 1616 2007 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 9156) has died
09-03 23:24:35.674 1616 2007 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 10425) has died
09-03 23:24:57.064 1616 1628 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 10740) has died
09-03 23:25:11.290 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 11187) has died
09-03 23:25:32.294 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 11558) has died
09-03 23:27:33.674 1616 1985 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 12010) has died
09-03 23:27:45.464 1616 2101 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 13118) has died
09-03 23:27:58.274 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 13457) has died
09-03 23:28:14.424 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 13789) has died
09-03 23:29:14.154 1616 1646 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 14180) has died
09-03 23:30:17.804 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 15113) has died
09-03 23:31:38.074 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 15718) has died
09-03 23:32:00.664 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 20283) has died
09-03 23:32:12.078 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 21603) has died
09-03 23:34:13.644 1616 2101 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 22347) has died
09-03 23:34:35.434 1616 1627 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 23502) has died
09-03 23:34:48.616 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 24156) has died
09-03 23:34:58.924 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 24578) has died
09-03 23:35:09.944 1616 2007 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 24880) has died
09-03 23:35:20.184 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 25208) has died
09-03 23:35:29.774 1616 1799 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 25516) has died
09-03 23:35:46.154 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 25823) has died
09-03 23:36:20.904 1616 1985 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 26214) has died
09-03 23:36:31.854 1616 1628 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 26796) has died
09-03 23:37:04.964 1616 1627 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 27108) has died
09-03 23:38:08.754 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 27677) has died
09-03 23:38:27.994 1616 1985 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 28620) has died
09-03 23:38:39.784 1616 1985 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 29053) has died
09-03 23:39:00.444 1616 1627 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 29389) has died
09-03 23:39:11.434 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 29847) has died
09-03 23:39:33.684 1616 1985 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 30168) has died
09-03 23:39:46.084 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 30644) has died
09-03 23:40:08.314 1616 1646 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 30981) has died
09-03 23:40:20.304 1616 1980 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 31432) has died
09-03 23:40:41.164 1616 1866 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 31766) has died
09-03 23:40:50.754 1616 1982 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 32182) has died
09-03 23:41:29.674 1616 1627 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 32490) has died
09-03 23:41:48.494 1616 2100 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 735) has died
09-03 23:41:58.064 1616 2007 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 1056) has died
09-03 23:42:13.834 1616 1628 I ActivityManager: Process org.mozilla.geckoview.test:tab0 (pid 1429) has died
https://firefoxci.taskcluster-artifacts.net/BiSk-8AcTKSjoemFY9-Zew/0/public/test_info//logcat-emulator-5554.log
https://firefoxci.taskcluster-artifacts.net/BiSk-8AcTKSjoemFY9-Zew/0/public/logs/live_backing.log
Comment 26•4 years ago
|
||
I am also unsure of why this would only happen on beta. Maybe there is some issue with running without the socket process? Let's see what happens if we enable socket process on beta...
Comment 27•4 years ago
|
||
Hmm. It seems that we disable socket process for android even on release, so that's not going to cause a difference in beta. Maybe there's something else that is EARLY_BETA_OR_EARLIER?
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Assignee | ||
Comment 31•4 years ago
|
||
The recent failure spike started with the expectation update in bug 1666427 and bug 1661136 - the latter also modified the test.
Comment 32•4 years ago
|
||
I think it's more likely to be the test modification that's the problem here.
We could add if os == "android": [OK, CRASH]
to the expectations, but bwc should likely look at the actual issue here.
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 36•4 years ago
|
||
snorp, any idea about what is going on in comment 25? Any idea on how we could get some kind of actionable information on what is happening here? Without any stacks or debug output, I'm afraid there's nothing I can do to diagnose this bug...
Comment hidden (Intermittent Failures Robot) |
Assignee | ||
Comment 38•4 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Updated•4 years ago
|
Comment 41•4 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment 43•4 years ago
|
||
bugherder |
Updated•4 years ago
|
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Comment 45•4 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Comment 47•4 years ago
|
||
bugherder |
Updated•4 years ago
|
Comment hidden (Intermittent Failures Robot) |
(In reply to Byron Campen [:bwc] from comment #36)
snorp, any idea about what is going on in comment 25? Any idea on how we could get some kind of actionable information on what is happening here? Without any stacks or debug output, I'm afraid there's nothing I can do to diagnose this bug...
Yeah I don't see anything obvious in the log. The stuff about test:tab0
process is probably normal if we are frequently opening and closing a single tab.
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 53•4 years ago
|
||
Comment 54•4 years ago
|
||
Updated•4 years ago
|
Comment 55•4 years ago
|
||
bugherder |
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment 58•4 years ago
|
||
Latest failures are on mozilla-release.
Comment 59•4 years ago
|
||
Aryx there are 10 total failures on release, should this be uplifted there?
Assignee | ||
Comment 60•4 years ago
|
||
Should get checked in if more lands on release.
Comment hidden (Intermittent Failures Robot) |
Updated•4 years ago
|
Comment hidden (Intermittent Failures Robot) |
Assignee | ||
Comment 63•4 years ago
|
||
release branch has been upgraded to 83 for which the expectation changes landed.
Updated•2 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Description
•