Closed Bug 1568063 Opened 5 years ago Closed 5 years ago

Intermittent Android <xpcshell> | xpcshell return code: 0 (or 139) in many tests

Categories

(Testing :: General, defect, P1)

Product:
Testing
Component:
General
Platform:
Unspecified
Android
Type:
defect

Tracking

(firefox-esr68 unaffected, firefox71 unaffected, firefox72 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla72
Tracking Flags:
Tracking Status
firefox-esr68 --- unaffected
firefox71 --- unaffected
firefox72 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: gbrown)

References

(Blocks 1 open bug, Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [necko-triaged])

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=257719963&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/NYOZ_nQoSfuRpzFaNN_zOA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/NYOZ_nQoSfuRpzFaNN_zOA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2019-07-22T20:31:27.824Z] 20:31:27 INFO - TEST-START | netwerk/test/unit/test_gzipped_206.js
[task 2019-07-22T20:31:28.230Z] 20:31:28 WARNING - TEST-UNEXPECTED-FAIL | netwerk/test/unit/test_gzipped_206.js | xpcshell return code: 0
[task 2019-07-22T20:31:28.230Z] 20:31:28 INFO - TEST-INFO took 405ms
[task 2019-07-22T20:31:28.230Z] 20:31:28 INFO - >>>>>>>
[task 2019-07-22T20:31:28.230Z] 20:31:28 INFO - netwerk/test/unit/test_gzipped_206.js | xpcw: cd /sdcard/tests/xpc/netwerk/test/unit
[task 2019-07-22T20:31:28.230Z] 20:31:28 INFO - netwerk/test/unit/test_gzipped_206.js | xpcw: xpcshell -r /sdcard/tests/xpc/c/httpd.manifest --greomni /data/local/xpcb/target.apk -m -s -e const _HEAD_JS_PATH = "/sdcard/tests/xpc/head.js"; -e const _MOZINFO_JS_PATH = "/sdcard/tests/xpc/p/mozinfo.json"; -e const _PREFS_FILE = "/sdcard/tests/xpc/user.js"; -e const _TESTING_MODULES_DIR = "/sdcard/tests/xpc/m"; -f /sdcard/tests/xpc/head.js -e const _HEAD_FILES = ["/sdcard/tests/xpc/netwerk/test/unit/head_channels.js", "/sdcard/tests/xpc/netwerk/test/unit/head_cache.js", "/sdcard/tests/xpc/netwerk/test/unit/head_cache2.js", "/sdcard/tests/xpc/netwerk/test/unit/head_cookies.js"]; -e const _JSDEBUGGER_PORT = 0; -e const _TEST_FILE = ["test_gzipped_206.js"]; -e const _TEST_NAME = "netwerk/test/unit/test_gzipped_206.js"; -e _execute_test(); quit(0);
[task 2019-07-22T20:31:28.230Z] 20:31:28 INFO - netwerk/test/unit/test_gzipped_206.js | /data/local/xpcb/xpcw[18]: cd: /sdcard/tests/xpc/netwerk/test/unit: No such file or directory
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - Error: cannot open file '/sdcard/tests/xpc/netwerk/test/unit/head_channels.js' for reading at /sdcard/tests/xpc/head.js:681
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - load_file@/sdcard/tests/xpc/head.js:681:7
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - _load_files@/sdcard/tests/xpc/head.js:693:10
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - _execute_test@/sdcard/tests/xpc/head.js:542:3
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - @-e:1:1
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - Error: cannot open file '/sdcard/tests/xpc/netwerk/test/unit/head_cache.js' for reading at /sdcard/tests/xpc/head.js:681
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - load_file@/sdcard/tests/xpc/head.js:681:7
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - _load_files@/sdcard/tests/xpc/head.js:693:10
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - _execute_test@/sdcard/tests/xpc/head.js:542:3
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - @-e:1:1
[task 2019-07-22T20:31:28.231Z] 20:31:28 INFO - Error: cannot open file '/sdcard/tests/xpc/netwerk/test/unit/head_cache2.js' for reading at /sdcard/tests/xpc/head.js:681
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - load_file@/sdcard/tests/xpc/head.js:681:7
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _load_files@/sdcard/tests/xpc/head.js:693:10
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _execute_test@/sdcard/tests/xpc/head.js:542:3
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - @-e:1:1
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - Error: cannot open file '/sdcard/tests/xpc/netwerk/test/unit/head_cookies.js' for reading at /sdcard/tests/xpc/head.js:681
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - load_file@/sdcard/tests/xpc/head.js:681:7
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _load_files@/sdcard/tests/xpc/head.js:693:10
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _execute_test@/sdcard/tests/xpc/head.js:542:3
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - @-e:1:1
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - Error: cannot open file 'test_gzipped_206.js' for reading at /sdcard/tests/xpc/head.js:681
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - load_file@/sdcard/tests/xpc/head.js:681:7
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _load_files@/sdcard/tests/xpc/head.js:693:10
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - _execute_test@/sdcard/tests/xpc/head.js:544:3
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - @-e:1:1
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - (xpcshell/head.js) | test MAIN run_test pending (1)
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - (xpcshell/head.js) | test run_next_test 0 pending (2)
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - (xpcshell/head.js) | test MAIN run_test finished (2)
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - running event loop
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - (xpcshell/head.js) | test run_next_test 0 finished (1)
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - exiting test
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - netwerk/test/unit/test_gzipped_206.js | JavaScript error: resource://testing-common/PromiseTestUtils.jsm, line 112: uncaught exception: Object
[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - <<<<<<<
[task 2019-07-22T20:31:29.561Z] 20:31:29 INFO - TEST-START | netwerk/test/unit/test_gzipped_206.js
[task 2019-07-22T20:31:29.966Z] 20:31:29 WARNING - TEST-UNEXPECTED-FAIL | netwerk/test/unit/test_gzipped_206.js | xpcshell return code: 0

Priority: P5 → P3
Whiteboard: [necko-triaged]

(In reply to Treeherder Bug Filer from comment #0)

[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - netwerk/test/unit/test_gzipped_206.js | JavaScript error: resource://testing-common/PromiseTestUtils.jsm, line 112: uncaught exception: Object

https://searchfox.org/mozilla-central/rev/4436573fa3d5c4311822090e188504c10c916c6f/toolkit/modules/tests/modules/PromiseTestUtils.jsm#112

[task 2019-07-22T20:31:28.232Z] 20:31:28 INFO - <<<<<<<
[task 2019-07-22T20:31:29.561Z] 20:31:29 INFO - TEST-START | netwerk/test/unit/test_gzipped_206.js
[task 2019-07-22T20:31:29.966Z] 20:31:29 WARNING - TEST-UNEXPECTED-FAIL | netwerk/test/unit/test_gzipped_206.js | xpcshell return code: 0

Anyway:

Error: cannot open file '/sdcard/tests/xpc/netwerk/test/unit/head_cache.js'

suggests this is an infra problem.

Component: Networking → XPCShell Harness
OS: Unspecified → Android
Product: Core → Testing

The product::component has been changed since the backlog priority was decided, so we're resetting it.
For more information, please visit auto_nag documentation.

Priority: P3 → --
Summary: Intermittent netwerk/test/unit/test_gzipped_206.js | xpcshell return code: 0 → Intermittent Android <xpcshell> | xpcshell return code: 0 due to No such file or directory
Assignee: nobody → gbrown
Priority: -- → P3

All of the examples collected here so far are in Android 7.0 xpcshell tests run in TV, which makes some sense: We previously saw this issue with xpcshell tests run in the latest emulator and downgraded the emulator for xpcshell -- but TV continues to use the new emulator. Tricky to fix: We need the new emulator for reliable Android 7.0 mochitests and reftests, but the old emulator for reliable xpcshell, and they all potentially run in the same environment for TV.

Component: XPCShell Harness → General
Blocks: test-verify

(In reply to Intermittent Failures Robot from comment #5)

1 failures in 5047 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

This is an xpcshell task, but the failure is not obviously related to missing files (unlike other failures tracked by this bug). In this case the failure was

[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - Unexpected exception RangeError: start offset is outside the bounds of the buffer at /sdcard/tests/xpc/dom/localstorage/test/unit/head.js:322
[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - readUsageFromUsageFile@/sdcard/tests/xpc/dom/localstorage/test/unit/head.js:322:14
[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - _do_main@/sdcard/tests/xpc/head.js:246:6
[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - _execute_test@/sdcard/tests/xpc/head.js:573:5
[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - @-e:1:1
[task 2019-08-31T22:47:09.135Z] 22:47:09 INFO - exiting test

I expect these failures to resume with the changes in bug 1594735, which upgrade the emulator for xpcshell tests. (These failures should have less impact than the failures resolved by the upgrade.)

Priority: P3 → P1
Regressed by: 1594735

Diagnostics to track down missing files:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=741ab904a38e50e08ae1195a048b373211dad473

I'll need to run that a lot to have a hope of reproducing this failure -- maybe on a weekend?

...but I don't see missing files in the most recent failures...

Summary: Intermittent Android <xpcshell> | xpcshell return code: 0 due to No such file or directory → Intermittent Android <xpcshell> | xpcshell return code: 0 in many tests
Summary: Intermittent Android <xpcshell> | xpcshell return code: 0 in many tests → Intermittent Android <xpcshell> | xpcshell return code: 0 (or 139) in many tests
Depends on: 1596962
Depends on: 1598737

No new failures since bug 1598737 landed, and no sign of trouble in the most recent 300 pushes on autoland.

Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
status-firefox71: --- → unaffected
status-firefox72: --- → fixed
status-firefox-esr68: --- → unaffected
Target Milestone: --- → mozilla72
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.