Intermittent [tier2] layout/base/crashtests/1586600.html | application crashed [@ mozalloc_handle_oom(unsigned int)]
Categories
(Core :: Graphics: WebRender, defect, P3)
Tracking
()
People
(Reporter: intermittent-bug-filer, Assigned: aryx)
References
(Regression)
Details
(Keywords: crash, intermittent-failure, regression, Whiteboard: [stockwell unknown])
Crash Data
Attachments
(1 file)
(deleted),
text/x-phabricator-request
|
Details |
Filed by: opoprus [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=274576462&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/Lm87T1Y8SGGym0L39Z_CAg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://queue.taskcluster.net/v1/task/Lm87T1Y8SGGym0L39Z_CAg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1
[task 2019-11-05T09:55:52.579Z] 09:55:20 INFO - REFTEST TEST-START | http://10.7.205.209:8854/tests/layout/base/crashtests/1586600.html
[task 2019-11-05T09:55:52.579Z] 09:55:20 INFO - REFTEST TEST-LOAD | http://10.7.205.209:8854/tests/layout/base/crashtests/1586600.html | 1940 / 3782 (51%)
[task 2019-11-05T09:55:52.579Z] 09:55:45 INFO - wait for org.mozilla.geckoview.test complete; top activity=com.bitbar.testdroid.monitor
[task 2019-11-05T09:55:52.579Z] 09:55:45 INFO - remoteautomation.py | Application ran for: 0:05:51.155797
[task 2019-11-05T09:55:52.579Z] 09:55:46 INFO - REFTEST INFO | Downloading symbols from: https://queue.taskcluster.net/v1/task/IiFuBefBS7G-Ekfd4vsuoA/artifacts/public/build/target.crashreporter-symbols.zip
[task 2019-11-05T09:55:52.579Z] 09:55:48 INFO - REFTEST INFO | Copy/paste: /builds/task_1572947197/workspace/build/linux64-minidump_stackwalk /tmp/tmpAaXaUZ/07c6edc4-15d3-18d0-4a34-9d1ea6cd591c.dmp /tmp/tmpkK7bDg
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - REFTEST INFO | Saved minidump as /builds/task_1572947197/workspace/build/blobber_upload_dir/07c6edc4-15d3-18d0-4a34-9d1ea6cd591c.dmp
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - REFTEST INFO | Saved app info as /builds/task_1572947197/workspace/build/blobber_upload_dir/07c6edc4-15d3-18d0-4a34-9d1ea6cd591c.extra
[task 2019-11-05T09:55:52.579Z] 09:55:52 WARNING - REFTEST PROCESS-CRASH | http://10.7.205.209:8854/tests/layout/base/crashtests/1586600.html | application crashed [@ mozalloc_handle_oom(unsigned int)]
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - Crash dump filename: /tmp/tmpAaXaUZ/07c6edc4-15d3-18d0-4a34-9d1ea6cd591c.dmp
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - Operating system: Android
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - 0.0.0 Linux 4.4.56-g594d847d09a1 #1 SMP PREEMPT Thu Oct 26 22:34:08 UTC 2017 armv8l
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - CPU: arm
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - ARMv1 Qualcomm part(0x51008010) features: half,thumb,fastmult,vfpv2,edsp,neon,vfpv3,tls,vfpv4,idiva,idivt
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - 8 CPUs
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - GPU: UNKNOWN
[task 2019-11-05T09:55:52.579Z] 09:55:52 INFO - Crash reason: SIGSEGV /SEGV_MAPERR
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Crash address: 0x0
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Process uptime: not available
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Thread 54 (crashed)
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 0 libmozglue.so!mozalloc_abort [mozalloc_abort.cpp:95dfa337c1dbb77e210abc30790ccb49ff7e163b : 33 + 0x10]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r0 = 0x00000000 r1 = 0x00000021 r2 = 0x00430000 r3 = 0xe65b43bc
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0xb447e458 r5 = 0xb447e458 r6 = 0x00000004 r7 = 0xb447e450
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 r12 = 0xe9767d5c
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - fp = 0x00000001 sp = 0xb447e448 lr = 0xe65b405d pc = 0xcb24ff44
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: given as instruction pointer in context
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 1 libmozglue.so!mozalloc_handle_oom(unsigned int) [mozalloc_oom.cpp:95dfa337c1dbb77e210abc30790ccb49ff7e163b : 51 + 0x3]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0x00000001 r5 = 0xb447e458 r6 = 0x00000004 r7 = 0xb447e498
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e458 lr = 0xcb2500c1 pc = 0xcb2500c1
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 2 libxul.so!gkrust_shared::oom_hook::hook [lib.rs:95dfa337c1dbb77e210abc30790ccb49ff7e163b : 271 + 0x3]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0x77c00000 r5 = 0x15000000 r6 = 0x00000004 r7 = 0xb447e4a0
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e4a0 lr = 0xc8fda3e1 pc = 0xc8fda3e1
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 3 libxul.so!rust_oom [alloc.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 216 + 0x1]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0x77c00000 r5 = 0x15000000 r6 = 0x00000004 r7 = 0xb447e5c8
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e4a8 pc = 0xc95c2259
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 4 libxul.so!alloc::alloc::handle_alloc_error [alloc.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 248 + 0x3]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0x77c00000 r5 = 0x15000000 r6 = 0x00000004 r7 = 0xb447e5c8
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e4b0 pc = 0xc95c7e57
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 5 libxul.so!<webrender_bindings::moz2d_renderer::Moz2dBlobRasterizer as webrender_api::image::AsyncBlobImageRasterizer>::rasterize [moz2d_renderer.rs:95dfa337c1dbb77e210abc30790ccb49ff7e163b : 528 + 0x1b]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0x77c00000 r5 = 0x15000000 r6 = 0x00000004 r7 = 0xb447e5c8
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xb447e5d8 r9 = 0x03c00000 r10 = 0x00400000 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e4b8 pc = 0xc9138497
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 6 libxul.so!webrender::scene_builder_thread::Transaction::rasterize_blobs [scene_builder_thread.rs:95dfa337c1dbb77e210abc30790ccb49ff7e163b : 73 + 0x3]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0xa5dfd6d0 r5 = 0xc91380e1 r6 = 0x00000001 r7 = 0xb447e610
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xa5dfd6d0 r9 = 0xb1b7541c r10 = 0x00000001 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e5d0 pc = 0xc9192cdd
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - 7 libxul.so!std::sys_common::backtrace::__rust_begin_short_backtrace [backtrace.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 77 + 0xab]
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r4 = 0xb447e680 r5 = 0xb447e730 r6 = 0xb447e7e0 r7 = 0xb447e8b0
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - r8 = 0xa5dfd6d0 r9 = 0xb1b7541c r10 = 0x00000001 fp = 0x00000001
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - sp = 0xb447e618 pc = 0xc92820d9
[task 2019-11-05T09:55:52.584Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 8 libxul.so!core::ops::function::FnOnce::call_once{{vtable.shim}} [function.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 235 + 0x57]
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r4 = 0xb447e900 r5 = 0xb447e8c0 r6 = 0x00000000 r7 = 0xb447e8f8
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r8 = 0xb48295e0 r9 = 0xca27dff0 r10 = 0xc95c2e25 fp = 0x00000002
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e8b8 pc = 0xc9281fb3
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 9 libxul.so!<alloc::boxed::Box<F> as core::ops::function::FnOnce<A>>::call_once [boxed.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 787 + 0x29]
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r4 = 0x0000002c r5 = 0xb447e900 r6 = 0xb447e930 r7 = 0xb447e940
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r8 = 0xb48295e0 r9 = 0xca27dff0 r10 = 0xc95c2e25 fp = 0x00000002
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e900 pc = 0xc95c163d
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 10 libxul.so!std::sys::unix::thread::Thread::new::thread_start [thread.rs:625451e376bb2e5283fc4741caa0a3e8a2ca4d54 : 79 + 0x7]
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r4 = 0xb6aef9d0 r5 = 0xb447e970 r6 = 0xb447e970 r7 = 0x00000078
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r8 = 0x00001831 r9 = 0x0000186f r10 = 0xc95c2e25 fp = 0x00000002
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e950 pc = 0xc95c2e31
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 11 libc.so + 0x47947
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r4 = 0xb447e970 r5 = 0xb447e970 r6 = 0xb447e970 r7 = 0x00000078
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - r8 = 0x00001831 r9 = 0x0000186f r10 = 0xc95c2e25 fp = 0x00000002
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e958 pc = 0xe971d949
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: call frame info
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 12 libc.so + 0x4792f
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e95c pc = 0xe971d931
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: stack scanning
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 13 libc.so + 0x1b381
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e960 pc = 0xe96f1383
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: stack scanning
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 14 libc.so + 0x4792f
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e968 pc = 0xe971d931
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: stack scanning
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - 15 libxul.so!std::sys::unix::thread::Thread::new + 0x1b3
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - sp = 0xb447e9a4 pc = 0xc95c2e25
[task 2019-11-05T09:55:52.592Z] 09:55:52 INFO - Found by: stack scanning
Updated•5 years ago
|
Updated•5 years ago
|
Comment 1•5 years ago
|
||
This appears to be an OOM in WebRender.
Comment hidden (Intermittent Failures Robot) |
Comment 3•5 years ago
|
||
It looks like we are hitting < 1% of memory free right from the start of the crashtest. I don't see any process dump in the resource usage json to explore what is holding onto all that memory, as it may not be us if it starts bad.
Comment hidden (Intermittent Failures Robot) |
Assignee | ||
Comment 5•5 years ago
|
||
Updated•5 years ago
|
Assignee | ||
Updated•5 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment hidden (Intermittent Failures Robot) |
Comment 8•5 years ago
|
||
This had a spike between Nov 4th and 17th.
Aryx is the disable here still needed? If so, can you add the checking tag?
Comment 9•5 years ago
|
||
I don't think the disable will help: there are quite a few bugs recently for OOM during the crashtests on pixel2+webrender. Different tests during which we crash, or different functions in which we crash, but presumably just the same root cause. Disabling this test might just cause another to increase.
Comment 10•5 years ago
|
||
Thank you.
Comment hidden (Intermittent Failures Robot) |
Comment 12•5 years ago
|
||
The priority flag is not set for this bug.
:jbonisteel, could you have a look please?
For more information, please visit auto_nag documentation.
Comment hidden (Intermittent Failures Robot) |
Updated•5 years ago
|
Comment hidden (Intermittent Failures Robot) |
Comment 15•5 years ago
|
||
No failures since Dec 6th, Fixed by bug 1594446
Updated•5 years ago
|
Updated•5 years ago
|
Updated•3 years ago
|
Description
•