Bug 1010675 just added 12 new reftests, which changed the chunking of reftests, which introduced a new intermittent failure that causes a timeout that makes an entire chunk (reftest-14) of the B2G emulator reftests not run: 13:24:11 WARNING - TEST-UNEXPECTED-FAIL | http://10.0.2.2:8888/tests/layout/reftests/marquee/336736-1b.html | application timed out after 330 seconds with no output We don't have good diagnostics since it's not the reftest harness timing things out, but the automation above that.

Disabled the new tests: https://hg.mozilla.org/integration/mozilla-inbound/rev/c30bce033d92

Two of the logs appear to be more informative than the rest: https://treeherder.mozilla.org/logviewer.html#?job_id=7868521&repo=mozilla-inbound https://treeherder.mozilla.org/logviewer.html#?job_id=7868438&repo=mozilla-inbound

Another more-useful log: https://treeherder.mozilla.org/logviewer.html#?job_id=7868422&repo=mozilla-inbound

Of the interesting logs, three of the stacks are: 13:30:14 INFO - 0 libc.so!__futex_syscall3 + 0xc 13:30:14 INFO - r4 = 0x46f88de4 r5 = 0x46dfafb0 r6 = 0xfffffff8 r7 = 0x000000f0 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef14368 lr = 0x4007056c pc = 0x4006b5a8 13:30:14 INFO - Found by: given as instruction pointer in context 13:30:14 INFO - 1 libc.so!__pthread_cond_timedwait_relative [pthread.c : 1477 + 0x16] 13:30:14 INFO - r4 = 0x46f88de4 r5 = 0x46dfafb0 r6 = 0xfffffff8 r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef14370 pc = 0x4007056c 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 2 libc.so!__pthread_cond_timedwait [pthread.c : 1500 + 0xa] 13:30:14 INFO - r4 = 0x46dfafb0 r5 = 0x46f88de4 r6 = 0xffffffff r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef14388 pc = 0x40070620 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 3 libmozglue.so!__wrap_pthread_cond_wait [Nuwa.cpp:fd0834bbfd3c : 1147 + 0x7] 13:30:14 INFO - r4 = 0x00000000 r5 = 0x00000000 r6 = 0xffffffff r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef143a0 pc = 0x4002a265 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 4 libnss3.so!PR_WaitCondVar [ptsynch.c:fd0834bbfd3c : 385 + 0x7] 13:30:14 INFO - r4 = 0x46f88de0 r5 = 0x40247080 r6 = 0xffffffff r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef143c8 pc = 0x40714c41 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 5 libxul.so!mozilla::Monitor::Wait [CondVar.h : 79 + 0x7] 13:30:14 INFO - r4 = 0x46f88dd0 r5 = 0xffffffff r6 = 0x000595c8 r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef143d8 pc = 0x40ae27eb 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 6 libxul.so!mozilla::ipc::MessageChannel::WaitForSyncNotify [MessageChannel.cpp:fd0834bbfd3c : 1425 + 0x5] 13:30:14 INFO - r4 = 0xffffffff r5 = 0x48a3a170 r6 = 0x000595c8 r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef143e8 pc = 0x40c387dd 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 7 libxul.so!mozilla::ipc::MessageChannel::Send [MessageChannel.cpp:fd0834bbfd3c : 823 + 0x5] 13:30:14 INFO - r4 = 0x00000000 r5 = 0xfffffffc r6 = 0x48a3a170 r7 = 0x00000000 13:30:14 INFO - r8 = 0xbef14414 r9 = 0xfffffffc r10 = 0x00000000 fp = 0xbef1445c 13:30:14 INFO - sp = 0xbef143f8 pc = 0x40c3d91b 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 8 libxul.so!mozilla::layers::PCompositorChild::SendMakeSnapshot [PCompositorChild.cpp : 320 + 0xb] 13:30:14 INFO - r4 = 0x44e94e00 r5 = 0x48a3a140 r6 = 0xbef1445c r7 = 0xbef14450 13:30:14 INFO - r8 = 0x00320012 r9 = 0xbef14510 r10 = 0x00000000 fp = 0x463109a0 13:30:14 INFO - sp = 0xbef14448 pc = 0x40d016e3 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 9 libxul.so!mozilla::layers::ClientLayerManager::MakeSnapshotIfRequired [ClientLayerManager.cpp:fd0834bbfd3c : 482 + 0x9] 13:30:14 INFO - r4 = 0xbef14528 r5 = 0x48334140 r6 = 0xbef144b0 r7 = 0xbef144a0 13:30:14 INFO - r8 = 0x48a3a140 r9 = 0xbef14510 r10 = 0x00000000 fp = 0x463109a0 13:30:14 INFO - sp = 0xbef14490 pc = 0x40e76ce9 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 10 libxul.so!mozilla::layers::ClientLayerManager::EndTransaction [ClientLayerManager.cpp:fd0834bbfd3c : 325 + 0x5] 13:30:14 INFO - r4 = 0x48334140 r5 = 0x00000000 r6 = 0xbef14880 r7 = 0x416498e1 13:30:14 INFO - r8 = 0x00000000 r9 = 0x00000000 r10 = 0x4711b6e0 fp = 0x463109a0 13:30:14 INFO - sp = 0xbef14580 pc = 0x40e78a77 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 11 libxul.so!nsDisplayList::PaintRoot [nsDisplayList.cpp:fd0834bbfd3c : 1763 + 0xf] 13:30:14 INFO - r4 = 0xbef14640 r5 = 0xbef14880 r6 = 0x44567970 r7 = 0xbef145f4 13:30:14 INFO - r8 = 0x00000000 r9 = 0x00000000 r10 = 0x4711b6e0 fp = 0x463109a0 13:30:14 INFO - sp = 0xbef14598 pc = 0x4166cec5 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 12 libxul.so!nsLayoutUtils::PaintFrame [nsLayoutUtils.cpp:fd0834bbfd3c : 3275 + 0x13] 13:30:14 INFO - r4 = 0x463432e8 r5 = 0xbef147c0 r6 = 0xbef1480c r7 = 0x00000000 13:30:14 INFO - r8 = 0x3747402f r9 = 0x00000055 r10 = 0x00000000 fp = 0xbef14850 13:30:14 INFO - sp = 0xbef14768 pc = 0x4168a0c7 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 13 libxul.so!PresShell::RenderDocument [nsPresShell.cpp:fd0834bbfd3c : 4933 + 0x17] 13:30:14 INFO - r4 = 0x4545afa0 r5 = 0x40293940 r6 = 0xbef14d18 r7 = 0x30000000 13:30:14 INFO - r8 = 0xffffffff r9 = 0x463432e8 r10 = 0xbef14dc8 fp = 0x0000000e 13:30:14 INFO - sp = 0xbef14c98 pc = 0x4168a5fb 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 14 libxul.so!mozilla::dom::CanvasRenderingContext2D::DrawWindow [CanvasRenderingContext2D.cpp:fd0834bbfd3c : 4666 + 0x11] 13:30:14 INFO - r4 = 0xbef14e00 r5 = 0x445b2c00 r6 = 0xbef14ee0 r7 = 0xbef14da0 13:30:14 INFO - r8 = 0xbef14da8 r9 = 0xbef14db0 r10 = 0x0000000c fp = 0x4541dbe0 13:30:14 INFO - sp = 0xbef14d78 pc = 0x412c1ba1 13:30:14 INFO - Found by: call frame info 13:30:14 INFO - 15 libxul.so!mozilla::dom::CanvasRenderingContext2DBinding::drawWindow [CanvasRenderingContext2DBinding.cpp : 5181 + 0x17] 13:30:14 INFO - r4 = 0xbef14ef4 r5 = 0x00000000 r6 = 0x402ca0e0 r7 = 0xbef14fb4 13:30:14 INFO - r8 = 0x00000001 r9 = 0x44575370 r10 = 0x445b2c00 fp = 0xbef14ee0 13:30:14 INFO - sp = 0xbef14e90 pc = 0x4113da49 13:30:14 INFO - Found by: call frame info and the remaining one is: 13:25:29 INFO - 0 libc.so!read + 0xc 13:25:29 INFO - r4 = 0xbecdbc30 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x00000003 13:25:29 INFO - r8 = 0xbecdbc30 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbb88 lr = 0x42e40305 pc = 0x4006a434 13:25:29 INFO - Found by: given as instruction pointer in context 13:25:29 INFO - 1 libOpenglSystemCommon.so!QemuPipeStream::readFully(void*, unsigned int) [QemuPipeStream.cpp : 125 + 0xb] 13:25:29 INFO - r4 = 0xbecdbc30 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x4023e100 13:25:29 INFO - r8 = 0xbecdbc30 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbb90 pc = 0x42e40305 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 2 libGLESv2_enc.so!IOStream::readback(void*, unsigned int) [IOStream.h : 83 + 0xb] 13:25:29 INFO - r4 = 0x4023e100 r5 = 0x00000004 r6 = 0xbecdbc30 r7 = 0x42f00225 13:25:29 INFO - r8 = 0xbecdbc30 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbbb0 pc = 0x42e55599 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 3 libGLESv2_enc.so!glGenTextures_enc [gl2_enc.cpp : 924 + 0x9] 13:25:29 INFO - r4 = 0x00000004 r5 = 0x00000004 r6 = 0x4023e100 r7 = 0x42f00225 13:25:29 INFO - r8 = 0xbecdbc30 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbbc0 pc = 0x42e58285 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 4 libGLESv2_emulation.so!glGenTextures [gl2_entry.cpp : 555 + 0x9] 13:25:29 INFO - r4 = 0x00000001 r5 = 0xbecdbc30 r6 = 0xbecdbc18 r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbbe8 pc = 0x4801eced 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 5 libxul.so!mozilla::gl::GLContext::fGenTextures [GLContext.h:bda9c6920e56 : 2168 + 0x9] 13:25:29 INFO - r4 = 0x44dbf800 r5 = 0xbecdbcb8 r6 = 0xbecdbc18 r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbbf8 pc = 0x40e4b52f 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 6 libxul.so!GrGpuGL::onCreateTexture [GrGpuGL.cpp:bda9c6920e56 : 1020 + 0xb] 13:25:29 INFO - r4 = 0x44dbf800 r5 = 0xbecdbcb8 r6 = 0xbecdbc18 r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0x00000000 r10 = 0x00000001 fp = 0x00000000 13:25:29 INFO - sp = 0xbecdbc00 pc = 0x41b07c73 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 7 libxul.so!GrGpu::createTexture [GrGpu.cpp:bda9c6920e56 : 136 + 0xf] 13:25:29 INFO - r4 = 0x44dbf800 r5 = 0xbecdbcb8 r6 = 0x41b07baf r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0xbecdbd40 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbca0 pc = 0x41ae298d 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 8 libxul.so!GrContext::createUncachedTexture [GrContext.cpp:bda9c6920e56 : 591 + 0x9] 13:25:29 INFO - r4 = 0xbecdbcc8 r5 = 0xbecdbcf8 r6 = 0x00000000 r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0xbecdbd40 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbcb8 pc = 0x41ae2d23 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 9 libxul.so!mozilla::gfx::DrawTargetSkia::InitWithGrContext [DrawTargetSkia.cpp:bda9c6920e56 : 813 + 0x5] 13:25:29 INFO - r4 = 0x45419040 r5 = 0x44e3db30 r6 = 0xbecdbd40 r7 = 0x00000000 13:25:29 INFO - r8 = 0x00000000 r9 = 0xbecdbd40 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbce8 pc = 0x40e23be3 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 10 libxul.so!mozilla::gfx::Factory::CreateDrawTargetSkiaWithGrContext [Factory.cpp:bda9c6920e56 : 743 + 0xd] 13:25:29 INFO - r4 = 0xbecdbd48 r5 = 0xbecdbd1c r6 = 0x40e23b71 r7 = 0x44e3db30 13:25:29 INFO - r8 = 0x00000000 r9 = 0xbecdbd40 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbd18 pc = 0x40e2a7a1 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 11 libxul.so!mozilla::dom::CanvasRenderingContext2D::EnsureTarget [CanvasRenderingContext2D.cpp:bda9c6920e56 : 1359 + 0xb] 13:25:29 INFO - r4 = 0x44561c00 r5 = 0xbecdbd48 r6 = 0x00000001 r7 = 0x488ec250 13:25:29 INFO - r8 = 0x0000000d r9 = 0x00000000 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbd40 pc = 0x412bb89b 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 12 libxul.so!mozilla::dom::CanvasRenderingContext2D::DrawWindow [CanvasRenderingContext2D.cpp:bda9c6920e56 : 4576 + 0x7] 13:25:29 INFO - r4 = 0xbecdbe00 r5 = 0x44561c00 r6 = 0xbecdbee0 r7 = 0x44575370 13:25:29 INFO - r8 = 0x0000000d r9 = 0x44575370 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbd78 pc = 0x412c1903 13:25:29 INFO - Found by: call frame info 13:25:29 INFO - 13 libxul.so!mozilla::dom::CanvasRenderingContext2DBinding::drawWindow [CanvasRenderingContext2DBinding.cpp : 5181 + 0x17] 13:25:29 INFO - r4 = 0xbecdbef4 r5 = 0x00000000 r6 = 0x402ca0e0 r7 = 0xbecdbfb4 13:25:29 INFO - r8 = 0x00000001 r9 = 0x44575370 r10 = 0x44561c00 fp = 0xbecdbee0 13:25:29 INFO - sp = 0xbecdbe90 pc = 0x4113da81 13:25:29 INFO - Found by: call frame info They're all SIGABRT.

Oh, but in the three crashes that showed up with __futex_syscall3 on the PROCESS-CRASH line (the three crashes with the first main thread stack in the previous comment), the Compositor thread stack was: 14:29:05 INFO - Thread 25 14:29:05 INFO - 0 libc.so!read + 0xc 14:29:05 INFO - r4 = 0x45dffa14 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x00000003 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dff9d0 lr = 0x42e4c305 pc = 0x4006a434 14:29:05 INFO - Found by: given as instruction pointer in context 14:29:05 INFO - 1 libOpenglSystemCommon.so!QemuPipeStream::readFully(void*, unsigned int) [QemuPipeStream.cpp : 125 + 0xb] 14:29:05 INFO - r4 = 0x45dffa14 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x4734c760 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dff9d8 pc = 0x42e4c305 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 2 lib_renderControl_enc.so!IOStream::readback(void*, unsigned int) [IOStream.h : 83 + 0xb] 14:29:05 INFO - r4 = 0x4734c760 r5 = 0x00000004 r6 = 0x45dffa14 r7 = 0x46993880 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dff9f8 pc = 0x42e4f635 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 3 lib_renderControl_enc.so!rcFlushWindowColorBuffer_enc [renderControl_enc.cpp : 347 + 0x9] 14:29:05 INFO - r4 = 0x00000004 r5 = 0x4734c760 r6 = 0x494016f0 r7 = 0x46993880 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffa08 pc = 0x42e4fc89 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 4 libEGL_emulation.so!egl_window_surface_t::swapBuffers() [egl.cpp : 317 + 0x5] 14:29:05 INFO - r4 = 0x47779b70 r5 = 0x46993880 r6 = 0x4537e7c4 r7 = 0x46993880 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffa30 pc = 0x45378e69 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 5 libEGL_emulation.so!eglSwapBuffers [egl.cpp : 1109 + 0x7] 14:29:05 INFO - r4 = 0x46f14dc0 r5 = 0x47779b70 r6 = 0x4537e7c4 r7 = 0x46993880 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffa50 pc = 0x45379393 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 6 libEGL.so!eglSwapBuffers [eglApi.cpp : 941 + 0xf] 14:29:05 INFO - r4 = 0x00000001 r5 = 0x469938b0 r6 = 0x40371040 r7 = 0x44d79534 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffa78 pc = 0x4035abcb 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 7 b2g!mozilla::GonkDisplayICS::SwapBuffers [GonkDisplayICS.cpp:7ff3c70a5ad2 : 190 + 0x7] 14:29:05 INFO - r4 = 0x4023e180 r5 = 0x469938b0 r6 = 0x00000001 r7 = 0x44d79534 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffa90 pc = 0x0001852f 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 8 libxul.so!mozilla::gl::GLContextEGL::SwapBuffers [GLContextProviderEGL.cpp:7ff3c70a5ad2 : 468 + 0x15] 14:29:05 INFO - r4 = 0x456d7800 r5 = 0x45dffaac r6 = 0x00000000 r7 = 0x44d79534 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffaa0 pc = 0x40e4aeff 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 9 libxul.so!mozilla::layers::CompositorOGL::EndFrame [CompositorOGL.cpp:7ff3c70a5ad2 : 1256 + 0x5] 14:29:05 INFO - r4 = 0x44d79480 r5 = 0x45dffaac r6 = 0x00000000 r7 = 0x44d79534 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffaa8 pc = 0x40e9c38b 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 10 libxul.so!mozilla::layers::LayerManagerComposite::Render [LayerManagerComposite.cpp:7ff3c70a5ad2 : 764 + 0x5] 14:29:05 INFO - r4 = 0x46dee2f0 r5 = 0x45dffb78 r6 = 0x00000000 r7 = 0x45dffb60 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dffae8 pc = 0x40e8ee03 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 11 libxul.so!mozilla::layers::LayerManagerComposite::EndTransaction [LayerManagerComposite.cpp:7ff3c70a5ad2 : 310 + 0x5] 14:29:05 INFO - r4 = 0x46dee2f0 r5 = 0x45dffc48 r6 = 0x44df0800 r7 = 0x40e73f25 14:29:05 INFO - r8 = 0x45dffcbc r9 = 0x00000000 r10 = 0x45dffcb0 fp = 0x00000000 14:29:05 INFO - sp = 0x45dffc40 pc = 0x40e8ef51 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 12 libxul.so!mozilla::layers::LayerManagerComposite::EndEmptyTransaction [LayerManagerComposite.cpp:7ff3c70a5ad2 : 257 + 0x9] 14:29:05 INFO - r4 = 0xda64fb3c r5 = 0x00000054 r6 = 0x48b10400 r7 = 0x45dffcb8 14:29:05 INFO - r8 = 0x45dffcbc r9 = 0x00000000 r10 = 0x45dffcb0 fp = 0x00000000 14:29:05 INFO - sp = 0x45dffca0 pc = 0x40e8efe1 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 13 libxul.so!mozilla::layers::CompositorParent::CompositeToTarget [CompositorParent.cpp:7ff3c70a5ad2 : 1020 + 0x7] 14:29:05 INFO - r4 = 0xda64fb3c r5 = 0x00000054 r6 = 0x48b10400 r7 = 0x45dffcb8 14:29:05 INFO - r8 = 0x45dffcbc r9 = 0x00000000 r10 = 0x45dffcb0 fp = 0x00000000 14:29:05 INFO - sp = 0x45dffca8 pc = 0x40e9694f 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 14 libxul.so!mozilla::layers::CompositorVsyncObserver::Composite [CompositorParent.cpp:7ff3c70a5ad2 : 337 + 0x7] 14:29:05 INFO - r4 = 0xda1e2b54 r5 = 0x00000054 r6 = 0x48310fc0 r7 = 0x00000000 14:29:05 INFO - r8 = 0x45dffd2c r9 = 0x4593fd90 r10 = 0x00100000 fp = 0x00000001 14:29:05 INFO - sp = 0x45dffd28 pc = 0x40e96acf 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 15 libxul.so!RunnableMethod<SoftwareDisplay, void (SoftwareDisplay::*)(mozilla::TimeStamp), Tuple1<mozilla::TimeStamp> >::Run [tuple.h:7ff3c70a5ad2 : 393 + 0x17] 14:29:05 INFO - r4 = 0x456c0880 r5 = 0x45dffdf8 r6 = 0x454a49f0 r7 = 0x00000001 14:29:05 INFO - r8 = 0x45dffe04 r9 = 0x4593fd90 r10 = 0x00100000 fp = 0x00000001 14:29:05 INFO - sp = 0x45dffd48 pc = 0x40e88601 14:29:05 INFO - Found by: call frame info 14:29:05 INFO - 16 libxul.so!MessageLoop::RunTask [message_loop.cc:7ff3c70a5ad2 : 361 + 0x5] 14:29:05 INFO - r4 = 0x456c0880 r5 = 0x45dffdf8 r6 = 0x454a49f0 r7 = 0x00000001 14:29:05 INFO - r8 = 0x45dffe04 r9 = 0x4593fd90 r10 = 0x00100000 fp = 0x00000001 14:29:05 INFO - sp = 0x45dffd50 pc = 0x40c2db75 14:29:05 INFO - Found by: call frame info ... which means all 4 of the instances where we have good stacks seem to be a hang with the top two frames being: 14:29:05 INFO - 0 libc.so!read + 0xc 14:29:05 INFO - r4 = 0x45dffa14 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x00000003 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dff9d0 lr = 0x42e4c305 pc = 0x4006a434 14:29:05 INFO - Found by: given as instruction pointer in context 14:29:05 INFO - 1 libOpenglSystemCommon.so!QemuPipeStream::readFully(void*, unsigned int) [QemuPipeStream.cpp : 125 + 0xb] 14:29:05 INFO - r4 = 0x45dffa14 r5 = 0x00000004 r6 = 0x00000004 r7 = 0x4734c760 14:29:05 INFO - r8 = 0x45dffb20 r9 = 0x45dffb18 r10 = 0x45dffb14 fp = 0x46dee308 14:29:05 INFO - sp = 0x45dff9d8 pc = 0x42e4c305 14:29:05 INFO - Found by: call frame info and the third frame being IOStream::readback (but in different libraries in the two patterns).

If this starts again because the chunking shifts again, one good way to fix would likely be to back out: https://hg.mozilla.org/integration/mozilla-inbound/rev/c30bce033d92 to shift the chunks further in the same direction.

I realize this bug is probably going to be a pain to debug if it's possible to debug at all, but having bugs that show up when reftests are added, causing other tests to move between chunks, is also a pain. Is there anybody who is actually familiar with this code (see comment 32 and comment 33 in particular, especially the end of comment 33).

(In reply to David Baron [:dbaron] ⏰UTC-7 from comment #35) > Is there anybody who is actually familiar with this code (see comment 32 and > comment 33 in particular, especially the end of comment 33). Looks like this code is in the Firefox OS display stack. Sotaro, do you know who might be familiar with it?

I do not know there is a person who knows ics emulator's internal. I am not sure there is a value to spend a time for ics emulator. Bug 1107678 is going to enable KK emulator.

I backed out the test disabling in: https://hg.mozilla.org/integration/mozilla-inbound/rev/9d7079578e3d

Probably worth revisiting with the KK emulator.