https://bugzilla.mozilla.org/show_bug.cgi?id=1033126#c13 explains the situation. I'm investigating the performance issue with structured logging, but it seems like we're going to need to chunk these sooner or later.

It looks like this needs something in mozharness as well, and I guess we should distinguish between debug and opt. Who needs to sign off on this sort of thing?

Comment on attachment 8472439 [details] [diff] [review] Enable xpcshell tests on the b2g emulator in 4 chunks Review of attachment 8472439 [details] [diff] [review]: ----------------------------------------------------------------- Releng needs to review the buildbot-config patches, otherwise the sheriffs should be consulted too. I think this looks right, but it's been awhile since I've modified this file. Maybe rail would be a good person to ask for review?

TBPL should Just Work (the chunking support is generic), so this shouldn't cause any issues on our end. I assume these'll be enabled on Cedar first, so we can always fix up any issues that do arise then.

Hi rail, I'm trying to add chunking to debug xpcshell tests on b2g ics emulators. Please feel free to redirect review to someone more appropriate. My main question right now is whether there's a mozharness change to be made as well, and if so where to make it. Thank you.

Comment on attachment 8472491 [details] [diff] [review] Enable xpcshell tests on the b2g emulator in 4 chunks Review of attachment 8472491 [details] [diff] [review]: ----------------------------------------------------------------- LGTM, except a nit: ::: mozilla-tests/b2g_config.py @@ +732,5 @@ > 'brand_name': 'Gecko', > 'builds_before_reboot': 1, > 'unittest-env': {'DISPLAY': ':0'}, > 'enable_opt_unittests': True, > + 'enable_debug_unittests': True, This hunk is redundant, it adds trailing spaces only.

This gets rid of whitespace changes and enables the chunking on cedar only. r=rail

Cedar only version: https://hg.mozilla.org/build/buildbot-configs/rev/ad66388f3636

Four chunks adds too much setup overhead (an additional hour across all four chunks combined). But ~100 minute chunks is still too long. RyanVM wants us to at least split it into two chunks across all branches.

Comment on attachment 8479189 [details] [diff] [review] Enable 2 chunk debug xpcshell across all branches https://hg.mozilla.org/build/buildbot-configs/rev/61b8ce3541cf

https://hg.mozilla.org/build/buildbot-configs/rev/61b8ce3541cf is in production

https://tbpl.mozilla.org/php/getParsedLog.php?id=46916851&tree=Mozilla-B2g28-v1.3 21:47:59 INFO - Calling ['/builds/slave/test/build/venv/bin/python', 'runtestsb2g.py', '--adbpath=/builds/slave/test/build/emulator/b2g-distro/out/host/linux-x86/bin/adb', '--b2gpath=/builds/slave/test/build/emulator/b2g-distro', '--emulator=arm', '--logcat-dir=/builds/slave/test/build', '--manifest=tests/xpcshell_b2g.ini', '--use-device-libs', '--testing-modules-dir=/builds/slave/test/build/tests/modules', '--symbols-path=/builds/slave/test/build/symbols', '--busybox=/builds/slave/test/build/busybox', '--total-chunks=2', '--this-chunk=1'] with output_timeout 1000 21:47:59 INFO - /builds/slave/test/build/venv/local/lib/python2.7/site-packages/mozrunner/utils.py:20: UserWarning: Module mozinfo was already imported from /builds/slave/test/build/tests/xpcshell/mozinfo.py, but /builds/slave/test/build/venv/lib/python2.7/site-packages is being added to sys.path 21:47:59 INFO - import pkg_resources 21:52:52 INFO - Cleaning files from previous run.. 21:53:54 INFO - Included file '/builds/slave/test/build/tests/xpcshell/tests/toolkit/devtools/debugger/tests/unit/xpcshell.ini' does not exist 21:53:54 INFO - Traceback (most recent call last): 21:53:54 INFO - File "runtestsb2g.py", line 205, in main 21:53:54 INFO - **options.__dict__): 21:53:54 INFO - File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 1294, in runTests 21:53:54 INFO - self.buildTestList() 21:53:54 INFO - File "/builds/slave/test/build/tests/xpcshell/remotexpcshelltests.py", line 426, in buildTestList 21:53:54 INFO - xpcshell.XPCShellTests.buildTestList(self) 21:53:54 INFO - File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 777, in buildTestList 21:53:54 INFO - self.chunkTests() 21:53:54 INFO - File "/builds/slave/test/build/tests/xpcshell/runxpcshelltests.py", line 786, in chunkTests 21:53:54 INFO - totalTests += len(self.alltests[dir]) 21:53:54 INFO - TypeError: list indices must be integers, not dict