We need to start running mochitests on B2G desktop builds (opt and debug) We can run all tests on the linux64 builds, and perhaps some subset on other platforms. jgriffin mentioned perhaps skipping domlevel0/2 on mac/windows. Debug builds are being stood up in bug 916111, but we can get started on testing the opt builds now.

I'll look into the mozharness side of things. I'll file new bugs to actually schedule tests when the mozharness script is done.

Ahal, how is that mozharness script going? I'd love to be able to land the script and run mochitests by next week on cedar. It'd be really nice to establish a good cadence of these moving forward since there are so many to do this quarter.

(In reply to Clint Talbert ( :ctalbert ) from comment #2) > Ahal, how is that mozharness script going? I'd love to be able to land the > script and run mochitests by next week on cedar. It'd be really nice to > establish a good cadence of these moving forward since there are so many to > do this quarter. Yep, the script is mostly finished, just doing some local testing and it should be ready for cedar and ash soon. In the meantime I filed bug 920354 to get the ball rolling for when this is done.

I think the mozharness script is more or less correct, but the b2g desktop runs are failing with the "TypeError: Container is null" message [1] when running with a tinderbox official build. If I point the exact same set up that the mozharness script creates at a local build, it works fine. For the record the local mozconfig I used is [2] and the official one is [3] (I think). I believe the problem is that the b2g desktop builds don't have tests enabled. Anyway, I'm almost certain this won't be the only issue. But this patch works locally (aside from the above error) so I think we should get it reviewed and landed and then tackle any other errors we come across in follow up patches. [1] http://pastebin.mozilla.org/3152269 [2] http://pastebin.mozilla.org/3152271 [3] http://mxr.mozilla.org/mozilla-central/source/b2g/config/mozconfigs/linux64_gecko/nightly

Comment on attachment 810744 [details] [diff] [review] Patch 1.0 - create b2g desktop mochitest mozharness script From pyflakes: scripts/b2g_desktop_unittest.py:14: 'TarErrorList' imported but unused scripts/b2g_desktop_unittest.py:21: 'LogcatErrorList' imported but unused > Anyway, I'm almost certain this won't be the only issue. But this patch > works locally (aside from the above error) so I think we should get it > reviewed and landed and then tackle any other errors we come across in > follow up patches. WFM.

Fixed imports and merged to production: https://hg.mozilla.org/build/mozharness/rev/506407a6e8ee

Progress update: This landed and is scheduled on cedar and ash. There's a problem with how utilityPath is being passed in which I am debugging on ash.