Summary

In similar vein to other chunking review, mochitest-devtools has some very short runtime chunks scattered throughout the platforms.

Data

Comparing some platforms:

linux64/opt

• longest: 27min
• shortest: 10 min
• time until suite-start: 0:04:13

windows7/opt

• longest: 19 min
• shortest: 15 min
• time until suite-start: 0:07:39

macosx64-shippable/opt

• longest: 23min
• shortest: 9min
• time until suite-start: 0:02:36

All examples are taken from baseline run:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&resultStatus=pending%2Crunning%2Csuperseded%2Cusercancel%2Cretry%2Csuccess%2Ctestfailed%2Cbusted%2Cexception&classifiedState=unclassified&tier=1%2C2%2C3&group_state=expanded&revision=e8aebe488b2f2e567940577de25013d00e818f7c&searchStr=devtools&selectedJob=243359778

Thoughts

For opt, similar approach to xpcshell-test, just with more chunks can be taken. Ideally, halve chunks from 8 to 4.

ccov can be left alone.

debug can be reduced by 1 or 2 chunks. Do not anticipate further reductions.

https://hg.mozilla.org/mozilla-central/rev/d9cf7d539c45

Failures http://tinyurl.com/y6hwkqrh

Backed out changeset d9cf7d539c45 (bug 1549619) for turning Bug1443043 into permafail

Backout revision https://hg.mozilla.org/integration/autoland/rev/8e2e62921fad44be81b7026d0ca7f76bbca423db

Failed push https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=os%2Cx%2C10.10%2Cdebug%2Cmochitests%2Ctest-macosx64%2Fdebug-mochitest-devtools-chrome-e10s-5%2Cm%28dt5%29&revision=d9cf7d539c45e2895193e507840bf1bdec6cb21b

Log failure https://treeherder.mozilla.org/logviewer.html#?job_id=245501901&repo=autoland

@Edwin can you please take a look?

Have an updated patch that should take care of the macosx64/debug failure, pending try run conclusion.

Try:
https://treeherder.mozilla.org/#/jobs?repo=try&group_state=expanded&revision=efd822ec7ddaac810271c7aa103285cdc7eb32a7

macosx64/debug appears to run in 8 chunks (as expected) and does not time out.

https://hg.mozilla.org/mozilla-central/rev/2ec342f2be77