This test file takes about six minutes to run on my machine. This makes it a huge pain to bisect any regressions. It would be nice to break it up. This would have to happen upstream, naturally. I'm not quite sure how best to do it, is the thing. Artificially splitting the tests up into lots of different files seems awkward, but I don't see a better way.

This is fixed upstream, now syncing. Note: some platforms had test_runtest.html disabled due to timeouts/OOM (see blocking bugs), and this will no longer be the case. If any of the split-up tests are still too big, they'll have to be disabled separately.

Do you want to rubber-stamp this? It should in theory just be a sync to upstream followed by regenerating the failures. I looked over the local changes to the tests and synced them upstream as appropriate. https://treeherder.mozilla.org/#/jobs?repo=try&revision=20b59e2e3256

Where's upstream nowadays?

https://dvcs.w3.org/hg/editing/ is the one I used. I just deleted the GitHub one for now, because they had fallen out of sync and I didn't want to maintain both. Anne is interested in moving it to the WHATWG's GitHub, which I'm in favor of if we can get redirects set up. But until then, the W3C one is authoritative.

Comment on attachment 8644348 [details] [diff] [review] Patch Review of attachment 8644348 [details] [diff] [review]: ----------------------------------------------------------------- It looks like I needed to update dom/imptests/moz.build too for failures/editing/conformancetest/run/ to get picked up. New try push with that change: https://treeherder.mozilla.org/#/jobs?repo=try&revision=4fd2c1c25eba

Comment on attachment 8644348 [details] [diff] [review] Patch rs=me

Backed out for making imptests basically permafail on Android/B2G. https://treeherder.mozilla.org/logviewer.html#?job_id=12735486&repo=mozilla-inbound https://treeherder.mozilla.org/logviewer.html#?job_id=12749744&repo=mozilla-inbound https://treeherder.mozilla.org/logviewer.html#?job_id=12749364&repo=mozilla-inbound etc... https://hg.mozilla.org/integration/mozilla-inbound/rev/7dcecc8a395d

These tests are being deleted soon in favor of wpt anyway, so I'm not going to bother re-fixing this. Some of them will need to be disabled on Android/B2G when they get imported into wpt.