Annotate mochitests that fail with Fission enabled
Categories
(Testing :: Mochitest, task, P2)
Tracking
(Fission Milestone:M4, firefox70 fixed)
Tracking | Status | |
---|---|---|
firefox70 | --- | fixed |
People
(Reporter: kmag, Assigned: kmag)
References
(Blocks 1 open bug)
Details
Attachments
(1 file)
(deleted),
text/x-phabricator-request
|
Details |
This will allow us to enable running Fission mochitests on normal integration branches, and to see actual regressions from unexpected failures that would otherwise be lost in the noise.
The tests will be annotated with fail-if = fission
annotations, which will need to be removed as soon as a test starts passing with Fission enabled so that it can't regress.
Assignee | ||
Comment 1•5 years ago
|
||
My preference was to annotate most of the failing tests with fail-if
so that
if they start passing, the fail-if
needs to be removed and they need to keep
passing. That doesn't work for tests that timeout, or which trigger failures
from their cleanup functions, however, so those tests need skip-if. And tests
with fail in their cleanup functions likely leave the browser in an
inconsistent state for subsequent tests, anyway, so really should be skipped
regardless.
There are some remaining tests which still fail because of crashes. I chose
not to skip them here, but to fix the crashes in separate bugs instead.
Updated•5 years ago
|
Updated•5 years ago
|
Assignee | ||
Comment 2•5 years ago
|
||
Assignee | ||
Updated•5 years ago
|
Comment 3•5 years ago
|
||
bugherder |
Description
•