linux ccov has tier 3 failing tasks
Categories
(Testing :: General, enhancement)
Tracking
(Not tracked)
People
(Reporter: egao, Unassigned)
References
Details
This also came up during the discussion with jmaher.
Currently on linux ccov on mozilla-central, we run tasks (mostly in the mochitest suite) that are tier 3 and have failures that are not sheriffed.
These tasks add no value unless they are tier 2. I think we should consider not running them if they won't be sheriffed anyway.
|
Reporter | |
Updated•5 years ago
|
|
||
Comment 1•5 years ago
|
||
I believe I checked on these last year and ccov folks wanted to keep the tasks running to generate coverage data even though tests were failing.
|
|
||
Comment 2•5 years ago
|
||
(There was a similar argument for failing tier 3 performance tests: Sometimes useful performance data could be collected from failed tasks.)
|
|
||
Updated•5 years ago
|
|
|
||
Comment 3•5 years ago
|
||
See also the review comments in bug 1596285 and especially bug 1596285 comment 8.
|
||
Comment 4•5 years ago
|
||
If we aren't going to disable tier 3 ccov jobs, then I suggest we focus on bug 1596285 and just green them up by disabling tests individually. We can either wontfix this one or dupe it to bug 1596285.
jmaher: Thoughts?
|
||
Comment 5•5 years ago
|
||
I like the idea of disabling/fixing until green.
Description
•