Closed Bug 1339843 Opened 8 years ago Closed 7 years ago

consider adjusting SETA to detemine high value jobs as jobs which don't necessarily catch every regression

Categories

(Tree Management Graveyard :: Treeherder: SETA, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: jmaher, Unassigned)

References

Details

there are many cases where we have a single test job that only catches a single regression. While this served its purpose, we could greatly reduce the number of jobs we mark high value if we ignore single instances. Many jobs are responsible for catching 2,3,4,5+ regressions- those are super high value.
this reduces the jobs from 160->82, so cut in half. That gives us 83% of historical failures detected, most likely this will cause a few more misses, but we guarantee that every 5th push we will run all the jobs. Not sure if this is worth pursuing, but it would be low cost, maybe there are other ways to skin this cat.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
Product: Tree Management → Tree Management Graveyard
You need to log in before you can comment on or make changes to this bug.