Closed Bug 817268 Opened 12 years ago Closed 12 years ago

Track down intermittent-failures that are missing from OrangeFactor

Categories

(Tree Management Graveyard :: OrangeFactor, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: emorley, Assigned: emorley)

References

Details

(Keywords: sheriffing-P1)

In the past myself/philor have stumbled across failure modes that are not recognised by OF (eg a starring something for weeks on TBPL and OF hasn't heard of it). I believe many of these to now be fixed as of bug 807114 and friends, since we no longer strictly limit OF to bugs containing [orange]. One of the arguments against doing away with the TBPLbot bugspam is that OF "often misses failures". I'd like to either prove this is no longer the case, or if it is, then make sure we fix it - so people can no longer use that argument (and also the bonus that OF is then more useful for me when prioritising bugs to chase). I'm going to export the last couple of weeks worth of change bugs from bugzilla and compare a scrape of the bug list in OF for the same timespan. Obviously, OF will be missing some bugs due to trees=All not covering Try etc; but it should be a good start.
Depends on: 812551
Depends on: 817275
Depends on: 807273
Depends on: 797811
Summary: Compare OrangeFactor reported failures against intermittent-failure bugs to see what is missing → Track down intermittent-failures that are missing from OrangeFactor
Depends on: 766084
Depends on: 676463
Depends on: 694170
I can't find any more cases that aren't already covered by the dependant bugs, so closing this out.
Status: ASSIGNED → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Depends on: 822857
Depends on: 823299
Depends on: 762972
Depends on: 690219
Keywords: sheriffing-P1
Product: Testing → Tree Management
Product: Tree Management → Tree Management Graveyard
You need to log in before you can comment on or make changes to this bug.