Closed Bug 1756897 Opened 3 years ago Closed 3 years ago

build a list of the open xpcshell bugs for unique test cases

Categories

(Testing :: General, task)

Default
task

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jmaher, Unassigned)

References

(Blocks 1 open bug)

Details

in order to change from tracking test failures to failed test cases we need to create bugs for each test_case and then take the existing bugs that reference failures to test_case and mark those as dependencies.

this bug will identify a query/tool that will generate a list of unique test_path/test_name so we can file bugs with it.

We do not need to be perfect here, just get the majority.

Initial criteria to use for the query:

  • summary contains: test_
  • keyword: intermittent-failure
  • resolved: today-30 days || open

We will need to parse the summary a bit- if it doesn't contain a specific test (i.e. test_abc*.js for multiple tests) we can harvest the filename.

Blocks: 1756898

I have a spreadsheet here:
https://docs.google.com/spreadsheets/d/1SnwIeI7HoLXMzaMzepZA_om1aIkgeOoXs6onlGEd2DU/edit#gid=790700025

here is some code that will help with this:
https://github.com/jmaher/randomtools/tree/master/simple

in all I need to create 85 bugs, which will then replace 117 existing bugs due to 32 bugs existing for >1 bug per testcase.

Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.