build a list of the open xpcshell bugs for unique test cases
Categories
(Testing :: General, task)
Tracking
(Not tracked)
People
(Reporter: jmaher, Unassigned)
References
(Blocks 1 open bug)
Details
in order to change from tracking test failures to failed test cases we need to create bugs for each test_case
and then take the existing bugs that reference failures to test_case
and mark those as dependencies.
this bug will identify a query/tool that will generate a list of unique test_path/test_name
so we can file bugs with it.
We do not need to be perfect here, just get the majority.
Initial criteria to use for the query:
- summary contains: test_
- keyword: intermittent-failure
- resolved: today-30 days || open
We will need to parse the summary a bit- if it doesn't contain a specific test (i.e. test_abc*.js
for multiple tests) we can harvest the filename.
Reporter | ||
Comment 1•3 years ago
|
||
I have a spreadsheet here:
https://docs.google.com/spreadsheets/d/1SnwIeI7HoLXMzaMzepZA_om1aIkgeOoXs6onlGEd2DU/edit#gid=790700025
here is some code that will help with this:
https://github.com/jmaher/randomtools/tree/master/simple
in all I need to create 85 bugs, which will then replace 117 existing bugs due to 32 bugs existing for >1 bug per testcase.
Reporter | ||
Updated•3 years ago
|
Description
•