Closed Bug 1060641 Opened 10 years ago Closed 10 years ago

[titanic] Switch from TBPL's getBuildRevisions.php to treeherder's API

Categories

(Testing :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: gakiwate, Unassigned)

References

Details

Titanic (https://github.com/gakiwate/titanic/) is a tool to bisect test failures. Titanic takes revision under investigation - which can be supplied to it using the APIs or command line and then works by pulling data about the revision and revisions before it from TBPL(https://tbpl.mozilla.org/) to bisect the failure. One of the main features of TBPL that Titanic uses is the getRevisionBuilds feature. It basically lists out the status of any job given the revision and the branch in a JSON format. For example, for revision 'd26db5427e8a' in the branch 'mozilla-inbound' we can get all the jobs for all platforms and revisions at https://tbpl.mozilla.org/php/getRevisionBuilds.php?branch=mozilla-inbound&rev=d26db5427e8a It would be great to have something similar for Treeherder to query if something similar doesn't exist already.
The API docs are at: https://treeherder.mozilla.org/docs/ jeads/mdoglio/camd will be able to answer more specific questions.
OS: Mac OS X → All
Hardware: x86 → All
For an idea of some of the queries that might work, load https://treeherder.mozilla.org/ with the webconsole open and filter on "/api/". eg: * https://treeherder.mozilla.org/api/repository/ * https://treeherder.mozilla.org/api/project/mozilla-central/resultset/?count=10&format=json&full=true&with_jobs=false * https://treeherder.mozilla.org/api/project/mozilla-central/resultset/1/get_resultset_jobs/?format=json&result_set_ids=461 I think this bug as filed really belongs in Testing::General, since the feature exists in treeherder already, it just needs exploring as part of the ongoing titanic work. Should you need jeads/camd/mdoglio to answer questions/check the queries you're using are the most efficient then just needinfo them. And if the API proves to be inadequate, a separate bug filed in treeherder with the payload required would probably be best :-) This issue is also orthogonal to adding UI support in treeherder, since when TBPL is EOL'd this bug will be required for titantic to continue to function, even if treeherder isn't integrated with titanic yet.
Component: Treeherder → General
Product: Tree Management → Testing
Summary: [titanic] getBuildRevisions equivalent in Treeherder → [titanic] Work out Treeherder equivalent to TBPL's getBuildRevisions
Version: unspecified → Trunk
No longer blocks: 1060632
Making this bug about: > 1) Shorter term: Switch titanic over to using treeherder's API rather than TBPL's From bug 1060632 comment 1.
Blocks: 1044200
Summary: [titanic] Work out Treeherder equivalent to TBPL's getBuildRevisions → [titanic] Switch from TBPL's getBuildRevisions.php to treeherder's API
Blocks: tbpl-eol
If it helps, here is the diff for another tool switching from getBuildRevisions.php to Treeherder's API: https://github.com/mstange/analyze-tryserver-profiles/commit/e14dfa4a9a9ca17e0ca6e4d96e0208d37b271e1d
Thanks Ed. This actually really helps! This is awesome! :)
Just as a heads up, I'd provisionally like to see if we can switch TBPL off in January (though this is still a big unknown, and there are lots of other pieces that need to be finished before that point). Could someone start looking at this soon? (Or at least say that we needn't block on this bug?) :-)
I think we can unblock on this- we actually have Q1 work scheduled to expand on Titanic, but some of it will need to be reworked to sort out changing needs, etc.
No longer blocks: tbpl-eol
Great, thank you :-)
Note in the meantime you'll need to adjust the TBPL getRevisionBuilds.php call [1] due to bug 1114742. [1] https://github.com/gakiwate/titanic/blob/2aa8ebda001a3313700ab8bade44d841cad5600b/titanic.py#L207
we are using mozilla_ci_tools (https://github.com/armenzg/mozilla_ci_tools) which has taken a lot of titanic pieces and knowledge.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.