Closed
Bug 1443251
Opened 7 years ago
Closed 6 years ago
Remove Treeherder support for Buildbot
Categories
(Tree Management :: Treeherder: Data Ingestion, enhancement, P1)
Tree Management
Treeherder: Data Ingestion
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: emorley, Assigned: emorley)
References
Details
Attachments
(3 files)
The Buildbot to Taskcluster migration is getting closer to completion:
https://atlee.ca/blog/posts/migration-status-2.html
Pre-requisites before Treeherder can remove support:
* Last of release automation tasks migrated (bug 1397762)
* ESR52 (which still uses Buildbot) to be EOLed (currently ~August 2018: https://wiki.mozilla.org/RapidRelease/Calendar)
* Thunderbird/comm-central to have switched over to Taskcluster (bug 1384205)
* ...?
Comment 1•6 years ago
|
||
What do you think about removing the prompt for buildapi auth on all branches other than ESR52 ? Earlier than removing buildbot completely in September I mean.
Assignee | ||
Comment 2•6 years ago
|
||
Yeah I'd love to do that if everyone was fine with it. (Given that people can retrigger via buildapi's UI anyway, it seems fine to do)
Assignee | ||
Comment 3•6 years ago
|
||
Buildbot is being switched off over the next few days \o/
Assignee: nobody → emorley
Status: NEW → ASSIGNED
Priority: P3 → P1
Assignee | ||
Updated•6 years ago
|
Comment 4•6 years ago
|
||
Assignee | ||
Updated•6 years ago
|
Attachment #9007637 -
Flags: review?(cdawson)
Updated•6 years ago
|
Attachment #9007637 -
Flags: review?(cdawson) → review+
Comment 5•6 years ago
|
||
Commit pushed to master at https://github.com/mozilla/treeherder
https://github.com/mozilla/treeherder/commit/255f246960d4902d40df1ec42e986e2f4814b7a5
Bug 1443251 - Disable buildbot celerybeat tasks (#4007)
This will allow these celery queues to drain before we remove the code
that handles them. The runnable jobs task is also buildbot-specific,
since for taskcluster the jobs are calculated via the tasks graph
instead.
Assignee | ||
Comment 6•6 years ago
|
||
The change in comment 5 is now deployed to production, so I've reduced the dyno count of `worker_buildapi_{pending,running,4hr}` down to zero, for all of {prototype,stage,prod}.
This reduces the total monthly dynos credits the Treeherder uses on Heroku from 97 to 88.
Comment 7•6 years ago
|
||
Comment 8•6 years ago
|
||
Commit pushed to master at https://github.com/mozilla/treeherder
https://github.com/mozilla/treeherder/commit/ffaa2e4b2af200d3ae91e3e6ecdc2d4e4f093e84
Bug 1443251 - Remove runnable jobs support for buildbot (#4071)
Runnable jobs for buildbot were calculated via a celerybeat task
(that was disabled in #4007) and the results stored in the
`runnable_jobs` table. This can all be removed now that buildbot is
EOL, since the remaining support for Taskcluster runnable jobs does
not use that celery task/Django model.
Comment 9•6 years ago
|
||
Assignee | ||
Comment 10•6 years ago
|
||
Cleanup for future PRs includes:
* rewriting the tests to be more taskcluster-specific
* removing the collection classes from treeherder-client once the tests no longer use them
* Improving the "ingesting jobs locally" UX now that ingest_push doesn't work (since no buildbot jobs)
* refactoring `store_job_data()` now that it's only ever called with a list of jobs of size one
* simplifying or removing the log parser step handling
* SETA/runnable job cleanup
Comment 11•6 years ago
|
||
Commit pushed to master at https://github.com/mozilla/treeherder
https://github.com/mozilla/treeherder/commit/445766d958f552535445f08e353045be0a3939ba
Bug 1443251 - Remove support for buildbot job ingestion (#4087)
The buildapi celerybeat tasks were disabled previously in #4007, so
these tasks are unused.
Assignee | ||
Comment 12•6 years ago
|
||
With the changes so far, we've down from 12 types of dyno worker, to 8 \o/
Assignee | ||
Updated•6 years ago
|
No longer depends on: comm-taskcluster
Assignee | ||
Updated•6 years ago
|
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
You need to log in
before you can comment on or make changes to this bug.
Description
•