Closed Bug 1443251 Opened 7 years ago Closed 6 years ago

Remove Treeherder support for Buildbot

Categories

(Tree Management :: Treeherder: Data Ingestion, enhancement, P1)

enhancement

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: emorley, Assigned: emorley)

References

Details

Attachments

(3 files)

The Buildbot to Taskcluster migration is getting closer to completion: https://atlee.ca/blog/posts/migration-status-2.html Pre-requisites before Treeherder can remove support: * Last of release automation tasks migrated (bug 1397762) * ESR52 (which still uses Buildbot) to be EOLed (currently ~August 2018: https://wiki.mozilla.org/RapidRelease/Calendar) * Thunderbird/comm-central to have switched over to Taskcluster (bug 1384205) * ...?
What do you think about removing the prompt for buildapi auth on all branches other than ESR52 ? Earlier than removing buildbot completely in September I mean.
Yeah I'd love to do that if everyone was fine with it. (Given that people can retrigger via buildapi's UI anyway, it seems fine to do)
Buildbot is being switched off over the next few days \o/
Assignee: nobody → emorley
Status: NEW → ASSIGNED
Priority: P3 → P1
Attachment #9007637 - Flags: review?(cdawson)
Attachment #9007637 - Flags: review?(cdawson) → review+
Commit pushed to master at https://github.com/mozilla/treeherder https://github.com/mozilla/treeherder/commit/255f246960d4902d40df1ec42e986e2f4814b7a5 Bug 1443251 - Disable buildbot celerybeat tasks (#4007) This will allow these celery queues to drain before we remove the code that handles them. The runnable jobs task is also buildbot-specific, since for taskcluster the jobs are calculated via the tasks graph instead.
The change in comment 5 is now deployed to production, so I've reduced the dyno count of `worker_buildapi_{pending,running,4hr}` down to zero, for all of {prototype,stage,prod}. This reduces the total monthly dynos credits the Treeherder uses on Heroku from 97 to 88.
Depends on: 1492462
Commit pushed to master at https://github.com/mozilla/treeherder https://github.com/mozilla/treeherder/commit/ffaa2e4b2af200d3ae91e3e6ecdc2d4e4f093e84 Bug 1443251 - Remove runnable jobs support for buildbot (#4071) Runnable jobs for buildbot were calculated via a celerybeat task (that was disabled in #4007) and the results stored in the `runnable_jobs` table. This can all be removed now that buildbot is EOL, since the remaining support for Taskcluster runnable jobs does not use that celery task/Django model.
Depends on: 1494750
Depends on: 1495402
Cleanup for future PRs includes: * rewriting the tests to be more taskcluster-specific * removing the collection classes from treeherder-client once the tests no longer use them * Improving the "ingesting jobs locally" UX now that ingest_push doesn't work (since no buildbot jobs) * refactoring `store_job_data()` now that it's only ever called with a list of jobs of size one * simplifying or removing the log parser step handling * SETA/runnable job cleanup
Commit pushed to master at https://github.com/mozilla/treeherder https://github.com/mozilla/treeherder/commit/445766d958f552535445f08e353045be0a3939ba Bug 1443251 - Remove support for buildbot job ingestion (#4087) The buildapi celerybeat tasks were disabled previously in #4007, so these tasks are unused.
With the changes so far, we've down from 12 types of dyno worker, to 8 \o/
No longer depends on: comm-taskcluster
Status: ASSIGNED → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED
Depends on: 1528811
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: