Closed Bug 1436478 Opened 7 years ago Closed 4 years ago

[tracker] Switch Taskcluster to Postgres

Categories

(Taskcluster :: Services, enhancement)

enhancement
Not set
normal

Tracking

(Not tracked)

RESOLVED MOVED

People

(Reporter: dustin, Unassigned)

References

(Blocks 1 open bug)

Details

Why? * A shared base of indexed data can allow services to make smarter decisions and save money on provisioning and data storage * Azure is unreliable with frequent failures and inscrutible rate-limiting. While we are resilient to these errors, they do cause inefficiency and sometimes cascading failures * Storing data in postgres will enable features users desire: * Queue introspection (what tasks are pending right now? how many tasks are [actually pending and not cancelled](https://bugzilla.mozilla.org/show_bug.cgi?id=1434851)?) * Integration of task-related and worker-related status (what tasks has this worker performed?) * Ad-hoc analytics (how much compute time do we use per push? what do we pay for wpt?) * More sophisticated dependency resolution [in the case of task failure](https://bugzilla.mozilla.org/show_bug.cgi?id=1443503#c8) * Dynamically changing task levels
Depends on: 1455369
Blocks: 1434851
QA Contact: jhford
Assignee: nobody → jhford
Status: NEW → ASSIGNED
Blocks: 1455369
No longer depends on: 1455369
Blocks: 1518914
Blocks: 1518933
Component: Queue → Services
Assignee: jhford → nobody
Status: ASSIGNED → NEW
QA Contact: jhford
No longer blocks: 1518933
No longer blocks: 1427838

Let's use this to track the overall switch to Postgres. We might start with Queue, but the migration plan should move swiftly past queue to cover all the services, rather than stall out in a half-migrated state.

Summary: [tracker] Migrate Queue to Postgres → [tracker] Switch Taskcluster to Postgres
Blocks: 1525038
Blocks: 1477097
Blocks: 1604175
Depends on: 1630014
Depends on: 1630015
Depends on: 1630016
Depends on: 1630017
Depends on: 1630018
Depends on: 1630019
Depends on: 1630020
Depends on: 1630021
Depends on: 1630022
Depends on: 1630023
Blocks: 1494446
Blocks: 1459710
No longer blocks: 1459710
No longer blocks: 1458896
No longer blocks: 1453656
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → MOVED
You need to log in before you can comment on or make changes to this bug.