Closed Bug 1451483 Opened 7 years ago Closed 6 years ago

Have a command that opens all necessary terminals to do pulse data ingestion

Categories

(Tree Management :: Treeherder, enhancement, P3)

enhancement

Tracking

(Not tracked)

RESOLVED DUPLICATE of bug 1318020

People

(Reporter: camd, Unassigned)

Details

This could take the PULSE_DATA_INGESTION_CONFIG from the environment, in a file, or as a cmd line arg. It would be awesome if it was possible to specify whether to JUST ingest jobs and pushes or to do log parsing as well. This will require Docker.
Depends on: 1169263
Another way to reduce the number of steps would be to combine the push and job listeners into one command - perhaps called "pulse_listener"? I don't think we ever need to stop listening to one and not the other (the store worker can be paused instead), and the load is so low that we don't need to run them on separate dynos.
Blocks: 1416266
Component: Treeherder: Data Ingestion → Treeherder: Docs & Development
Priority: -- → P3

Bug 1318020 is filed for adding a command that runs multiple processes using something like Honcho (which looks at the Procfile for what to run).

Alternatively docker-compose could be used for similar effect if the switch from Vagrant to Docker is made (bug 1169263).

For the suggestion in comment 1 of merging the two pulse listening commands, I've filed bug 1530965.

No longer blocks: 1416266
Status: NEW → RESOLVED
Closed: 6 years ago
No longer depends on: 1169263
Resolution: --- → DUPLICATE
Component: Treeherder: Docs & Development → TreeHerder
You need to log in before you can comment on or make changes to this bug.