Closed
Bug 1218372
Opened 9 years ago
Closed 8 years ago
monitor signing workers queue
Categories
(Release Engineering :: General, defect)
Release Engineering
General
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: rail, Unassigned)
References
Details
Today all signing workers were stuck, not receiving any tasks from pulse. TC marked them as deadline-exceeded. After restarting the serves, signing workers started picking tasks without any issues.
We can probably monitor them for idleness and restart if they don't take tasks for too long.
Reporter | ||
Comment 2•9 years ago
|
||
One of the theories is that the new rabbit server doesn't support heartbeats.
http://hg.mozilla.org/build/buildapi/file/f5b3577bf236/buildapi/lib/mq.py#l40 does some magic to explicitly reconnect.
Comment 3•9 years ago
|
||
Rail, I assume this is because of bug 1218976.
Comment 4•8 years ago
|
||
I believe this is fixed now.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Assignee | ||
Updated•6 years ago
|
Component: General Automation → General
You need to log in
before you can comment on or make changes to this bug.
Description
•