Closed Bug 1067919 (panda-0425) Opened 10 years ago Closed 9 years ago

panda-0425 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Product:
Infrastructure & Operations Graveyard
Component:
CIDuty
Platform:
ARM
Android
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: RyanVM, Unassigned)

References

Details

(Whiteboard: [buildduty][buildslaves][capacity])

Depends on: 1075101
Replaced SD card.
Back in production.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Picked up right where it left off burning every job it touches. https://treeherder.mozilla.org/ui/logviewer.html#?job_id=2826373&repo=mozilla-inbound
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
seems this panda isn't refusing to acknowledge that he is disabled and still taking jobs :/ pinged pmoore about this
Raised bug 1079778 about this
Panda disabled by killing buildbot slave on foopy66
Depends on: 1079778
Since this slave had trouble recovering itself, it would be wise to check that the relay info in inventory is accurate. Inventory claims: panda-relay-038.p4.releng.scl3.mozilla.com:bank1:relay3
Depends on: 1082955
inventory is correct regarding the power relay information. i was able to verify by opening up the panda chassis, running please_power_cycle and watch it cycle. i also confirmed with https://mana.mozilla.org/wiki/display/IT/Panda+Chassis+System as the panda is panda #3 in the diagrams.
No longer depends on: 1079778
Recovery bug is closed. Re-enabling.
Status: REOPENED → RESOLVED
Closed: 10 years ago → 10 years ago
Resolution: --- → FIXED
Burning everything it touches.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Depends on: 1079778
Killed the buildbot slave on foopy66 for this device. Bug 1079778 described root cause - will try to tackle that today.
I've re-enabled this panda. We'll see how long it lasts.
Looks pretty good after 5 jobs.
Status: REOPENED → RESOLVED
Closed: 10 years ago → 10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed. Attempting reboot via Mozpool...Failed. Filed IT bug for reboot (bug 1162547)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Status: REOPENED → RESOLVED
Closed: 10 years ago → 9 years ago
Resolution: --- → FIXED
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.