Closed
Bug 654938
Opened 14 years ago
Closed 14 years ago
StagingRepositorySetupFactory should retry on clone failures
Categories
(Release Engineering :: General, defect, P2)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: rail, Assigned: rail)
References
Details
(Whiteboard: [staging][automation][simple])
Attachments
(2 files, 2 obsolete files)
(deleted),
patch
|
catlee
:
review+
rail
:
checked-in+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
catlee
:
review+
rail
:
checked-in+
|
Details | Diff | Splinter Review |
It usually fails due to hg.m.o timeouts or connection closures.
Assignee | ||
Comment 1•14 years ago
|
||
Tested in staging. Normal clone output: ========================== Calling <function run_with_timeout at 0xb7c84fb4> with args: (['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nn-NO', 'l10n-central/nn-NO'], 300, None, None, False, True), kwargs: {}, attempt #1 Executing: ['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nn-NO', 'l10n-central/nn-NO'] Process stdio: Please wait. Cloning /l10n-central/nn-NO to /users/stage-ffxbld/nn-NO Clone complete. Fixing permissions, don't interrupt. Process stderr: ========================== Output with failure: ========================== Calling <function run_with_timeout at 0xb7c6cfb4> with args: (['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nl', 'l10n-central/nl'], 300, None, None, False, True), kwargs: {}, attempt #4 Executing: ['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nl', 'l10n-central/nl'] Failed, sleeping 30 seconds before retrying Calling <function run_with_timeout at 0xb7c6cfb4> with args: (['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nl', 'l10n-central/nl'], 300, None, None, False, True), kwargs: {}, attempt #5 Executing: ['ssh', '-l', 'stage-ffxbld', '-oIdentityFile=~cltbld/.ssh/ffxbld_dsa', 'hg.mozilla.org', 'clone', 'nl', 'l10n-central/nl'] Process stdio: Please wait. Cloning /l10n-central/nl to /users/stage-ffxbld/nl Process stderr: Killed by signal 15. Process stdio: Please wait. Cloning /l10n-central/nl to /users/stage-ffxbld/nl Clone complete. Fixing permissions, don't interrupt. Process stderr: ==========================
Attachment #530253 -
Attachment is obsolete: true
Attachment #530258 -
Flags: review?(catlee)
Assignee | ||
Comment 2•14 years ago
|
||
Comment on attachment 530258 [details] [diff] [review] use retry.py Testing another, more robust version.
Attachment #530258 -
Flags: review?(catlee)
Assignee | ||
Comment 3•14 years ago
|
||
* Add "?rnd=$randomInt" to the end of the user repo URLs. Sometimes we get 404 even thought the repo exists. Generates URLs like the following: http://hg.mozilla.org/users/stage-ffxbld/pt-PT?rnd=528539
Attachment #530258 -
Attachment is obsolete: true
Attachment #530274 -
Flags: review?(catlee)
Updated•14 years ago
|
Attachment #530274 -
Flags: review?(catlee) → review+
Assignee | ||
Comment 4•14 years ago
|
||
Comment on attachment 530274 [details] [diff] [review] more robust repo_setup http://hg.mozilla.org/build/buildbotcustom/rev/21a8316e55b3
Attachment #530274 -
Flags: checked-in+
Assignee | ||
Updated•14 years ago
|
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Assignee | ||
Comment 5•14 years ago
|
||
retry.py has its own timeout, cloning mozilla repo times out.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Updated•14 years ago
|
Attachment #530333 -
Flags: review?(catlee) → review+
Assignee | ||
Comment 7•14 years ago
|
||
Comment on attachment 530333 [details] [diff] [review] sync timeouts http://hg.mozilla.org/build/buildbotcustom/rev/f8824518fe6b
Attachment #530333 -
Flags: checked-in+
Assignee | ||
Comment 8•14 years ago
|
||
Passed.
Status: REOPENED → RESOLVED
Closed: 14 years ago → 14 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Product: mozilla.org → Release Engineering
You need to log in
before you can comment on or make changes to this bug.
Description
•