Closed
Bug 628671
Opened 14 years ago
Closed 14 years ago
release clobberer STILL broken
Categories
(Release Engineering :: General, defect, P1)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: bhearsum, Assigned: bhearsum)
References
Details
(Whiteboard: [automation])
Attachments
(3 files, 2 obsolete files)
(deleted),
patch
|
catlee
:
review+
bhearsum
:
checked-in+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
bhearsum
:
review+
catlee
:
feedback+
bhearsum
:
checked-in+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
catlee
:
review+
bhearsum
:
checked-in+
|
Details | Diff | Splinter Review |
There seems to be a couple of things wrong with it, even after the Great Purge in bug 626164:
1) Branches are never set for the release clobberer form
2) When a clobber is set, it's only set for the base builddir, eg, "tag", instead of "rel-191-tag".
The latter blocks clobberer from working at all for releases, the former makes it impossible to only clobber a single branches' builder(s).
Assignee | ||
Comment 1•14 years ago
|
||
This seems to fix #2, and got release clobbers working again in staging. Doesn't affect branch clobberability.
Attachment #506757 -
Flags: review?(catlee)
Assignee | ||
Comment 2•14 years ago
|
||
This patch gets us back into a state where all combinations of the release clobberer options work. I also fixed the "Regular Clobbers" display to not show release builds in any case, even if the user is special -- it's only confusing.
There's still an issue with tag and l10n though, we skip the "build" directory when clobbering to avoid deleting the "tools" clone, but that's also the directory where all the work happens....so we never actually clobber anything.
Attachment #506757 -
Attachment is obsolete: true
Attachment #506814 -
Flags: review?(catlee)
Attachment #506757 -
Flags: review?(catlee)
Assignee | ||
Comment 3•14 years ago
|
||
This seems to be the best fix for the aforementioned problem with tag/l10n. With this, we can ignore "scripts" and "buildprops.json" when calling clobberer, and only clobber what we actually want to...
Catlee, what do you think about this approach?
Attachment #506832 -
Flags: feedback?(catlee)
Assignee | ||
Updated•14 years ago
|
Priority: -- → P1
Updated•14 years ago
|
Attachment #506814 -
Flags: review?(catlee) → review+
Comment 4•14 years ago
|
||
Comment on attachment 506832 [details] [diff] [review]
make script factory more suitable for clobberer
So the gist here is to just change where scripts are run out of? Instead of everything being under <builder_dir>/build/, it will now be under <builder_dir>?
Assignee | ||
Comment 5•14 years ago
|
||
(In reply to comment #4)
> Comment on attachment 506832 [details] [diff] [review]
> make script factory more suitable for clobberer
>
> So the gist here is to just change where scripts are run out of? Instead of
> everything being under <builder_dir>/build/, it will now be under
> <builder_dir>?
Yeah, that's right. Clobberer can only skip things that are in the root of the slavebuilddir, and this makes it easy for scripts to run out of it.
Assignee | ||
Comment 6•14 years ago
|
||
Comment on attachment 506814 [details] [diff] [review]
v2, fix the display, too
Landed this and updated the clobberer and stage-clobberer instances.
Attachment #506814 -
Flags: checked-in+
Assignee | ||
Comment 7•14 years ago
|
||
Verified this in production by requesting a clobber for "any master", "mozilla-central", "tag". From mv-moz2-linux-ix-slave10's subsequent clobberer call:
Checking clobber URL: http://build.mozilla.org/clobberer/index.php?master=http%3A%2F%2Fproduction-master01.build.mozilla.org%3A8010%2F&slave=mv-moz2-linux-ix-slave10&builddir=tm-mb-br-lnx-ntly&branch=tracemonkey&buildername=Linux+Mobile+Desktop+tracemonkey+nightly
rel-cen-tag:Our last clobber date: 2011-01-21 15:38:15
rel-cen-tag:Server clobber date: 2011-01-27 06:12:20
rel-cen-tag:Server is forcing a clobber, initiated by bhearsum@mozilla.com
rel-cen-tag:Clobbering...
Skipping last-clobber
Removing build/
Updated•14 years ago
|
Attachment #506832 -
Flags: feedback?(catlee) → feedback+
Assignee | ||
Comment 8•14 years ago
|
||
Still need to test a couple of these, so far so good though.
Assignee | ||
Comment 9•14 years ago
|
||
hooray. l10n is still even more broken, probably because of the split builders. probably need to update the release builder names in index.php.
Assignee | ||
Comment 10•14 years ago
|
||
Actually...it looks like all builders that have shortened names can't be clobbered by their buildername. This is basically everything except "tag".
Assignee | ||
Comment 11•14 years ago
|
||
So...this is a bit of a bigger change to the release clobberer, but I think it helps maintainability a lot. Here's the summary of this and the others parts of this patch:
- Switch to on-the-fly detection of release builddirs in Clobberer. Since *everything* is prefixed with "rel-", we don't need to list them out explicitly anymore. This is great, because it means the next time we change the build dirs, we won't break.
- Stop showing anything with the RELEASE_PREFIX in the main table
- Deleted testReleaseClobberPrefixBuilder, because it's unnecessary now (it tests the ability to clobber a builder on a branch, but we handle that through using the full builddir/buildername in the builder list now.)
- Update clobberer invocations/skip file/dirs for ScriptFactory changes.
Attachment #507559 -
Attachment is obsolete: true
Attachment #508017 -
Flags: review?(catlee)
Comment 12•14 years ago
|
||
(In reply to comment #11)
> Created attachment 508017 [details] [diff] [review]
> more fixes
A couple questions due to the impending beta 11:
1) is this likely to land before go-to-build tomorrow?
2) from reading your comments on the patch, it sounds like it should work for the first release after being landed. Is this correct?
Assignee | ||
Comment 13•14 years ago
|
||
(In reply to comment #12)
> (In reply to comment #11)
> > Created attachment 508017 [details] [diff] [review]
> > more fixes
>
> A couple questions due to the impending beta 11:
>
> 1) is this likely to land before go-to-build tomorrow?
Ask Catlee :)
> 2) from reading your comments on the patch, it sounds like it should work for
> the first release after being landed. Is this correct?
It should; you can set the clobber for mozilla-central as son as this lands to find out! I just updated the docs to make it clear how to do this (https://wiki.mozilla.org/Release:Release_Automation_on_Mercurial:Documentation#Preparation). Once you mark things for a clobber try tracking down a couple of machines that did release builds in b10 to verify that they delete their release stuff in their next job. Let me know if you have issues with this.
Assignee | ||
Comment 14•14 years ago
|
||
Comment on attachment 506832 [details] [diff] [review]
make script factory more suitable for clobberer
From IRC: carry forward the feedback+ to r+
Landed on default: changeset: 1466:d01b1631d33a
Armen is planning a reconfig for this morning, so this should head to production-0.8 then.
Attachment #506832 -
Flags: review+
Assignee | ||
Updated•14 years ago
|
Whiteboard: [automation[
Assignee | ||
Updated•14 years ago
|
Whiteboard: [automation[ → [automation]
Updated•14 years ago
|
Attachment #508017 -
Flags: review?(catlee) → review+
Assignee | ||
Comment 15•14 years ago
|
||
Comment on attachment 508017 [details] [diff] [review]
more fixes
Landed this, updated clobberer and stage-clobberer instances.
Attachment #508017 -
Flags: checked-in+
Assignee | ||
Comment 16•14 years ago
|
||
Comment on attachment 506832 [details] [diff] [review]
make script factory more suitable for clobberer
This made it to production today.
Attachment #506832 -
Flags: checked-in+
Assignee | ||
Comment 17•14 years ago
|
||
We're all done here.
Status: ASSIGNED → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Product: mozilla.org → Release Engineering
You need to log in
before you can comment on or make changes to this bug.
Description
•