Closed
Bug 747457
Opened 13 years ago
Closed 13 years ago
mozharness l10n should add per-locale status properties in production
Categories
(Release Engineering :: Applications: MozharnessCore, defect, P3)
Release Engineering
Applications: MozharnessCore
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: mozilla, Assigned: mozilla)
References
()
Details
(Whiteboard: [mozharness])
Attachments
(2 files, 3 obsolete files)
(deleted),
patch
|
catlee
:
review+
mozilla
:
checked-in+
|
Details | Diff | Splinter Review |
(deleted),
patch
|
rail
:
review+
mozilla
:
checked-in+
|
Details | Diff | Splinter Review |
See https://bugzilla.mozilla.org/show_bug.cgi?id=745975#c2 .
Setting properties should be a generic method in BuildbotMixin.
The l10n script could then have a wrapper method that takes locale, message, and status, and can both self.add_summary() and self.set_buildbot_property(). Not sure if this method lives in the script or in LocalesMixin or what.
We should also perhaps add a string at the beginning and end of each compare-locale run:
"compare locales output per locale could be sandwiched between easily
identified headers like
*** BEGIN compare_locales ab-CD
....
*** END compare_locales ab-CD
"
Assignee | ||
Updated•13 years ago
|
Assignee: nobody → aki
Assignee | ||
Comment 1•13 years ago
|
||
I *think* this would work but a run through ScriptFactory with the properties set properly would be best.
I'd also like to see a failing l10n repack get marked as such... pretty sure that's easily doable on m-c.
Assignee | ||
Comment 2•13 years ago
|
||
Still had old logic lying around that created a 'locales' property as a list of comma-delineated locales.
Removed.
Attachment #617158 -
Attachment is obsolete: true
Assignee | ||
Comment 3•13 years ago
|
||
Ok.
This patch is tested in staging (with some staging-specific changes for testing purposes).
I correctly created the locales property and wrote the file:
14:42:59 INFO - Setting buildbot property locales to {"ja-JP-mac": "Success", "ko": "Success", "it": "Success", "hu": "Success", "lt": "Success", "id": "Success", "nb-NO": "Success", "ja": "Success", "he": "Failed"}
14:42:59 INFO - mkdir: /builds/slave/m-cen-andrd-l10n-3/properties
14:42:59 INFO - Writing buildbot properties ['locales'] to /builds/slave/m-cen-andrd-l10n-3/properties/locales
14:42:59 INFO - Writing to file /builds/slave/m-cen-andrd-l10n-3/properties/locales
14:42:59 INFO - Contents:
14:42:59 INFO - locales:{"ja-JP-mac": "Success", "ko": "Success", "it": "Success", "hu": "Success", "lt": "Success", "id": "Success", "nb-NO": "Success", "ja": "Success", "he": "Failed"}
The SetProperty step in ScriptFactory correctly read the string:
locales:{"ja-JP-mac": "Success", "ko": "Success", "it": "Success", "hu": "Success", "lt": "Success", "id": "Success", "nb-NO": "Success", "ja": "Success", "he": "Failed"}
However, SetProperty then set this property:
locales: '{"ja-JP-mac"'
I think we have to replace the bash call with something else, or do something ugly in a single string without quotes. Or escape all the quotes (YUCK)
I think we need to morph bug 724221 to not use bash before we can do this.
Attachment #617159 -
Attachment is obsolete: true
Assignee | ||
Comment 4•13 years ago
|
||
(In reply to Aki Sasaki [:aki] from comment #3)
> However, SetProperty then set this property:
>
> locales: '{"ja-JP-mac"'
>
> I think we have to replace the bash call with something else, or do
> something ugly in a single string without quotes. Or escape all the quotes
> (YUCK)
> I think we need to morph bug 724221 to not use bash before we can do this.
Actually, I think the splitting on colons is at fault here:
http://hg.mozilla.org/build/buildbotcustom/file/97126886e152/process/factory.py#l8489
Assignee | ||
Comment 5•13 years ago
|
||
Only split on the leftmost colon.
Skip the line if there's no colon.
Attachment #617681 -
Flags: review?(catlee)
Assignee | ||
Comment 6•13 years ago
|
||
This works when run with the above buildbotcustom patch.
The following two properties were set for a staging Android mozilla-central l10n nightly 3/5 run:
he_failure: "he failed in make installers-he! Can't create a snippet for he without an upload url."
locales: '{"ja-JP-mac": "Success", "ko": "Success", "it": "Success", "hu": "Success", "lt": "Success", "id": "Success", "nb-NO": "Success", "ja": "Success", "he": "Failed"}'
Attachment #617659 -
Attachment is obsolete: true
Attachment #617684 -
Flags: review?(rail)
Updated•13 years ago
|
Attachment #617681 -
Flags: review?(catlee) → review+
Assignee | ||
Comment 7•13 years ago
|
||
Comment on attachment 617681 [details] [diff] [review]
fix ScriptFactory's extractProperties
http://hg.mozilla.org/build/buildbotcustom/rev/28ed61ce33a4
Attachment #617681 -
Flags: checked-in+
Comment 8•13 years ago
|
||
Comment on attachment 617684 [details] [diff] [review]
mozharness buildbot property support
Review of attachment 617684 [details] [diff] [review]:
-----------------------------------------------------------------
Sorry for the delay, buildduty :/
::: mozharness/mozilla/buildbot.py
@@ +77,5 @@
> + if not prop_list:
> + prop_list = self.buildbot_properties.keys()
> + self.info("Writing buildbot properties to %s" % file_name)
> + else:
> + if not isinstance(prop_list, list):
could be
if not isinstance(prop_list, (list, tuple)):
or even
if not callable(getattr(prop_list, '__iter__', None)):
:)
Attachment #617684 -
Flags: review?(rail) → review+
Assignee | ||
Comment 9•13 years ago
|
||
Comment on attachment 617684 [details] [diff] [review]
mozharness buildbot property support
http://hg.mozilla.org/build/mozharness/rev/6cf10e691609
(In reply to Rail Aliiev [:rail] from comment #8)
> Sorry for the delay, buildduty :/
No worries.
> ::: mozharness/mozilla/buildbot.py
> @@ +77,5 @@
> > + if not prop_list:
> > + prop_list = self.buildbot_properties.keys()
> > + self.info("Writing buildbot properties to %s" % file_name)
> > + else:
> > + if not isinstance(prop_list, list):
>
> could be
> if not isinstance(prop_list, (list, tuple)):
Done.
We should now have per-locale status properties in Android single locale repacks. Once we move desktop repacks to mozharness, we'll have per-locale status properties there as well, though Windows may be delayed until bug 724221 is resolved.
Attachment #617684 -
Flags: checked-in+
Assignee | ||
Updated•13 years ago
|
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Product: mozilla.org → Release Engineering
Updated•10 years ago
|
Component: General Automation → Mozharness
You need to log in
before you can comment on or make changes to this bug.
Description
•