Closed
Bug 1411884
Opened 7 years ago
Closed 7 years ago
6.23% build times (windows2012-32) regression on push 64a852e835b7469715fe13dc76b12458e12bb5cb (Wed Oct 25 2017)
Categories
(Firefox Build System :: General, defect)
Tracking
(firefox-esr52 unaffected, firefox57 unaffected, firefox58 fixed)
RESOLVED
FIXED
mozilla58
Tracking | Status | |
---|---|---|
firefox-esr52 | --- | unaffected |
firefox57 | --- | unaffected |
firefox58 | --- | fixed |
People
(Reporter: igoldan, Unassigned)
References
Details
(Keywords: regression)
We have detected a build metrics regression from push:
https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=64a852e835b7469715fe13dc76b12458e12bb5cb
As author of one of the patches included in that push, we need your help to address this regression.
Regressions:
6% build times summary windows2012-32 debug static-analysis taskcluster-c4.4xlarge 1,853.70 -> 1,969.28
Improvements:
66% sccache hit rate summary windows2012-32 debug static-analysis taskcluster-c4.4xlarge 0.78 -> 0.26
66% sccache hit rate summary windows2012-32 opt static-analysis taskcluster-c4.4xlarge 0.78 -> 0.27
65% sccache hit rate summary windows2012-64 opt static-analysis taskcluster-c4.4xlarge 0.86 -> 0.30
You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=10168
On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the jobs in a pushlog format.
To learn more about the regressing test(s), please see: https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Automated_Performance_Testing_and_Sheriffing/Build_Metrics
Reporter | ||
Updated•7 years ago
|
Component: Untriaged → Build Config
Product: Firefox → Core
Reporter | ||
Comment 1•7 years ago
|
||
The improvements mentioned above are actually regressions. They actually show that the sccache hit rate dropped from 100% to 66%. Fortunately, it was a just temporary issue.
:gps The increase in build time still remains. Is this something we should accept from now on, for debug builds?
Flags: needinfo?(gps)
Comment 2•7 years ago
|
||
The intent of the patches wasn't to change any build configurations for release builds.
However, this measured a difference for static analysis builds, which aren't release builds.
I need to look at the logs, but we /may/ have accidentally changed build flags for static analysis builds when we didn't intend to. I'm glad this monitoring is here and Perfherder alerted us to this possibility.
I'll look at this in more detail later. I don't think it is terribly important to do right this minute.
Comment 3•7 years ago
|
||
If you look at the graph, the build times are back to what they were.
Reporter | ||
Comment 4•7 years ago
|
||
(In reply to Mike Hommey [:glandium] from comment #3)
> If you look at the graph, the build times are back to what they were.
Pretty much yes, but not entirely.
The new min-values are just slighly higher (<1%) than the ones before bug 1411081 landed (old mins 1845 vs new mins 1855).
I believe we have to thank build caching for that.
So the 6% regression we noticed initially wasn't that serious really.
Reporter | ||
Comment 5•7 years ago
|
||
I see bug 1412952 managed to regain the original baseline. Did it resolve our specific regression or bring a separate improvement by its own?
Comment 6•7 years ago
|
||
I think we can call this resolved.
Status: NEW → RESOLVED
Closed: 7 years ago
Flags: needinfo?(gps)
Resolution: --- → FIXED
Updated•7 years ago
|
status-firefox57:
--- → unaffected
status-firefox58:
--- → fixed
status-firefox-esr52:
--- → unaffected
Target Milestone: --- → mozilla58
Updated•7 years ago
|
Product: Core → Firefox Build System
You need to log in
before you can comment on or make changes to this bug.
Description
•