Closed Bug 1475157 Opened 6 years ago Closed 6 years ago

189.44 - 274.09% damp (osx-10-10, windows10-64, windows10-64-msvc, windows7-32-msvc) regression on push 2d44bdd3fdd49f4b533faefce1eb19b680367a24 (Wed Jul 11 2018)

Categories

(DevTools :: General, defect)

Unspecified
All
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: igoldan, Unassigned)

References

Details

(Keywords: perf, regression, talos-regression)

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=2d44bdd3fdd49f4b533faefce1eb19b680367a24

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

274%  damp osx-10-10 opt e10s stylo     138.74 -> 519.03
200%  damp windows7-32-msvc opt e10s stylo102.17 -> 306.89
198%  damp windows10-64-msvc opt e10s stylo95.24 -> 283.35
189%  damp windows10-64 opt e10s stylo  90.84 -> 262.92


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=14300

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling
Product: Testing → DevTools
:ochameau I want to mark this as WONTFIX as it's just a harness update. Were the results above expected?
Flags: needinfo?(poirot.alex)
(In reply to Ionuț Goldan [:igoldan], Performance Sheriffing from comment #1)
> :ochameau I want to mark this as WONTFIX as it's just a harness update. Were
> the results above expected?

Yes, settle subtests were having very low durations compared to all the others, thus leading to significant increase of geometric mean.
Flags: needinfo?(poirot.alex)
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.