Closed Bug 1649692 Opened 4 years ago Closed 4 years ago

9.18% raptor-tp6-facebook-firefox-cold loadtime (linux64-shippable-qr) regression on push b96cdb2a5b42ba979caca9f4ac93525a869d7d6b (Fri June 26 2020)

Categories

(Testing :: Performance, defect)

80 Branch
defect

Tracking

(firefox80 wontfix)

RESOLVED WONTFIX
Tracking Status
firefox80 --- wontfix

People

(Reporter: Bebe, Unassigned)

References

(Regression)

Details

(Keywords: perf, perf-alert, regression)

Perfherder has detected a raptor performance regression from push b96cdb2a5b42ba979caca9f4ac93525a869d7d6b. As author of one of the patches included in that push, we need your help to address this regression.

== Change summary for alert #26393 (as of Wed, 01 Jul 2020 05:19:19 GMT) ==

Regressions:

10% raptor-tp6-facebook-firefox-cold loadtime linux64-shippable opt 2,458.42 -> 2,703.33
10% raptor-tp6-facebook-firefox-cold loadtime linux64-shippable-qr opt webrender 2,548.08 -> 2,791.33
9% raptor-tp6-facebook-firefox-cold loadtime linux64-shippable-qr opt webrender 2,548.92 -> 2,782.83

Improvements:

22% raptor-tp6-facebook-firefox-cold loadtime macosx1014-64-shippable opt 4,189.33 -> 3,251.67
12% raptor-tp6-outlook-firefox-cold fcp windows7-32-shippable opt 237.25 -> 208.08
12% raptor-tp6-outlook-firefox-cold fcp windows10-64-shippable opt 235.75 -> 207.33
11% raptor-tp6-outlook-firefox-cold windows10-64-shippable opt 291.05 -> 259.52
11% raptor-tp6-outlook-firefox-cold fcp windows10-64-shippable-qr opt webrender 235.50 -> 210.75
11% raptor-tp6-outlook-firefox-cold windows7-32-shippable opt 290.91 -> 260.36
9% raptor-tp6-outlook-firefox-cold windows10-64-shippable-qr opt webrender 288.49 -> 261.65
9% raptor-tp6-wikipedia-firefox-cold fcp linux64-shippable opt 1,586.08 -> 1,441.67
9% raptor-tp6-office-firefox-cold fcp windows10-64-shippable opt 407.17 -> 371.42
9% raptor-tp6-wikipedia-firefox-cold linux64-shippable opt 1,612.26 -> 1,472.42
8% raptor-tp6-wikipedia-firefox-cold fcp linux64-shippable-qr opt webrender 1,813.67 -> 1,663.00
8% raptor-tp6-wikipedia-firefox-cold linux64-shippable-qr opt webrender 1,729.86 -> 1,587.80
8% raptor-tp6-wikipedia-firefox-cold loadtime windows7-32-shippable opt 1,466.92 -> 1,349.33
8% raptor-tp6-wikipedia-firefox-cold loadtime linux64-shippable-qr opt webrender 1,765.00 -> 1,626.92
8% raptor-tp6-wikipedia-firefox-cold loadtime linux64-shippable opt 1,694.00 -> 1,564.42
7% raptor-tp6-wikipedia-firefox-cold loadtime windows10-64-shippable opt 1,434.17 -> 1,326.75
7% raptor-tp6-wikipedia-firefox-cold loadtime windows10-64-shippable-qr opt webrender 1,406.16 -> 1,307.08
6% raptor-tp6-pinterest-firefox-cold fcp windows7-32-shippable opt 597.38 -> 561.08
5% raptor-tp6-wikipedia-firefox-cold windows7-32-shippable opt 1,304.78 -> 1,236.80
5% raptor-tp6-reddit-firefox-cold fcp linux64-shippable opt 269.42 -> 255.58
5% raptor-tp6-pinterest-firefox-cold fcp windows10-64-shippable opt 585.33 -> 555.58
4% raptor-tp6-pinterest-firefox-cold windows10-64-shippable opt 911.32 -> 877.34
4% raptor-tp6-wikipedia-firefox-cold windows10-64-shippable-qr opt webrender 1,285.25 -> 1,237.27
4% raptor-tp6-facebook-firefox-cold loadtime windows7-32-shippable opt 1,930.83 -> 1,863.33
3% raptor-tp6-wikipedia-firefox-cold fcp windows7-32-shippable opt 1,248.29 -> 1,208.17
3% raptor-tp6-outlook-firefox-cold loadtime windows10-64-shippable opt 632.75 -> 613.25
3% raptor-tp6-reddit-firefox-cold linux64-shippable opt 742.46 -> 723.73
2% raptor-tp6-outlook-firefox-cold loadtime windows7-32-shippable opt 631.08 -> 615.67
2% raptor-tp6-pinterest-firefox-cold loadtime windows10-64-shippable opt 1,822.88 -> 1,785.17

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=26393

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

This push was simply a backout of the pref change landed on June 22nd, and reversed the various regressions and improvements there.

So there's nothing interesting here, just a return to the original state.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → WONTFIX

Yep thanks for closing it

You need to log in before you can comment on or make changes to this bug.