Closed Bug 1763666 Opened 3 years ago Closed 3 years ago

73.17 - 12.38% welcome ContentfulSpeedIndex / welcome ContentfulSpeedIndex + 4 more (Linux, OSX, Windows) regression on Fri April 1 2022

Categories

(Firefox :: Messaging System, defect, P1)

Product:
Firefox
Component:
Messaging System
Type:
defect

Tracking

()

Status:
RESOLVED FIXED
Milestone:
101 Branch
Iteration:
101.2 - April 18 - April 29
Tracking Flags:
Tracking Status
firefox-esr91 --- unaffected
firefox99 --- unaffected
firefox100 --- wontfix
firefox101 --- fixed

People

(Reporter: afinder, Assigned: Mardak)

References

(Blocks 1 open bug, Regression)

Details

(Keywords: perf, perf-alert, regression)

Attachments

(1 file)

Bug 1763666 - Revert various changes back to before Fx100 onboarding r?pdahiya
(deleted), text/x-phabricator-request
Details

Perfherder has detected a browsertime performance regression from push 53e6fbe77dff1c74b11e1903ccf3084a39f90cd0. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
73% welcome ContentfulSpeedIndex windows10-64-shippable-qr fission warm webrender 324.83 -> 562.50
52% welcome ContentfulSpeedIndex windows10-64-shippable-qr fission warm webrender 354.92 -> 538.33
24% welcome ContentfulSpeedIndex macosx1015-64-shippable-qr fission warm webrender 1,366.33 -> 1,693.25
20% welcome ContentfulSpeedIndex linux1804-64-shippable-qr fission warm webrender 1,338.17 -> 1,601.42
12% welcome ContentfulSpeedIndex macosx1015-64-shippable-qr cold fission webrender 1,594.42 -> 1,793.08
12% welcome ContentfulSpeedIndex linux1804-64-shippable-qr cold fission webrender 1,500.92 -> 1,686.67

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
28% welcome PerceptualSpeedIndex windows10-64-shippable-qr fission warm webrender 281.58 -> 204.00
26% welcome PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 380.25 -> 281.83
20% welcome SpeedIndex windows10-64-shippable-qr cold fission webrender 272.83 -> 217.17
15% welcome fcp macosx1015-64-shippable-qr cold fission webrender 108.92 -> 92.29
8% welcome PerceptualSpeedIndex macosx1015-64-shippable-qr cold fission webrender 1,503.96 -> 1,380.17
... ... ... ... ...
5% welcome PerceptualSpeedIndex macosx1015-64-shippable-qr fission warm webrender 1,388.00 -> 1,314.25

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Flags: needinfo?(edilee)

Set release status flags based on info from the regressing bug 1762289

status-firefox100: --- → affected
status-firefox101: --- → affected
status-firefox99: --- → unaffected
status-firefox-esr91: --- → unaffected
Blocks: 1728848

The main background image for about:welcome changed from an .avif to .svg. We'll revert back to the avif in 101.

There's also regressions for FirstVisualChange ContentfulSpeedIndex and improvements for SpeedIndex ContentfulSpeedIndex fcp noted in bug 1763705. Overall interesting to see what changes although the background images are quite different from each other in content as well.

Assignee: nobody → edilee
No longer blocks: 1728848
Iteration: --- → 101.2 - April 18 - April 29
status-firefox100: affected → wontfix
Flags: needinfo?(edilee)
Priority: -- → P1
Blocks: 1728848
Has Regression Range: --- → yes
Blocks: 1765133
Pushed by elee@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/f905975979c2 Revert various changes back to before Fx100 onboarding r=pdahiya
Depends on: 1762263, 1762289, 1762291, 1762292, 1762290, 1762285

https://hg.mozilla.org/mozilla-central/rev/f905975979c2

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox101: affected → fixed
Resolution: --- → FIXED
Target Milestone: --- → 101 Branch

(In reply to Pulsebot from comment #6)

Pushed by elee@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/f905975979c2
Revert various changes back to before Fx100 onboarding r=pdahiya

== Change summary for alert #33996 (as of Tue, 03 May 2022 05:33:24 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
39% welcome PerceptualSpeedIndex windows10-64-shippable-qr fission warm webrender 202.67 -> 281.67
30% welcome PerceptualSpeedIndex linux1804-64-shippable-qr cold fission webrender 295.42 -> 385.42
29% welcome PerceptualSpeedIndex linux1804-64-shippable-qr fission warm webrender 237.58 -> 306.08
24% welcome SpeedIndex windows10-64-shippable-qr cold fission webrender 230.38 -> 284.58
14% welcome fcp windows10-64-shippable-qr cold fission webrender 94.52 -> 107.96
8% welcome fcp linux1804-64-shippable-qr cold fission webrender 109.44 -> 118.58
6% welcome PerceptualSpeedIndex macosx1015-64-shippable-qr cold fission webrender 1,428.92 -> 1,508.67
5% welcome PerceptualSpeedIndex macosx1015-64-shippable-qr fission warm webrender 1,320.71 -> 1,387.25

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
31% welcome FirstVisualChange windows10-64-shippable-qr cold fission webrender 173.33 -> 120.00
28% welcome FirstVisualChange linux1804-64-shippable-qr cold fission webrender 180.00 -> 130.00
27% welcome ContentfulSpeedIndex windows10-64-shippable-qr fission warm webrender 532.08 -> 387.67
25% welcome ContentfulSpeedIndex linux1804-64-shippable-qr fission warm webrender 535.46 -> 400.58
22% welcome ContentfulSpeedIndex macosx1015-64-shippable-qr fission warm webrender 1,688.79 -> 1,324.00
... ... ... ... ...
5% welcome FirstVisualChange macosx1015-64-shippable-qr cold fission webrender 1,296.67 -> 1,230.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33996

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: