Closed Bug 1723118 Opened 3 years ago Closed 3 years ago

37.99 - 34.09% pinterest PerceptualSpeedIndex / pinterest fcp + 1 more (OSX) regression on Mon July 26 2021

Categories

(Core :: Layout: Scrolling and Overflow, defect)

Firefox 92
defect

Tracking

()

RESOLVED WORKSFORME
Tracking Status
firefox-esr78 --- unaffected
firefox-esr91 --- unaffected
firefox90 --- unaffected
firefox91 --- unaffected
firefox92 --- wontfix
firefox93 --- wontfix
firefox94 --- wontfix

People

(Reporter: alexandrui, Unassigned)

References

(Regression)

Details

(Keywords: perf, perf-alert, regression)

Perfherder has detected a browsertime performance regression from push ba212049d3c03367539fe10a67dc1b2fb7c42a86. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio Suite Test Platform Options Absolute values (old vs new)
38% pinterest PerceptualSpeedIndex macosx1015-64-shippable-qr warm webrender 435.92 -> 601.50
36% pinterest fcp macosx1015-64-shippable-qr warm webrender 291.88 -> 395.79
34% pinterest fcp macosx1015-64-shippable-qr warm webrender 290.17 -> 389.08

Improvements:

Ratio Suite Test Platform Options Absolute values (old vs new)
28% paypal LastVisualChange macosx1015-64-shippable-qr cold webrender 1,685.00 -> 1,220.00
17% paypal SpeedIndex macosx1015-64-shippable-qr cold webrender 942.04 -> 777.58
12% paypal PerceptualSpeedIndex macosx1015-64-shippable-qr cold webrender 880.96 -> 774.00

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Flags: needinfo?(emilio)

Set release status flags based on info from the regressing bug 1722359

Can you double-check the regression push?

I'm moderately sure my patch shouldn't have caused any behavior change on macOS, since on mac (on desktop in general) we returned zero for that value before.

The only plausible behavior change would be android, and it'd be a perf improvement.

Flags: needinfo?(emilio)
Flags: needinfo?(aionescu)

The retriggers revealed the same thing.

Flags: needinfo?(aionescu)

Looks like the regressing bug was confirmed by retriggers and a recent look at the graph shows that this regression is still present.

Flags: needinfo?(emilio)

So, I can reproduce, but I still have no idea how this can happen, fwiw... I verified both before and after my patch that the condition I removed wasn't being hit.

I think there's something off with the pinterest test. So here are a few try runs:

Enough work has been done since then that I think we can just close this. Some of the tests are somewhat unstable, this may be an aspect of that (random timing change)

Status: NEW → RESOLVED
Closed: 3 years ago
Flags: needinfo?(rjesup)
Resolution: --- → WORKSFORME
Has Regression Range: --- → yes
You need to log in before you can comment on or make changes to this bug.