Closed Bug 1532548 Opened 6 years ago Closed 6 years ago

44.59 - 46.48% sessionrestore / sessionrestore_no_auto_restore (osx-10-10) regression on push 0ecb667b6b046767759ca6fda321d5ee2385d3e6 (Mon Mar 4 2019)

Categories

(Testing :: Talos, defect)

Version 3
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: Bebe, Unassigned)

Details

(Keywords: perf, regression, talos-regression)

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=0ecb667b6b046767759ca6fda321d5ee2385d3e6

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

46% sessionrestore_no_auto_restore osx-10-10 opt e10s stylo 684.33 -> 1,002.42
45% sessionrestore osx-10-10 opt e10s stylo 630.75 -> 912.00

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=19764

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Performance_sheriffing/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Performance_sheriffing/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Component: General → Talos

I know this is expected. Still, could you please update the Wiki docs as well?

Flags: needinfo?(felipc)
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WONTFIX

(In reply to Ionuț Goldan [:igoldan], Performance Sheriffing from comment #1)

I know this is expected. Still, could you please update the [Wiki
docs](https://wiki.mozilla.org/Performance_sheriffing/Talos/
Tests#sessionrestore.2Fsessionrestore_no_auto_restore.
2Fsessionrestore_many_windows) as well?

Sure thing, I just updated it. I had updated the version at https://wiki.mozilla.org/Buildbot/Talos/Tests. What's the difference between the two? Should the one I had updated first be marked as deprecated?

Flags: needinfo?(felipc)

(In reply to :Felipe Gomes (needinfo me!) from comment #2)

I had updated the version at https://wiki.mozilla.org/Buildbot/Talos/Tests. What's the difference between the two? Should the one I had updated first be marked as deprecated?

You are correct. We (as Perf Engineering team) should have removed the Buildbot/* links entirely, as Buildbot has been dropped from mozilla-central. I will sync your updates with the new docs. Thanks for providing them!

You need to log in before you can comment on or make changes to this bug.