Closed
Bug 1450860
Opened 7 years ago
Closed 7 years ago
11.07 - 13.89% tp5o (windows10-64/windows7-32) regression on push 9d08798cee62 (Fri Mar 30 2018)
Categories
(Testing :: Talos, defect)
Tracking
(Not tracked)
RESOLVED
WORKSFORME
People
(Reporter: igoldan, Unassigned)
References
Details
== Change summary for alert #12427 (as of Fri, 30 Mar 2018 07:08:55 GMT) ==
Regressions:
14% tp5o windows7-32 pgo e10s stylo 203.12 -> 231.33
11% tp5o windows10-64 pgo e10s stylo 201.24 -> 223.52
Improvements:
82% speedometer windows10-64 opt e10s stylo 34.00 -> 61.89
80% stylebench windows10-64 opt e10s stylo 35.28 -> 63.40
79% tp5o responsiveness windows10-64 pgo e10s stylo1.66 -> 0.34
79% dromaeo_css windows7-32 opt e10s stylo 6,939.78 -> 12,408.08
77% tp5o responsiveness windows10-64 opt e10s stylo1.75 -> 0.41
76% dromaeo_css windows10-64 opt e10s stylo 7,415.49 -> 13,057.31
75% speedometer windows7-32 opt e10s stylo 34.08 -> 59.57
75% tp5o responsiveness windows7-32 pgo e10s stylo1.21 -> 0.31
73% stylebench windows7-32 opt e10s stylo 29.15 -> 50.46
71% dromaeo_css windows10-64 pgo e10s stylo 7,779.04 -> 13,274.37
68% speedometer windows10-64 pgo e10s stylo 42.35 -> 71.08
65% dromaeo_css windows7-32 pgo e10s stylo 7,532.33 -> 12,449.75
63% tp5o_webext responsiveness windows10-64 pgo e10s stylo2.59 -> 0.96
62% tp5o_webext responsiveness windows10-64 opt e10s stylo2.77 -> 1.05
60% tp5o_scroll windows7-32 pgo e10s stylo 2.12 -> 0.84
60% speedometer windows7-32 pgo e10s stylo 44.88 -> 71.83
60% tp5o_scroll windows7-32 opt e10s stylo 2.17 -> 0.87
60% tp5o_webext responsiveness windows7-32 pgo e10s stylo2.23 -> 0.89
59% stylebench windows10-64 pgo e10s stylo 45.47 -> 72.15
57% tscrollx windows7-32 pgo e10s stylo 2.55 -> 1.09
55% tp5o_scroll windows10-64 pgo e10s stylo 1.74 -> 0.79
54% a11yr windows10-64 opt e10s stylo 533.80 -> 246.73
53% stylebench windows7-32 pgo e10s stylo 43.36 -> 66.54
53% tscrollx windows7-32 opt e10s stylo 2.55 -> 1.20
53% tscrollx windows10-64 pgo e10s stylo 2.39 -> 1.12
50% a11yr windows7-32 opt e10s stylo 635.07 -> 314.90
50% tsvgx windows7-32 pgo e10s stylo 373.39 -> 185.20
49% tscrollx windows10-64 opt e10s stylo 2.22 -> 1.13
49% tp5o_scroll windows10-64 opt e10s stylo 1.75 -> 0.90
47% a11yr windows10-64 pgo e10s stylo 355.96 -> 189.47
45% tp6_amazon windows10-64 opt e10s stylo 562.02 -> 306.92
45% tsvgr_opacity windows10-64 opt e10s stylo 228.89 -> 125.73
45% tsvgr_opacity windows7-32 pgo e10s stylo 213.87 -> 117.91
44% a11yr windows7-32 pgo e10s stylo 370.38 -> 205.75
44% tp6_google windows10-64 opt e10s stylo 790.17 -> 439.00
44% tsvgr_opacity windows7-32 opt e10s stylo 253.99 -> 142.50
43% tsvgx windows7-32 opt e10s stylo 434.84 -> 246.29
42% tp6_amazon windows7-32 pgo e10s stylo 494.25 -> 286.79
42% tp6_amazon windows7-32 opt e10s stylo 644.98 -> 374.62
41% tsvgr_opacity windows10-64 pgo e10s stylo 201.21 -> 119.43
41% about_preferences_basic windows10-64 opt e10s stylo246.18 -> 146.34
40% tp6_google windows7-32 opt e10s stylo 800.27 -> 480.67
40% tp6_amazon windows10-64 pgo e10s stylo 453.90 -> 273.25
40% tp6_google windows10-64 pgo e10s stylo 670.73 -> 404.38
40% perf_reftest_singletons windows10-64 opt e10s stylo26.93 -> 16.28
39% tp6_facebook windows10-64 opt e10s stylo 311.71 -> 189.83
39% kraken windows7-32 opt e10s stylo 1,713.26 -> 1,052.08
38% tart windows7-32 opt e10s stylo 4.58 -> 2.84
38% ts_paint windows7-32 opt e10s stylo 636.33 -> 395.50
38% kraken windows10-64 pgo e10s stylo 1,548.29 -> 964.94
37% kraken windows10-64 opt e10s stylo 1,588.16 -> 993.19
37% perf_reftest_singletons windows7-32 opt e10s stylo26.87 -> 16.82
37% about_preferences_basic windows10-64 pgo e10s stylo207.35 -> 130.53
37% sessionrestore windows7-32 opt e10s stylo 460.46 -> 290.42
37% sessionrestore_many_windows windows10-64 opt e10s stylo1,472.83 -> 930.83
37% sessionrestore windows10-64 opt e10s stylo 415.96 -> 263.42
37% tpaint windows10-64 opt e10s stylo 241.61 -> 153.26
36% sessionrestore_no_auto_restore windows10-64 opt e10s stylo495.42 -> 315.33
36% tart windows7-32 pgo e10s stylo 3.84 -> 2.45
36% ts_paint_webext windows7-32 opt e10s stylo 718.88 -> 458.92
36% sessionrestore_no_auto_restore windows7-32 opt e10s stylo542.00 -> 346.50
36% perf_reftest_singletons windows10-64 pgo e10s stylo23.63 -> 15.11
36% kraken windows7-32 pgo e10s stylo 1,663.59 -> 1,063.78
36% displaylist_mutate windows10-64 opt e10s stylo6,934.45 -> 4,471.73
35% sessionrestore_many_windows windows7-32 opt e10s stylo1,587.04 -> 1,025.92
35% cpstartup content-process-startup windows10-64 opt e10s stylo284.29 -> 185.92
34% about_preferences_basic windows7-32 opt e10s stylo246.19 -> 162.13
34% ts_paint windows7-32 pgo e10s stylo 554.71 -> 365.67
34% tp6_google windows7-32 pgo e10s stylo 646.79 -> 428.92
34% perf_reftest windows7-32 opt e10s stylo 2.59 -> 1.72
34% perf_reftest_singletons windows7-32 pgo e10s stylo22.51 -> 14.96
33% sessionrestore windows10-64 pgo e10s stylo 366.38 -> 244.58
33% sessionrestore_many_windows windows10-64 pgo e10s stylo1,255.38 -> 840.00
33% ts_paint windows10-64 opt e10s stylo 548.21 -> 367.75
33% ts_paint_webext windows10-64 opt e10s stylo 621.46 -> 418.75
32% tp6_facebook windows7-32 opt e10s stylo 300.27 -> 202.79
32% sessionrestore_no_auto_restore windows10-64 pgo e10s stylo435.42 -> 295.00
32% tart windows10-64 opt e10s stylo 3.91 -> 2.66
32% ts_paint_webext windows7-32 pgo e10s stylo 619.04 -> 422.17
32% cpstartup content-process-startup windows10-64 pgo e10s stylo261.71 -> 179.08
31% damp windows10-64 opt e10s stylo 109.03 -> 74.82
31% cpstartup content-process-startup windows7-32 opt e10s stylo290.25 -> 199.42
31% displaylist_mutate windows7-32 opt e10s stylo8,824.82 -> 6,105.05
30% sessionrestore windows7-32 pgo e10s stylo 381.12 -> 265.25
30% tart windows10-64 pgo e10s stylo 3.45 -> 2.40
30% tp6_facebook windows10-64 pgo e10s stylo 254.94 -> 177.79
30% rasterflood_svg windows7-32 opt e10s stylo 16,383.11 -> 11,442.58
30% ts_paint_webext windows10-64 pgo e10s stylo 548.17 -> 385.00
30% tpaint windows10-64 pgo e10s stylo 202.91 -> 142.61
29% ts_paint windows10-64 pgo e10s stylo 485.58 -> 343.58
29% damp windows10-64 pgo e10s stylo 95.27 -> 67.62
29% sessionrestore_many_windows windows7-32 pgo e10s stylo1,264.38 -> 900.17
29% damp windows7-32 opt e10s stylo 114.60 -> 81.69
29% sessionrestore_no_auto_restore windows7-32 pgo e10s stylo448.25 -> 320.50
28% displaylist_mutate windows10-64 pgo e10s stylo5,848.54 -> 4,196.78
28% perf_reftest windows7-32 pgo e10s stylo 2.36 -> 1.69
28% perf_reftest windows10-64 pgo e10s stylo 2.32 -> 1.66
28% perf_reftest windows10-64 opt e10s stylo 2.52 -> 1.81
27% basic_compositor_video windows10-64 opt e10s stylo3.71 -> 2.71
26% basic_compositor_video windows10-64 pgo e10s stylo3.68 -> 2.71
26% basic_compositor_video windows7-32 opt e10s stylo3.68 -> 2.71
26% rasterflood_svg windows7-32 pgo e10s stylo 15,352.19 -> 11,325.08
26% basic_compositor_video windows7-32 pgo e10s stylo3.65 -> 2.71
26% tp6_youtube windows7-32 opt e10s stylo 275.75 -> 204.50
26% tp6_facebook windows7-32 pgo e10s stylo 245.81 -> 182.83
26% damp windows7-32 pgo e10s stylo 95.26 -> 70.95
25% about_preferences_basic windows7-32 pgo e10s stylo189.99 -> 141.79
25% displaylist_mutate windows7-32 pgo e10s stylo6,347.07 -> 4,767.63
24% tpaint windows7-32 pgo e10s stylo 192.01 -> 145.46
23% cpstartup content-process-startup windows7-32 pgo e10s stylo251.67 -> 192.75
23% tabpaint windows10-64 pgo e10s stylo 67.19 -> 51.64
20% tps windows10-64 opt e10s stylo 23.27 -> 18.67
19% tp5o_webext windows10-64 opt e10s stylo 346.66 -> 280.43
17% tabpaint windows10-64 opt e10s stylo 69.40 -> 57.38
17% tsvg_static windows10-64 opt e10s stylo 52.41 -> 43.49
15% tsvg_static windows7-32 opt e10s stylo 52.29 -> 44.34
15% tps windows10-64 pgo e10s stylo 21.60 -> 18.34
15% tsvg_static windows7-32 pgo e10s stylo 52.56 -> 44.81
14% tabpaint windows7-32 pgo e10s stylo 62.52 -> 53.59
9% tsvg_static windows10-64 pgo e10s stylo 47.83 -> 43.37
8% tp5o_webext windows10-64 pgo e10s stylo 281.94 -> 260.54
6% rasterflood_svg windows10-64 opt e10s stylo 11,563.54 -> 10,868.47
4% rasterflood_svg windows10-64 pgo e10s stylo 11,265.84 -> 10,778.72
For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=12427
Reporter | ||
Comment 1•7 years ago
|
||
:jmaher Lots and lots and perf improvements on Windows from now on -- perf baseline update. I filed this bug only to highlight the PGO regressions according to tp5o. Their OPT counterparts record quite the opposite: perf improvements.
I guess I can close this bug as WORKSFORME, as it sounds like a temporary glitch?
Also, if I blocked the wrong bug from the patch, please adjust this.
Flags: needinfo?(jmaher)
Comment 2•7 years ago
|
||
yes, thanks for filing this- this change is just the new hardware and the PGO only regressions are confusing but not really actionable if OPT is an improvement.
Status: NEW → RESOLVED
Closed: 7 years ago
Flags: needinfo?(jmaher)
Resolution: --- → WORKSFORME
You need to log in
before you can comment on or make changes to this bug.
Description
•