Closed
Bug 1572739
Opened 5 years ago
Closed 4 years ago
Move linux hardware testers to ubuntu1804
Categories
(Infrastructure & Operations :: RelOps: Posix OS, task)
Infrastructure & Operations
RelOps: Posix OS
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: dhouse, Assigned: aerickson)
References
Details
(Keywords: perf-alert)
Attachments
(4 files, 1 obsolete file)
(In reply to Mike Hommey [:glandium] from https://bugzilla.mozilla.org/show_bug.cgi?id=1565332#1)
I know you spent time on this, but I think we shouldn't do this. We should instead switch the test image to Debian. Why? Because we can actually reproducibly build Debian images, but we can't do that for Ubuntu. And not being able to do that means things can break whenever some unrelated change triggers a new docker image build, which has happened a lot until we finally bailed and used a hack (bug 1503756)
f+'d by ryanvm, tomprince, jmaher
(In reply to Joel Maher ( :jmaher ) (UTC-4) from https://bugzilla.mozilla.org/show_bug.cgi?id=1565332#c33)
I would prefer all our linux test machines use the same image. This means:
32 bit linux aws
64 bit linux aws
linux hardware in datacenter
(possibly bitbar)
(possibly packet.net base image for emulators)
egao and glandium are working through the move and resolving issues for docker-worker
It looks like we need to switch the hardware, and maybe move or be involved with the move for the cloud workers
|
||
Comment 1•5 years ago
|
||
:dhouse - assuming that I am able to produce a reliable, stable debian10 test image (which has been a struggle), what would be involved in the second part of your comment (one from Joel):
would prefer all our linux test machines use the same image. This means:
32 bit linux aws
64 bit linux aws
linux hardware in datacenter
(possibly bitbar)
(possibly packet.net base image for emulators)
I understand the 32/64bit linux AWS would simply be the normal CI.
Linux hardware in datacentre - what hardware do we have? I have my test image defined in the form of a Docker image, so perhaps the approach is to mirror the AWS scenario? I am not too well versed with these other hardwares.
Flags: needinfo?(dhouse)
(In reply to Edwin Takahashi (:egao, :etakahashi) from comment #1)
:dhouse - assuming that I am able to produce a reliable, stable debian10 test image (which has been a struggle), what would be involved in the second part of your comment (one from Joel):
would prefer all our linux test machines use the same image. This means: 32 bit linux aws 64 bit linux aws linux hardware in datacenter (possibly bitbar) (possibly packet.net base image for emulators)I understand the 32/64bit linux AWS would simply be the normal CI.
Linux hardware in datacentre - what hardware do we have? I have my test image defined in the form of a Docker image, so perhaps the approach is to mirror the AWS scenario? I am not too well versed with these other hardwares.
:egao, I/relops will need to translate the docker container setup to an install of Debian on our HP moonshot cartridges (for perf tests). For the bitbar and packet.net (android tests), I think we'll need to talk with aerickson. I don't know if that is necessarily part of this migration.
When you are close, I'll set up 3-4 of the moonshot machines with Debian and we can start adding packages and configuring them.
I haven't been closely watching the move to Debian for test workers. Is there a plan for upgrading the OS on the workers once they're all on Debian (like every 6months or to use rolling updates?).
Thanks for bringing this up!
Flags: needinfo?(dhouse)
|
Assignee | |
Comment 3•5 years ago
|
||
re: bitbar, We're just finishing up testing on our move to Ubuntu 18.04 to get a modern python 3 (3.6). Moving to debian 10 should be pretty easy. I'll just have to change the Docker file (https://github.com/bclary/mozilla-bitbar-docker/blob/master/Dockerfile) and test.
re: packet, Wander/TC are handling this for now (relops will eventually own).
|
|
||
Comment 4•5 years ago
|
||
I have changed the bug to refer to ubuntu1804 since that is the new path I have chosen to pursue at this time due to difficulties with debian10.
Summary: Move linux testers to debian → Move linux testers to ubuntu1804
|
||
Updated•5 years ago
|
Assignee: nobody → aerickson
|
|
Assignee | |
Updated•5 years ago
|
Summary: Move linux testers to ubuntu1804 → Move linux hardware testers to ubuntu1804
|
|
Assignee | |
Comment 5•5 years ago
|
||
in progress puppet PR: https://github.com/mozilla-platform-ops/ronin_puppet/pull/165
|
|
Assignee | |
Updated•5 years ago
|
|
|
Assignee | |
Updated•4 years ago
|
Status: NEW → ASSIGNED
|
|
Assignee | |
Comment 6•4 years ago
|
||
First PR has landed. Second PR: https://github.com/mozilla-platform-ops/ronin_puppet/pull/219
|
|
Assignee | |
Comment 7•4 years ago
|
||
Worker Type: gecko-t-linux-talos-1804
https://firefox-ci-tc.services.mozilla.com/provisioners/releng-hardware/worker-types/gecko-t-linux-talos-1804
Current status:
- 30 1804 workers in MDC1
Working on growing to 75 (min) - 95 (ideal) workers and scheduling tasks in tree.
|
|
Assignee | |
Comment 8•4 years ago
|
||
|
||
Updated•4 years ago
|
Attachment #9202161 -
Attachment description: Bug 1572739: add 1804 workers and schedule work → Bug 1572739: add 1804 hw workers and schedule work
|
||
Comment 9•4 years ago
|
||
duplicate linux talos tasks for both 1604 and 1804.
|
|
||
Updated•4 years ago
|
Attachment #9202161 -
Attachment is obsolete: true
|
||
Comment 10•4 years ago
|
||
Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/1374f3cd9ec2 duplicate linux talos tasks for both 1604 and 1804. r=sparky
|
||
Comment 11•4 years ago
|
||
| bugherder | ||
Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
|
|
Assignee | |
Comment 12•4 years ago
|
||
Currently at 74 1804 workers. Still targeting 95.
|
|
Assignee | |
Comment 13•4 years ago
|
||
We're at 97 workers.
|
|
Assignee | |
Updated•4 years ago
|
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
|
|
Assignee | |
Comment 14•4 years ago
|
||
We're currently duplicating 1604 talos jobs to the 1804 workers. The plan is to disable the 1604 workers on or around March 1st.
|
|
||
Comment 15•4 years ago
|
||
remove duplicate linux perf tasks
|
|
||
Comment 16•4 years ago
|
||
Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/9187a95143a1 remove duplicate linux perf tasks. r=aerickson
|
||
Comment 17•4 years ago
|
||
| bugherder | ||
Status: REOPENED → RESOLVED
Closed: 4 years ago → 4 years ago
Resolution: --- → FIXED
|
|
||
Comment 18•4 years ago
|
||
please upload the second revision https://hg.mozilla.org/mozilla-central/rev/9187a95143a1 to beta
Whiteboard: [checkin-needed-beta]
|
||
Comment 19•4 years ago
|
||
| bugherder uplift | ||
Whiteboard: [checkin-needed-beta]
|
||
Comment 20•4 years ago
|
||
(In reply to Pulsebot from comment #16)
Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/9187a95143a1
remove duplicate linux perf tasks. r=aerickson
== Change summary for alert #29006 (as of Tue, 02 Mar 2021 22:14:17 GMT) ==
Regressions:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 34% | a11yr | dhtml.html | linux64-shippable-qr | e10s stylo webrender | 351.03 -> 472.08 |
| 25% | pdfpaint | linux64-shippable-qr | e10s stylo webrender | 389.16 -> 487.71 | |
| 13% | kraken | linux64-shippable | e10s stylo | 1,266.13 -> 1,427.62 | |
| 7% | tp5o_scroll | linux64-shippable-qr | e10s stylo webrender-sw | 1.87 -> 1.99 |
Improvements:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 67% | twinopen | ext+twinopen:twinopen.html | linux64-shippable-qr | e10s stylo webrender | 330.91 -> 110.33 |
| 25% | sessionrestore | sessionrestore | linux64-shippable-qr | e10s stylo webrender | 689.00 -> 519.50 |
| 19% | startup_about_home_paint | startup_about_home_paint | linux64-shippable-qr | e10s stylo webrender | 858.75 -> 696.67 |
| 9% | ts_paint | ts_paint | linux64-shippable-qr | e10s stylo webrender | 251.17 -> 229.00 |
| 8% | tabpaint | linux64-shippable-qr | e10s stylo webrender | 48.90 -> 44.77 | |
| 5% | tabswitch | linux64-shippable-qr | e10s stylo webrender | 5.98 -> 5.69 |
For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=29006
|
||
Comment 21•4 years ago
|
||
(In reply to Bogdan Tara[:bogdan_tara | bogdant] from comment #17)
== Change summary for alert #29016 (as of Wed, 03 Mar 2021 05:57:34 GMT) ==
Regressions:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 258% | imgur | FirstVisualChange | windows10-64-shippable-qr | nocondprof warm webrender | 81.75 -> 292.42 |
| 214% | google-sheets | LastVisualChange | linux64-shippable | nocondprof warm | 2,083.33 -> 6,540.00 |
| 166% | ebay | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 959.08 -> 2,546.58 |
| 165% | ebay | SpeedIndex | linux64-shippable | cold nocondprof | 964.92 -> 2,556.75 |
| 132% | ebay | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 2,073.33 -> 4,816.67 |
| 129% | ebay | LastVisualChange | linux64-shippable | cold nocondprof | 2,096.67 -> 4,806.67 |
| 98% | imgur | ContentfulSpeedIndex | windows10-64-shippable-qr | cold nocondprof webrender | 1,319.79 -> 2,614.33 |
| 97% | ebay | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 925.75 -> 1,826.92 |
| 96% | ebay | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 928.17 -> 1,821.08 |
| 93% | LastVisualChange | linux64-shippable | nocondprof warm | 2,270.00 -> 4,370.00 | |
| 88% | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 2,326.67 -> 4,383.33 | |
| 64% | LastVisualChange | linux64-shippable | cold nocondprof | 3,140.00 -> 5,136.67 | |
| 61% | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 3,233.33 -> 5,216.67 | |
| 51% | yandex | fcp | linux64-shippable-qr | nocondprof warm webrender | 45.33 -> 68.25 |
| 46% | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 160.00 -> 233.33 | |
| 39% | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 165.00 -> 230.00 | |
| 36% | youtube | SpeedIndex | linux64-shippable | nocondprof warm | 731.83 -> 996.92 |
| 36% | paypal | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 323.33 -> 440.00 |
| 35% | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 200.00 -> 270.00 | |
| 33% | outlook | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 240.00 -> 320.00 |
| 32% | fcp | linux64-shippable-qr | nocondprof warm webrender | 143.29 -> 189.21 | |
| 32% | paypal | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 366.00 -> 483.08 |
| 32% | fcp | linux64-shippable-qr | nocondprof warm webrender | 143.17 -> 188.75 | |
| 32% | paypal | fcp | linux64-shippable-qr | nocondprof warm webrender | 315.88 -> 415.67 |
| 31% | paypal | fcp | linux64-shippable | nocondprof warm | 315.62 -> 413.46 |
| 31% | netflix | LastVisualChange | linux64-shippable | nocondprof warm | 1,163.33 -> 1,520.00 |
| 30% | paypal | linux64-shippable | nocondprof warm | 401.51 -> 523.61 | |
| 30% | yandex | linux64-shippable-qr | nocondprof warm webrender | 76.00 -> 98.90 | |
| 30% | fcp | linux64-shippable-qr | cold nocondprof webrender | 172.62 -> 224.12 | |
| 30% | paypal | linux64-shippable-qr | nocondprof warm webrender | 403.66 -> 523.57 | |
| 29% | fcp | linux64-shippable-qr | nocondprof warm webrender | 169.75 -> 219.46 | |
| 29% | netflix | fcp | linux64-shippable-qr | nocondprof warm webrender | 60.27 -> 77.83 |
| 28% | google-docs | fcp | linux64-shippable-qr | cold nocondprof webrender | 383.33 -> 491.17 |
| 28% | google-docs | fcp | linux64-shippable | cold nocondprof | 380.83 -> 487.38 |
| 28% | youtube | linux64-shippable-qr | nocondprof warm webrender | 452.58 -> 578.64 | |
| 28% | yahoo-news | fcp | linux64-shippable-qr | nocondprof warm webrender | 280.29 -> 358.33 |
| 28% | youtube | linux64-shippable | nocondprof warm | 436.53 -> 556.91 | |
| 27% | outlook | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 440.00 -> 560.00 |
| 27% | fcp | linux64-shippable-qr | cold nocondprof webrender | 173.08 -> 220.12 | |
| 27% | outlook | fcp | linux64-shippable-qr | cold nocondprof webrender | 156.42 -> 198.58 |
| 27% | tumblr | fcp | linux64-shippable-qr | nocondprof warm webrender | 160.71 -> 204.00 |
| 27% | outlook | fcp | linux64-shippable | cold nocondprof | 155.21 -> 197.00 |
| 27% | fandom | fcp | linux64-shippable | nocondprof warm | 152.25 -> 193.17 |
| 27% | fcp | linux64-shippable-qr | nocondprof warm webrender | 174.46 -> 220.92 | |
| 26% | google-slides | fcp | linux64-shippable-qr | cold nocondprof webrender | 409.17 -> 516.92 |
| 26% | paypal | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 542.67 -> 685.25 |
| 26% | apple | fcp | linux64-shippable | nocondprof warm | 232.29 -> 293.17 |
| 26% | ebay | fcp | linux64-shippable-qr | nocondprof warm webrender | 175.08 -> 220.62 |
| 26% | paypal | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 484.00 -> 609.33 |
| 26% | yahoo-news | fcp | linux64-shippable | nocondprof warm | 277.79 -> 349.54 |
| 26% | apple | linux64-shippable | nocondprof warm | 232.98 -> 292.96 | |
| 26% | google-docs | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 390.00 -> 490.00 |
| 26% | microsoft | fcp | linux64-shippable-qr | nocondprof warm webrender | 175.62 -> 220.50 |
| 25% | paypal | loadtime | linux64-shippable-qr | nocondprof warm webrender | 642.54 -> 805.92 |
| 25% | bing-search | loadtime | linux64-shippable-qr | nocondprof warm webrender | 171.42 -> 214.62 |
| 25% | netflix | LastVisualChange | linux64-shippable | cold nocondprof | 1,286.67 -> 1,610.00 |
| 25% | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 160.00 -> 200.00 | |
| 25% | apple | fcp | linux64-shippable-qr | nocondprof warm webrender | 242.00 -> 302.25 |
| 25% | apple | linux64-shippable-qr | nocondprof warm webrender | 240.44 -> 299.81 | |
| 24% | netflix | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 1,286.67 -> 1,600.00 |
| 24% | apple | loadtime | linux64-shippable | nocondprof warm | 240.38 -> 298.25 |
| 24% | apple | loadtime | linux64-shippable-qr | nocondprof warm webrender | 243.21 -> 301.75 |
| 24% | bing-search | fcp | linux64-shippable-qr | nocondprof warm webrender | 179.54 -> 222.71 |
| 24% | bing-search | linux64-shippable-qr | nocondprof warm webrender | 179.86 -> 222.62 | |
| 24% | google-mail | loadtime | linux64-shippable | nocondprof warm | 487.50 -> 603.29 |
| 24% | cnn-ampstories | linux64-shippable | nocondprof warm | 72.17 -> 89.21 | |
| 23% | paypal | loadtime | linux64-shippable | nocondprof warm | 638.29 -> 788.21 |
| 23% | yahoo-news | loadtime | linux64-shippable-qr | nocondprof warm webrender | 361.29 -> 445.83 |
| 23% | yahoo-news | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 356.67 -> 440.00 |
| 23% | yahoo-news | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 372.17 -> 458.58 |
| 23% | yahoo-mail | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 260.00 -> 320.00 |
| 23% | yahoo-mail | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 367.25 -> 451.58 |
| 23% | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 160.00 -> 196.67 | |
| 23% | linux64-shippable-qr | cold nocondprof webrender | 377.45 -> 463.79 | ||
| 23% | yahoo-news | linux64-shippable-qr | nocondprof warm webrender | 292.17 -> 358.87 | |
| 23% | bing-search | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 206.83 -> 253.42 |
| 23% | google-docs | FirstVisualChange | linux64-shippable | cold nocondprof | 400.00 -> 490.00 |
| 22% | youtube | fcp | linux64-shippable-qr | nocondprof warm webrender | 207.67 -> 254.17 |
| 22% | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 314.75 -> 385.17 | |
| 22% | linux64-shippable-qr | nocondprof warm webrender | 221.75 -> 270.99 | ||
| 22% | fcp | linux64-shippable | nocondprof warm | 145.00 -> 177.00 | |
| 22% | yahoo-news | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 408.75 -> 498.50 |
| 22% | yandex | fcp | linux64-shippable-qr | cold nocondprof webrender | 224.54 -> 273.83 |
| 22% | linux64-shippable-qr | nocondprof warm webrender | 253.84 -> 309.06 | ||
| 22% | google-sheets | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 230.00 -> 280.00 |
| 21% | google-slides | fcp | linux64-shippable | cold nocondprof | 408.38 -> 495.79 |
| 21% | fandom | linux64-shippable | nocondprof warm | 229.42 -> 278.50 | |
| 21% | google-mail | linux64-shippable | nocondprof warm | 553.87 -> 672.35 | |
| 21% | microsoft | linux64-shippable-qr | nocondprof warm webrender | 201.43 -> 244.36 | |
| 21% | youtube | SpeedIndex | linux64-shippable | cold nocondprof | 1,139.92 -> 1,381.75 |
| 21% | yahoo-news | linux64-shippable | nocondprof warm | 291.18 -> 352.71 | |
| 21% | yahoo-news | loadtime | linux64-shippable | nocondprof warm | 370.62 -> 448.62 |
| 21% | microsoft | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 206.92 -> 250.33 |
| 21% | netflix | linux64-shippable-qr | nocondprof warm webrender | 190.63 -> 230.48 | |
| 21% | bing-search | loadtime | linux64-shippable | nocondprof warm | 169.12 -> 204.33 |
| 21% | microsoft | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 416.67 -> 503.33 |
| 21% | google-sheets | fcp | linux64-shippable-qr | nocondprof warm webrender | 213.88 -> 258.33 |
| 21% | google-slides | fcp | linux64-shippable | nocondprof warm | 180.25 -> 217.58 |
| 21% | youtube | fcp | linux64-shippable | nocondprof warm | 200.92 -> 242.46 |
| 20% | google-docs | fcp | linux64-shippable-qr | nocondprof warm webrender | 210.17 -> 253.12 |
| 20% | yahoo-news | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 431.67 -> 519.58 |
| 20% | microsoft | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 201.92 -> 243.00 |
| 20% | fcp | linux64-shippable-qr | cold nocondprof webrender | 207.62 -> 249.83 | |
| 20% | google-sheets | linux64-shippable-qr | nocondprof warm webrender | 368.31 -> 442.64 | |
| 20% | ebay | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 802.50 -> 964.25 |
| 20% | bing-search | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 200.00 -> 240.00 |
| 20% | google-slides | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 200.00 -> 240.00 |
| 20% | microsoft | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 200.00 -> 240.00 |
| 20% | outlook | FirstVisualChange | linux64-shippable | cold nocondprof | 466.67 -> 560.00 |
| 20% | microsoft | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 203.83 -> 244.33 |
| 20% | tumblr | linux64-shippable-qr | nocondprof warm webrender | 246.87 -> 295.59 | |
| 20% | ebay | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 803.83 -> 961.92 |
| 20% | bing-search | fcp | linux64-shippable-qr | cold nocondprof webrender | 224.96 -> 269.12 |
| 19% | microsoft | fcp | linux64-shippable-qr | cold nocondprof webrender | 461.79 -> 550.50 |
| 19% | imdb | loadtime | linux64-shippable | nocondprof warm | 853.33 -> 1,016.38 |
| 19% | google-slides | fcp | linux64-shippable-qr | nocondprof warm webrender | 189.71 -> 225.92 |
| 19% | linux64-shippable-qr | cold nocondprof webrender | 430.38 -> 512.04 | ||
| 19% | yahoo-mail | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 279.75 -> 332.67 |
| 19% | google-search | fcp | linux64-shippable-qr | nocondprof warm webrender | 214.67 -> 254.92 |
| 19% | office | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 640.00 -> 760.00 |
| 19% | google-docs | linux64-shippable | nocondprof warm | 375.34 -> 445.23 | |
| 19% | google-docs | fcp | linux64-shippable | nocondprof warm | 206.79 -> 245.21 |
| 19% | microsoft | fcp | linux64-shippable | nocondprof warm | 177.00 -> 209.79 |
| 18% | google-docs | loadtime | linux64-shippable | nocondprof warm | 781.04 -> 925.21 |
| 18% | google-search | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | google-search | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | google-search | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | google-search | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | google-search | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | youtube | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 236.67 -> 280.00 |
| 18% | facebook-redesign | fcp | linux64-shippable | nocondprof warm | 362.62 -> 428.75 |
| 18% | bing-search | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 251.58 -> 297.42 |
| 18% | google-mail | fcp | linux64-shippable | cold nocondprof | 479.21 -> 566.38 |
| 18% | google-slides | FirstVisualChange | linux64-shippable | cold nocondprof | 440.00 -> 520.00 |
| 18% | fandom | loadtime | linux64-shippable | nocondprof warm | 350.42 -> 414.08 |
| 18% | wikipedia | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 1,160.00 -> 1,370.00 |
| 18% | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 240.00 -> 283.33 | |
| 18% | google-sheets | fcp | linux64-shippable-qr | cold nocondprof webrender | 495.00 -> 584.29 |
| 18% | google-docs | linux64-shippable-qr | nocondprof warm webrender | 387.11 -> 456.71 | |
| 18% | google-mail | loadtime | linux64-shippable | cold nocondprof | 903.42 -> 1,065.62 |
| 18% | ebay | fcp | linux64-shippable | nocondprof warm | 177.98 -> 209.92 |
| 18% | google-mail | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 1,145.42 -> 1,350.25 |
| 18% | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,355.38 -> 1,597.62 | |
| 18% | office | linux64-shippable-qr | nocondprof warm webrender | 537.58 -> 633.34 | |
| 18% | bing-search | linux64-shippable-qr | cold nocondprof webrender | 251.25 -> 295.98 | |
| 18% | linux64-shippable-qr | nocondprof warm webrender | 383.05 -> 451.08 | ||
| 18% | linux64-shippable | nocondprof warm | 219.14 -> 257.94 | ||
| 18% | microsoft | linux64-shippable | nocondprof warm | 199.13 -> 234.37 | |
| 18% | fcp | linux64-shippable | cold nocondprof | 177.04 -> 208.29 | |
| 18% | ebay | linux64-shippable-qr | nocondprof warm webrender | 244.37 -> 287.42 | |
| 18% | yahoo-mail | fcp | linux64-shippable-qr | nocondprof warm webrender | 246.17 -> 289.54 |
| 18% | fcp | linux64-shippable-qr | nocondprof warm webrender | 234.19 -> 275.29 | |
| 17% | yahoo-mail | linux64-shippable-qr | nocondprof warm webrender | 357.93 -> 420.49 | |
| 17% | fcp | linux64-shippable | nocondprof warm | 228.58 -> 268.38 | |
| 17% | microsoft | fcp | linux64-shippable | cold nocondprof | 457.00 -> 536.42 |
| 17% | facebook-redesign | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 403.33 -> 473.33 |
| 17% | google-mail | linux64-shippable | cold nocondprof | 591.21 -> 693.83 | |
| 17% | office | fcp | linux64-shippable-qr | nocondprof warm webrender | 548.46 -> 643.58 |
| 17% | google-search | linux64-shippable-qr | nocondprof warm webrender | 232.42 -> 272.60 | |
| 17% | yahoo-mail | loadtime | linux64-shippable-qr | nocondprof warm webrender | 515.62 -> 604.58 |
| 17% | bing-search | linux64-shippable | nocondprof warm | 186.20 -> 218.31 | |
| 17% | facebook-redesign | linux64-shippable | nocondprof warm | 295.55 -> 346.16 | |
| 17% | office | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 686.92 -> 802.58 |
| 17% | wikipedia | fcp | linux64-shippable | nocondprof warm | 757.25 -> 883.88 |
| 17% | yahoo-mail | fcp | linux64-shippable-qr | cold nocondprof webrender | 284.62 -> 332.12 |
| 17% | ebay | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 200.00 -> 233.33 |
| 17% | facebook-redesign | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 423.67 -> 494.08 |
| 17% | google-slides | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,057.92 -> 1,233.67 |
| 17% | fcp | linux64-shippable | nocondprof warm | 261.38 -> 304.75 | |
| 16% | outlook | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 516.00 -> 601.08 |
| 16% | google-mail | FirstVisualChange | linux64-shippable | nocondprof warm | 1,093.33 -> 1,270.00 |
| 16% | google-mail | SpeedIndex | linux64-shippable | nocondprof warm | 1,103.75 -> 1,282.17 |
| 16% | office | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 717.58 -> 833.17 |
| 16% | youtube | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 909.08 -> 1,055.50 |
| 16% | google-mail | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 1,120.67 -> 1,301.00 |
| 16% | office | linux64-shippable | nocondprof warm | 524.49 -> 608.88 | |
| 16% | google-mail | LastVisualChange | linux64-shippable | nocondprof warm | 2,125.00 -> 2,466.67 |
| 16% | google-sheets | loadtime | linux64-shippable | nocondprof warm | 922.71 -> 1,070.96 |
| 16% | google-slides | SpeedIndex | linux64-shippable | cold nocondprof | 777.83 -> 901.92 |
| 16% | bing-search | fcp | linux64-shippable | nocondprof warm | 186.71 -> 216.33 |
| 16% | facebook-redesign | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 418.67 -> 484.25 |
| 16% | google-docs | loadtime | linux64-shippable-qr | nocondprof warm webrender | 815.04 -> 942.25 |
| 16% | facebook-redesign | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 426.83 -> 493.25 |
| 16% | office | fcp | linux64-shippable | nocondprof warm | 533.21 -> 616.17 |
| 16% | outlook | linux64-shippable | cold nocondprof | 288.84 -> 333.78 | |
| 15% | imdb | linux64-shippable | nocondprof warm | 579.53 -> 669.31 | |
| 15% | google-search | loadtime | linux64-shippable | nocondprof warm | 269.29 -> 310.92 |
| 15% | yandex | fcp | linux64-shippable | cold nocondprof | 224.75 -> 259.50 |
| 15% | ebay | linux64-shippable | nocondprof warm | 250.89 -> 289.54 | |
| 15% | google-sheets | linux64-shippable | nocondprof warm | 362.80 -> 418.55 | |
| 15% | microsoft | loadtime | linux64-shippable | nocondprof warm | 284.25 -> 327.83 |
| 15% | google-search | linux64-shippable | nocondprof warm | 229.07 -> 264.14 | |
| 15% | wikipedia | loadtime | linux64-shippable-qr | nocondprof warm webrender | 807.88 -> 931.50 |
| 15% | linux64-shippable | nocondprof warm | 385.32 -> 444.23 | ||
| 15% | imgur | linux64-shippable-qr | nocondprof warm webrender | 287.75 -> 331.67 | |
| 15% | google-sheets | linux64-shippable-qr | cold nocondprof webrender | 769.83 -> 887.02 | |
| 15% | imdb | fcp | linux64-shippable | nocondprof warm | 497.00 -> 572.17 |
| 15% | yahoo-mail | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 1,040.00 -> 1,196.67 |
| 15% | google-sheets | fcp | linux64-shippable | nocondprof warm | 212.12 -> 244.00 |
| 15% | imdb | LastVisualChange | linux64-shippable | nocondprof warm | 890.00 -> 1,023.33 |
| 15% | linux64-shippable-qr | nocondprof warm webrender | 415.46 -> 477.71 | ||
| 15% | google-search | fcp | linux64-shippable | nocondprof warm | 212.25 -> 243.92 |
| 15% | microsoft | loadtime | linux64-shippable-qr | nocondprof warm webrender | 294.79 -> 338.75 |
| 15% | linux64-shippable-qr | nocondprof warm webrender | 468.40 -> 537.98 | ||
| 15% | microsoft | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 500.58 -> 574.58 |
| 15% | facebook-redesign | linux64-shippable-qr | nocondprof warm webrender | 306.50 -> 351.67 | |
| 15% | google-sheets | fcp | linux64-shippable | cold nocondprof | 490.54 -> 562.79 |
| 15% | google-slides | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 882.25 -> 1,012.00 |
| 15% | google-search | fcp | linux64-shippable-qr | cold nocondprof webrender | 273.83 -> 313.96 |
| 15% | office | loadtime | linux64-shippable-qr | nocondprof warm webrender | 735.42 -> 843.08 |
| 15% | amazon | fcp | linux64-shippable-qr | nocondprof warm webrender | 324.04 -> 371.42 |
| 15% | yahoo-news | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 439.58 -> 503.75 |
| 15% | paypal | SpeedIndex | linux64-shippable | nocondprof warm | 577.83 -> 662.08 |
| 15% | amazon | linux64-shippable-qr | nocondprof warm webrender | 372.82 -> 426.99 | |
| 15% | microsoft | linux64-shippable-qr | cold nocondprof webrender | 513.00 -> 587.42 | |
| 14% | netflix | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 607.25 -> 694.92 |
| 14% | apple | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 463.33 -> 530.00 |
| 14% | paypal | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 411.29 -> 470.25 |
| 14% | apple | fcp | linux64-shippable | cold nocondprof | 514.40 -> 588.04 |
| 14% | yahoo-news | FirstVisualChange | linux64-shippable | nocondprof warm | 385.00 -> 440.00 |
| 14% | wikipedia | loadtime | linux64-shippable | nocondprof warm | 794.62 -> 907.58 |
| 14% | outlook | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 897.58 -> 1,025.17 |
| 14% | facebook-redesign | fcp | linux64-shippable-qr | nocondprof warm webrender | 384.19 -> 438.58 |
| 14% | wikipedia | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 832.42 -> 950.17 |
| 14% | google-docs | linux64-shippable | cold nocondprof | 696.03 -> 794.14 | |
| 14% | yahoo-news | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 399.00 -> 455.17 |
| 14% | google-sheets | loadtime | linux64-shippable-qr | nocondprof warm webrender | 954.00 -> 1,088.00 |
| 14% | facebook-redesign | loadtime | linux64-shippable | nocondprof warm | 412.38 -> 469.83 |
| 14% | linux64-shippable | nocondprof warm | 452.90 -> 516.00 | ||
| 14% | amazon | linux64-shippable | nocondprof warm | 361.53 -> 411.80 | |
| 14% | paypal | FirstVisualChange | linux64-shippable | nocondprof warm | 360.00 -> 410.00 |
| 14% | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 310.00 -> 353.00 | |
| 14% | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 247.00 -> 281.17 | |
| 14% | outlook | linux64-shippable-qr | cold nocondprof webrender | 292.90 -> 333.09 | |
| 14% | netflix | loadtime | linux64-shippable-qr | nocondprof warm webrender | 637.00 -> 724.25 |
| 14% | wikipedia | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 833.08 -> 946.92 |
| 14% | wikipedia | FirstVisualChange | linux64-shippable-qr | nocondprof warm webrender | 830.00 -> 943.33 |
| 14% | wikipedia | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 830.17 -> 943.42 |
| 14% | google-docs | linux64-shippable-qr | cold nocondprof webrender | 715.11 -> 812.49 | |
| 14% | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,096.83 -> 1,246.25 | |
| 14% | bing-search | loadtime | linux64-shippable-qr | cold nocondprof webrender | 340.67 -> 386.79 |
| 14% | netflix | loadtime | linux64-shippable | nocondprof warm | 590.67 -> 670.46 |
| 14% | wikipedia | LastVisualChange | linux64-shippable | nocondprof warm | 1,160.00 -> 1,316.67 |
| 14% | microsoft | linux64-shippable | cold nocondprof | 503.22 -> 571.16 | |
| 13% | apple | fcp | linux64-shippable-qr | cold nocondprof webrender | 520.88 -> 590.88 |
| 13% | office | loadtime | linux64-shippable | nocondprof warm | 718.83 -> 815.42 |
| 13% | youtube | loadtime | linux64-shippable-qr | nocondprof warm webrender | 1,208.04 -> 1,369.54 |
| 13% | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 394.83 -> 447.33 | |
| 13% | youtube | loadtime | linux64-shippable | nocondprof warm | 1,168.17 -> 1,323.58 |
| 13% | amazon | fcp | linux64-shippable | nocondprof warm | 307.50 -> 348.33 |
| 13% | amazon | loadtime | linux64-shippable-qr | nocondprof warm webrender | 523.71 -> 593.21 |
| 13% | google-sheets | linux64-shippable | cold nocondprof | 751.82 -> 851.48 | |
| 13% | google-mail | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,896.75 -> 2,147.25 |
| 13% | google-slides | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 589.83 -> 667.67 |
| 13% | yandex | loadtime | linux64-shippable-qr | nocondprof warm webrender | 133.25 -> 150.62 |
| 13% | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,817.00 -> 2,053.58 | |
| 13% | microsoft | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 511.75 -> 578.08 |
| 13% | google-search | linux64-shippable-qr | cold nocondprof webrender | 382.60 -> 432.16 | |
| 13% | youtube | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 823.08 -> 929.67 |
| 13% | google-search | FirstVisualChange | linux64-shippable | cold nocondprof | 283.33 -> 320.00 |
| 13% | youtube | fcp | linux64-shippable-qr | cold nocondprof webrender | 441.96 -> 498.88 |
| 13% | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 346.67 -> 390.83 | |
| 13% | google-slides | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 595.42 -> 671.08 |
| 13% | apple | FirstVisualChange | linux64-shippable | cold nocondprof | 485.22 -> 546.67 |
| 13% | loadtime | linux64-shippable | nocondprof warm | 974.17 -> 1,096.83 | |
| 13% | google-search | loadtime | linux64-shippable | cold nocondprof | 1,077.46 -> 1,213.08 |
| 13% | tumblr | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 358.08 -> 403.00 |
| 13% | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,527.42 -> 1,718.33 | |
| 12% | google-search | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 284.83 -> 320.42 |
| 12% | yahoo-news | SpeedIndex | linux64-shippable | nocondprof warm | 437.88 -> 492.33 |
| 12% | google-search | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 285.67 -> 321.17 |
| 12% | office | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 1,290.00 -> 1,450.00 |
| 12% | google-slides | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 517.08 -> 580.92 |
| 12% | office | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 916.75 -> 1,029.83 |
| 12% | paypal | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 519.75 -> 583.75 |
| 12% | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 564.92 -> 633.58 | |
| 12% | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 1,210.00 -> 1,357.08 | |
| 12% | google-mail | SpeedIndex | linux64-shippable | cold nocondprof | 1,776.83 -> 1,992.58 |
| 12% | youtube | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 440.00 -> 493.33 |
| 12% | tumblr | loadtime | linux64-shippable-qr | nocondprof warm webrender | 545.17 -> 610.88 |
| 12% | netflix | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 626.83 -> 702.33 |
| 12% | google-slides | linux64-shippable-qr | nocondprof warm webrender | 436.21 -> 488.43 | |
| 12% | apple | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 510.75 -> 571.83 |
| 12% | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,622.17 -> 1,815.42 | |
| 12% | FirstVisualChange | linux64-shippable | nocondprof warm | 280.00 -> 313.33 | |
| 12% | amazon | loadtime | linux64-shippable | nocondprof warm | 524.06 -> 586.12 |
| 12% | wikipedia | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 817.54 -> 913.75 |
| 12% | wikipedia | FirstVisualChange | linux64-shippable | nocondprof warm | 815.00 -> 910.00 |
| 12% | wikipedia | SpeedIndex | linux64-shippable | nocondprof warm | 815.50 -> 910.00 |
| 12% | apple | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 525.52 -> 586.33 |
| 12% | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 706.58 -> 788.08 | |
| 12% | wikipedia | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 817.96 -> 912.08 |
| 11% | google-slides | linux64-shippable | nocondprof warm | 406.22 -> 452.86 | |
| 11% | loadtime | linux64-shippable-qr | nocondprof warm webrender | 1,885.21 -> 2,101.54 | |
| 11% | ebay | loadtime | linux64-shippable | nocondprof warm | 378.15 -> 421.42 |
| 11% | google-docs | SpeedIndex | linux64-shippable | nocondprof warm | 1,092.42 -> 1,217.33 |
| 11% | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 777.17 -> 865.58 | |
| 11% | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,108.83 -> 1,234.08 | |
| 11% | google-search | linux64-shippable | cold nocondprof | 388.25 -> 431.75 | |
| 11% | outlook | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,092.83 -> 1,215.17 |
| 11% | apple | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 563.50 -> 626.08 |
| 11% | google-search | SpeedIndex | linux64-shippable | cold nocondprof | 289.75 -> 321.75 |
| 11% | loadtime | linux64-shippable-qr | nocondprof warm webrender | 590.08 -> 655.04 | |
| 11% | linux64-shippable | cold nocondprof | 382.50 -> 424.53 | ||
| 11% | youtube | linux64-shippable | cold nocondprof | 856.56 -> 949.82 | |
| 11% | amazon | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 370.88 -> 411.17 |
| 11% | bing-search | linux64-shippable | cold nocondprof | 256.64 -> 284.42 | |
| 11% | apple | SpeedIndex | linux64-shippable | cold nocondprof | 574.65 -> 636.67 |
| 11% | tumblr | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 383.17 -> 424.50 |
| 11% | google-slides | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 476.25 -> 527.50 |
| 11% | google-sheets | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 327.42 -> 362.50 |
| 11% | bing-search | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 295.42 -> 327.00 |
| 11% | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 563.50 -> 623.75 | |
| 11% | bing-search | SpeedIndex | linux64-shippable | cold nocondprof | 341.08 -> 377.50 |
| 11% | SpeedIndex | linux64-shippable | nocondprof warm | 1,080.25 -> 1,195.67 | |
| 11% | facebook-redesign | loadtime | linux64-shippable-qr | nocondprof warm webrender | 427.21 -> 472.75 |
| 11% | wikipedia | linux64-shippable | nocondprof warm | 818.88 -> 904.88 | |
| 10% | google-search | fcp | linux64-shippable | cold nocondprof | 266.23 -> 293.88 |
| 10% | ebay | loadtime | linux64-shippable-qr | nocondprof warm webrender | 358.83 -> 396.04 |
| 10% | office | fcp | linux64-shippable-qr | cold nocondprof webrender | 1,025.17 -> 1,130.42 |
| 10% | office | linux64-shippable-qr | cold nocondprof webrender | 1,199.37 -> 1,322.50 | |
| 10% | microsoft | LastVisualChange | linux64-shippable | cold nocondprof | 813.33 -> 896.67 |
| 10% | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,276.75 -> 1,406.83 | |
| 10% | apple | linux64-shippable | cold nocondprof | 615.73 -> 677.89 | |
| 10% | netflix | SpeedIndex | linux64-shippable | nocondprof warm | 470.08 -> 517.42 |
| 10% | apple | linux64-shippable-qr | cold nocondprof webrender | 617.82 -> 679.92 | |
| 10% | facebook-redesign | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 420.75 -> 462.83 |
| 10% | google-sheets | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 392.42 -> 431.58 |
| 10% | facebook-redesign | FirstVisualChange | linux64-shippable | nocondprof warm | 403.33 -> 443.33 |
| 10% | imgur | loadtime | linux64-shippable-qr | nocondprof warm webrender | 452.52 -> 496.96 |
| 10% | facebook-redesign | SpeedIndex | linux64-shippable | nocondprof warm | 421.38 -> 462.50 |
| 10% | google-docs | LastVisualChange | linux64-shippable | cold nocondprof | 7,203.33 -> 7,906.67 |
| 10% | google-sheets | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 4,066.67 -> 4,463.33 |
| 10% | google-docs | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,783.50 -> 1,956.92 |
| 10% | netflix | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 601.38 -> 659.75 |
| 10% | facebook-redesign | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 414.42 -> 454.33 |
| 10% | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 747.42 -> 819.00 | |
| 9% | youtube | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 831.92 -> 910.75 |
| 9% | google-sheets | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,711.96 -> 1,873.17 |
| 9% | youtube | linux64-shippable-qr | cold nocondprof webrender | 870.96 -> 952.75 | |
| 9% | fcp | linux64-shippable-qr | cold nocondprof webrender | 791.17 -> 864.83 | |
| 9% | office | fcp | linux64-shippable | cold nocondprof | 1,010.12 -> 1,103.46 |
| 9% | bing-search | fcp | linux64-shippable | cold nocondprof | 227.79 -> 248.50 |
| 9% | microsoft | LastVisualChange | linux64-shippable | nocondprof warm | 440.00 -> 480.00 |
| 9% | office | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 1,040.00 -> 1,133.33 |
| 9% | tumblr | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 771.67 -> 840.00 |
| 9% | office | linux64-shippable | cold nocondprof | 1,185.97 -> 1,290.27 | |
| 9% | google-slides | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 521.67 -> 567.42 |
| 9% | google-docs | ContentfulSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,167.62 -> 1,269.58 |
| 9% | netflix | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 619.92 -> 674.00 |
| 9% | google-sheets | LastVisualChange | linux64-shippable | cold nocondprof | 3,990.00 -> 4,336.67 |
| 9% | yahoo-mail | linux64-shippable-qr | cold nocondprof webrender | 539.61 -> 586.48 | |
| 9% | google-sheets | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 538.50 -> 585.17 |
| 9% | bing-search | loadtime | linux64-shippable | cold nocondprof | 342.42 -> 372.04 |
| 9% | loadtime | linux64-shippable-qr | nocondprof warm webrender | 584.19 -> 634.42 | |
| 9% | google-slides | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,233.62 -> 1,339.42 |
| 9% | SpeedIndex | linux64-shippable | nocondprof warm | 326.12 -> 354.00 | |
| 9% | google-docs | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,752.00 -> 1,901.75 |
| 9% | google-mail | LastVisualChange | linux64-shippable | cold nocondprof | 3,923.33 -> 4,256.67 |
| 8% | youtube | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 809.33 -> 877.50 |
| 8% | google-docs | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,762.25 -> 1,907.17 |
| 8% | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 2,696.67 -> 2,916.67 | |
| 8% | linux64-shippable-qr | cold nocondprof webrender | 569.76 -> 616.21 | ||
| 8% | fandom | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 349.83 -> 378.17 |
| 8% | google-docs | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 1,278.75 -> 1,380.67 |
| 8% | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 813.33 -> 876.67 | |
| 8% | office | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,136.83 -> 1,224.50 |
| 8% | office | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,191.33 -> 1,282.67 |
| 8% | office | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,175.50 -> 1,265.50 |
| 8% | office | loadtime | linux64-shippable-qr | cold nocondprof webrender | 2,546.67 -> 2,741.29 |
| 8% | google-slides | SpeedIndex | linux64-shippable | nocondprof warm | 485.21 -> 522.17 |
| 8% | google-search | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,022.31 -> 1,099.58 |
| 7% | youtube | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,390.67 -> 1,493.83 |
| 7% | office | FirstVisualChange | linux64-shippable | cold nocondprof | 1,036.67 -> 1,113.33 |
| 7% | LastVisualChange | linux64-shippable | nocondprof warm | 860.00 -> 923.33 | |
| 7% | bing-search | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 296.00 -> 317.75 |
| 7% | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 1,363.33 -> 1,463.33 | |
| 7% | office | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 731.75 -> 785.25 |
| 7% | wikipedia | LastVisualChange | linux64-shippable | cold nocondprof | 2,538.33 -> 2,723.33 |
| 7% | office | FirstVisualChange | linux64-shippable | nocondprof warm | 665.00 -> 713.33 |
| 7% | office | SpeedIndex | linux64-shippable | cold nocondprof | 1,125.54 -> 1,206.25 |
| 7% | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 659.83 -> 706.75 | |
| 7% | wikipedia | fcp | linux64-shippable-qr | cold nocondprof webrender | 1,543.25 -> 1,652.46 |
| 7% | wikipedia | linux64-shippable-qr | nocondprof warm webrender | 855.01 -> 914.43 | |
| 7% | office | SpeedIndex | linux64-shippable | nocondprof warm | 706.54 -> 755.50 |
| 7% | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 845.00 -> 903.33 | |
| 7% | imgur | fcp | linux64-shippable-qr | cold nocondprof webrender | 592.31 -> 632.79 |
| 7% | office | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,583.67 -> 1,688.00 |
| 7% | office | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 2,486.67 -> 2,650.00 |
| 7% | paypal | fcp | linux64-shippable-qr | cold nocondprof webrender | 544.71 -> 580.29 |
| 7% | wikipedia | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,991.71 -> 2,121.75 |
| 7% | paypal | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 1,355.00 -> 1,443.33 |
| 6% | wikipedia | loadtime | linux64-shippable | cold nocondprof | 1,971.77 -> 2,099.17 |
| 6% | microsoft | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 547.83 -> 582.92 |
| 6% | bing-search | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 351.33 -> 373.33 |
| 6% | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 365.92 -> 388.17 | |
| 6% | wikipedia | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 2,586.67 -> 2,743.33 |
| 6% | amazon | LastVisualChange | linux64-shippable | nocondprof warm | 1,173.33 -> 1,243.33 |
| 6% | SpeedIndex | linux64-shippable | cold nocondprof | 1,001.67 -> 1,061.42 | |
| 6% | netflix | windows10-64-shippable | cold nocondprof | 406.00 -> 430.20 | |
| 6% | microsoft | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 529.50 -> 560.75 |
| 6% | imgur | loadtime | linux64-shippable | nocondprof warm | 441.17 -> 466.79 |
| 6% | outlook | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 2,890.00 -> 3,056.67 |
| 6% | google-docs | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 1,215.08 -> 1,284.75 |
| 6% | youtube | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,269.58 -> 1,341.58 |
| 6% | netflix | loadtime | windows10-64-shippable | cold nocondprof | 762.12 -> 805.21 |
| 6% | youtube | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,239.88 -> 1,309.92 |
| 6% | microsoft | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 539.71 -> 569.58 |
| 5% | paypal | linux64-shippable-qr | cold nocondprof webrender | 670.63 -> 707.25 | |
| 5% | yahoo-mail | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 537.50 -> 566.75 |
| 5% | paypal | loadtime | linux64-shippable-qr | cold nocondprof webrender | 880.88 -> 928.58 |
| 5% | google-docs | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 7,309.96 -> 7,703.17 |
| 5% | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 1,331.67 -> 1,403.33 | |
| 5% | paypal | LastVisualChange | linux64-shippable | nocondprof warm | 1,366.67 -> 1,440.00 |
| 5% | paypal | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 804.08 -> 847.25 |
| 5% | google-docs | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,325.96 -> 1,396.00 |
| 5% | twitch | loadtime | linux64-shippable | nocondprof warm | 696.00 -> 732.75 |
| 5% | bing-search | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 760.00 -> 800.00 |
| 5% | netflix | loadtime | windows10-64-shippable | nocondprof warm | 488.12 -> 513.08 |
| 5% | youtube | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,315.96 -> 1,382.08 |
| 5% | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,009.46 -> 1,059.92 | |
| 5% | linux64-shippable-qr | cold nocondprof webrender | 1,156.67 -> 1,214.12 | ||
| 5% | ebay | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,271.75 -> 1,334.67 |
| 5% | fandom | linux64-shippable | cold nocondprof | 735.91 -> 772.32 | |
| 5% | ebay | linux64-shippable-qr | cold nocondprof webrender | 693.79 -> 726.63 | |
| 5% | LastVisualChange | linux64-shippable | cold nocondprof | 1,338.33 -> 1,400.00 | |
| 5% | paypal | SpeedIndex | linux64-shippable | cold nocondprof | 814.33 -> 851.33 |
| 4% | paypal | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 668.29 -> 694.17 |
| 4% | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,620.21 -> 1,679.00 | |
| 3% | ebay | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 1,286.00 -> 1,329.67 |
| 3% | twitch | loadtime | linux64-shippable | cold nocondprof | 899.77 -> 927.75 |
| 3% | paypal | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 759.71 -> 783.08 |
| 3% | ebay | SpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 1,918.17 -> 1,970.25 |
| 3% | bing-search | SpeedIndex | linux64-shippable | nocondprof warm | 292.42 -> 300.00 |
| 2% | ebay | SpeedIndex | linux64-shippable | nocondprof warm | 1,940.00 -> 1,983.17 |
| 2% | apple | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 312.62 -> 319.42 |
| 2% | bing-search | PerceptualSpeedIndex | linux64-shippable-qr | nocondprof warm webrender | 507.83 -> 518.50 |
Improvements:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 57% | google-slides | loadtime | linux64-shippable-qr | cold nocondprof webrender | 4,211.33 -> 1,819.92 |
| 47% | google-slides | loadtime | linux64-shippable | cold nocondprof | 4,288.19 -> 2,278.96 |
| 33% | twitch | FirstVisualChange | linux64-shippable | cold nocondprof | 120.00 -> 80.00 |
| 33% | twitch | FirstVisualChange | linux64-shippable | nocondprof warm | 120.00 -> 80.00 |
| 27% | twitch | LastVisualChange | linux64-shippable | cold nocondprof | 6,000.00 -> 4,410.00 |
| 25% | youtube | LastVisualChange | linux64-shippable | nocondprof warm | 2,083.33 -> 1,560.00 |
| 23% | youtube | LastVisualChange | linux64-shippable-qr | nocondprof warm webrender | 2,113.33 -> 1,620.00 |
| 22% | twitch | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,088.58 -> 853.92 |
| 21% | youtube | LastVisualChange | linux64-shippable | cold nocondprof | 2,760.00 -> 2,190.00 |
| 19% | cnn-ampstories | fcp | linux64-shippable | cold nocondprof | 1,476.31 -> 1,195.83 |
| 18% | twitch | fcp | linux64-shippable | cold nocondprof | 65.23 -> 53.38 |
| 17% | google-slides | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 4,431.67 -> 3,660.00 |
| 16% | FirstVisualChange | windows10-64-shippable | nocondprof warm | 239.42 -> 201.17 | |
| 15% | yandex | loadtime | linux64-shippable | cold nocondprof | 1,619.79 -> 1,368.92 |
| 15% | FirstVisualChange | windows10-64-shippable-qr | cold nocondprof webrender | 236.75 -> 201.00 | |
| 15% | facebook-redesign | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 1,856.67 -> 1,580.00 |
| 15% | yandex | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,632.38 -> 1,390.38 |
| 15% | google-slides | LastVisualChange | linux64-shippable | cold nocondprof | 4,351.67 -> 3,710.00 |
| 14% | yandex | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 678.42 -> 582.33 |
| 14% | bing-search | FirstVisualChange | windows10-64-shippable | nocondprof warm | 233.04 -> 201.25 |
| 13% | bing-search | LastVisualChange | linux64-shippable | cold nocondprof | 1,490.00 -> 1,293.33 |
| 13% | google-sheets | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 828.75 -> 724.92 |
| 12% | yandex | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 533.58 -> 467.58 |
| 12% | loadtime | linux64-shippable | cold nocondprof | 2,882.46 -> 2,531.88 | |
| 12% | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,566.67 -> 1,382.00 | |
| 11% | FirstVisualChange | linux64-shippable | cold nocondprof | 996.67 -> 883.33 | |
| 11% | imdb | fcp | linux64-shippable | cold nocondprof | 941.33 -> 837.17 |
| 11% | loadtime | linux64-shippable | cold nocondprof | 2,610.25 -> 2,321.62 | |
| 11% | linux64-shippable | cold nocondprof | 1,276.32 -> 1,136.67 | ||
| 11% | yahoo-news | fcp | linux64-shippable | cold nocondprof | 1,046.17 -> 931.96 |
| 11% | facebook-redesign | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,107.67 -> 987.75 |
| 11% | SpeedIndex | linux64-shippable | cold nocondprof | 1,035.00 -> 924.67 | |
| 11% | yahoo-news | linux64-shippable | cold nocondprof | 1,193.49 -> 1,067.21 | |
| 11% | bing-search | ContentfulSpeedIndex | windows10-64-shippable | nocondprof warm | 246.08 -> 220.08 |
| 11% | facebook-redesign | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 1,073.33 -> 960.00 |
| 11% | loadtime | linux64-shippable-qr | cold nocondprof webrender | 2,712.02 -> 2,426.75 | |
| 10% | fcp | linux64-shippable | cold nocondprof | 977.71 -> 875.50 | |
| 10% | yahoo-news | linux64-shippable-qr | cold nocondprof webrender | 1,203.32 -> 1,077.60 | |
| 10% | facebook-redesign | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,107.25 -> 992.67 |
| 10% | imdb | SpeedIndex | linux64-shippable | cold nocondprof | 1,062.83 -> 955.50 |
| 10% | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,072.42 -> 964.58 | |
| 10% | youtube | LastVisualChange | linux64-shippable-qr | cold nocondprof webrender | 2,476.67 -> 2,233.33 |
| 10% | imdb | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,006.42 -> 907.83 |
| 10% | facebook-redesign | LastVisualChange | linux64-shippable | cold nocondprof | 1,733.33 -> 1,566.67 |
| 9% | facebook-redesign | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,097.25 -> 994.83 |
| 9% | ContentfulSpeedIndex | linux64-shippable | cold nocondprof | 1,145.42 -> 1,039.92 | |
| 9% | google-slides | FirstVisualChange | linux64-shippable-qr | cold nocondprof webrender | 571.67 -> 520.00 |
| 9% | facebook-redesign | FirstVisualChange | linux64-shippable | cold nocondprof | 1,043.33 -> 950.00 |
| 9% | twitch | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 428.83 -> 390.50 |
| 9% | facebook-redesign | PerceptualSpeedIndex | linux64-shippable | cold nocondprof | 1,071.58 -> 976.58 |
| 9% | facebook-redesign | SpeedIndex | linux64-shippable | cold nocondprof | 1,075.75 -> 980.58 |
| 9% | yahoo-news | fcp | linux64-shippable-qr | cold nocondprof webrender | 1,054.54 -> 963.12 |
| 8% | facebook-redesign | loadtime | linux64-shippable-qr | cold nocondprof webrender | 1,946.96 -> 1,783.83 |
| 8% | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 980.75 -> 899.08 | |
| 8% | facebook-redesign | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 1,108.71 -> 1,016.67 |
| 8% | LastVisualChange | linux64-shippable | cold nocondprof | 1,850.00 -> 1,700.00 | |
| 8% | facebook-redesign | fcp | linux64-shippable | cold nocondprof | 988.50 -> 908.58 |
| 8% | amazon | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 882.67 -> 812.00 |
| 8% | facebook-redesign | loadtime | linux64-shippable | cold nocondprof | 1,885.79 -> 1,737.46 |
| 8% | facebook-redesign | fcp | linux64-shippable-qr | cold nocondprof webrender | 1,017.25 -> 937.58 |
| 8% | bing-search | SpeedIndex | windows10-64-shippable | nocondprof warm | 294.92 -> 272.17 |
| 8% | yandex | SpeedIndex | linux64-shippable | cold nocondprof | 631.17 -> 582.75 |
| 7% | yandex | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 663.67 -> 614.17 |
| 7% | amazon | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 864.88 -> 803.17 |
| 7% | PerceptualSpeedIndex | windows10-64-shippable | nocondprof warm | 381.00 -> 354.67 | |
| 7% | outlook | loadtime | linux64-shippable | cold nocondprof | 1,241.00 -> 1,157.25 |
| 7% | amazon | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 860.88 -> 803.42 |
| 7% | outlook | LastVisualChange | linux64-shippable | cold nocondprof | 4,506.67 -> 4,206.67 |
| 7% | FirstVisualChange | linux64-shippable | cold nocondprof | 556.67 -> 520.00 | |
| 7% | yahoo-mail | ContentfulSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 438.29 -> 409.42 |
| 6% | yandex | PerceptualSpeedIndex | linux64-shippable | nocondprof warm | 115.00 -> 108.50 |
| 5% | google-sheets | SpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 864.96 -> 817.58 |
| 4% | yandex | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 85.00 -> 81.42 |
| 4% | twitch | ContentfulSpeedIndex | linux64-shippable | nocondprof warm | 966.00 -> 926.50 |
| 4% | loadtime | linux64-shippable-qr | cold nocondprof webrender | 2,120.85 -> 2,037.71 | |
| 3% | bing-search | PerceptualSpeedIndex | linux64-shippable-qr | cold nocondprof webrender | 717.62 -> 693.58 |
For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=29016
|
|
||
Comment 22•4 years ago
|
||
From Raptor as well:
== Change summary for alert #29050 (as of Thu, 04 Mar 2021 08:13:43 GMT) ==
Regressions:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 42% | raptor-wasm-misc-baseline-firefox | linux64-shippable | nocondprof | 69,722.24 -> 99,188.80 | |
| 37% | raptor-wasm-misc-baseline-firefox | linux64-shippable-qr | nocondprof webrender | 71,648.19 -> 98,189.19 | |
| 25% | raptor-wasm-misc-firefox | linux64-shippable | nocondprof | 39,353.12 -> 49,068.77 | |
| 24% | raptor-wasm-misc-firefox | linux64-shippable-qr | nocondprof webrender | 39,644.11 -> 49,110.28 | |
| 24% | raptor-wasm-misc-optimizing-firefox | linux64-shippable-qr | nocondprof webrender | 39,335.06 -> 48,599.89 | |
| 23% | raptor-wasm-misc-optimizing-firefox | linux64-shippable | nocondprof | 39,470.21 -> 48,704.40 | |
| 23% | raptor-ares6-firefox | linux64-shippable-qr | nocondprof webrender | 51.40 -> 63.16 | |
| 22% | raptor-ares6-firefox | linux64-shippable | nocondprof | 51.21 -> 62.22 | |
| 16% | raptor-speedometer-firefox | linux64-shippable | nocondprof | 110.14 -> 92.55 | |
| 15% | raptor-webaudio-firefox | linux64-shippable | nocondprof | 106.92 -> 123.25 | |
| 15% | raptor-speedometer-firefox | linux64-shippable-qr | nocondprof webrender | 108.84 -> 92.38 | |
| 13% | raptor-webaudio-firefox | linux64-shippable-qr | nocondprof webrender | 110.00 -> 124.33 | |
| 13% | raptor-motionmark-htmlsuite-firefox | linux64-shippable | nocondprof | 29.38 -> 25.68 | |
| 9% | raptor-stylebench-firefox | linux64-shippable-qr | nocondprof webrender | 45.71 -> 41.67 | |
| 7% | raptor-motionmark-animometer-firefox | linux64-shippable-qr | nocondprof webrender | 45.53 -> 42.41 | |
| 7% | raptor-stylebench-firefox | linux64-shippable | nocondprof | 44.47 -> 41.55 | |
| 6% | raptor-motionmark-animometer-firefox | linux64-shippable | nocondprof | 37.50 -> 35.26 | |
| 6% | raptor-motionmark-htmlsuite-firefox | linux64-shippable-qr | nocondprof webrender | 61.26 -> 57.61 |
Improvements:
| Ratio | Suite | Test | Platform | Options | Absolute values (old vs new) |
|---|---|---|---|---|---|
| 125% | raptor-unity-webgl-firefox | linux64-shippable | nocondprof | 710.67 -> 1,596.67 | |
| 122% | raptor-unity-webgl-firefox | linux64-shippable-qr | nocondprof webrender | 721.58 -> 1,604.58 | |
| 65% | raptor-wasm-godot-firefox | linux64-shippable | nocondprof | 1,631.01 -> 563.86 | |
| 65% | raptor-wasm-godot-firefox | linux64-shippable-qr | nocondprof webrender | 1,672.87 -> 589.44 | |
| 63% | raptor-wasm-godot-baseline-firefox | linux64-shippable | nocondprof | 1,263.81 -> 469.53 | |
| 62% | raptor-wasm-godot-baseline-firefox | linux64-shippable-qr | nocondprof webrender | 1,291.50 -> 496.88 | |
| 48% | raptor-tp6-cnn-ampstories-firefox-cold | fnbpaint | linux64-shippable | live nocondprof | 1,220.67 -> 637.58 |
| 47% | raptor-tp6-cnn-ampstories-firefox-cold | fnbpaint | linux64-shippable-qr | live nocondprof webrender | 1,207.58 -> 640.08 |
| 36% | raptor-wasm-godot-optimizing-firefox | linux64-shippable | nocondprof | 2,034.76 -> 1,310.60 | |
| 34% | raptor-wasm-godot-optimizing-firefox | linux64-shippable-qr | nocondprof webrender | 2,064.05 -> 1,356.12 | |
| 24% | raptor-tp6-cnn-ampstories-firefox-cold | fcp | linux64-shippable-qr | live nocondprof webrender | 1,446.83 -> 1,102.58 |
| 23% | raptor-tp6-cnn-ampstories-firefox-cold | fcp | linux64-shippable | live nocondprof | 1,465.00 -> 1,127.83 |
| 22% | raptor-tp6-cnn-ampstories-firefox-cold | linux64-shippable | live nocondprof | 677.82 -> 530.69 | |
| 19% | raptor-tp6-cnn-ampstories-firefox-cold | linux64-shippable-qr | live nocondprof webrender | 663.19 -> 535.93 |
For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=29050
|
|
||
Comment 23•4 years ago
|
||
Change platform type for linux perf tests to be linux 1804
|
|
||
Updated•4 years ago
|
Keywords: perf-alert
|
||
Updated•4 years ago
|
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
|
|
||
Comment 24•4 years ago
|
||
as mentioned in the review for fixing the platform tags, we had issues with running on ccov. Looking at mozilla-central for the last week on ccov, there is talos(bcv) is the only job I see running on mozilla-central, and that is tier-3.
Doing a cleanup in test-platforms.yml, I see these jobs being removed:
test-linux1804-64-ccov/opt-awsy-base-dmd-e10s
test-linux1804-64-ccov/opt-awsy-base-e10s
test-linux1804-64-ccov/opt-awsy-dmd-e10s
test-linux1804-64-ccov/opt-awsy-e10s
test-linux1804-64-ccov/opt-awsy-tp6-e10s
test-linux1804-64-ccov/opt-awsy-tp6-fis-e10s
test-windows10-64-ccov-qr/opt-awsy-base-dmd-e10s
test-windows10-64-ccov-qr/opt-awsy-base-e10s
test-windows10-64-ccov-qr/opt-awsy-dmd-e10s
test-windows10-64-ccov-qr/opt-awsy-e10s
test-windows10-64-ccov-qr/opt-awsy-tp6-e10s
test-windows10-64-ccov-qr/opt-awsy-tp6-fis-e10s
test-windows10-64-ccov-qr/opt-talos-bcv-e10s
test-windows10-64-ccov-qr/opt-talos-bcv-fis-e10s
test-windows10-64-ccov-qr/opt-talos-bcv-swr-e10s
test-windows10-64-ccov-qr/opt-talos-chrome-e10s
test-windows10-64-ccov-qr/opt-talos-chrome-fis-e10s
test-windows10-64-ccov-qr/opt-talos-chrome-swr-e10s
test-windows10-64-ccov-qr/opt-talos-damp-e10s
test-windows10-64-ccov-qr/opt-talos-damp-fis-e10s
test-windows10-64-ccov-qr/opt-talos-damp-swr-e10s
test-windows10-64-ccov-qr/opt-talos-dromaeojs-e10s
test-windows10-64-ccov-qr/opt-talos-dromaeojs-fis-e10s
test-windows10-64-ccov-qr/opt-talos-g1-e10s
test-windows10-64-ccov-qr/opt-talos-g1-fis-e10s
test-windows10-64-ccov-qr/opt-talos-g1-swr-e10s
test-windows10-64-ccov-qr/opt-talos-g4-e10s
test-windows10-64-ccov-qr/opt-talos-g4-fis-e10s
test-windows10-64-ccov-qr/opt-talos-g4-swr-e10s
test-windows10-64-ccov-qr/opt-talos-g5-e10s
test-windows10-64-ccov-qr/opt-talos-g5-fis-e10s
test-windows10-64-ccov-qr/opt-talos-g5-swr-e10s
test-windows10-64-ccov-qr/opt-talos-other-e10s
test-windows10-64-ccov-qr/opt-talos-other-fis-e10s
test-windows10-64-ccov-qr/opt-talos-other-swr-e10s
test-windows10-64-ccov-qr/opt-talos-perf-reftest-e10s
test-windows10-64-ccov-qr/opt-talos-perf-reftest-fis-e10s
test-windows10-64-ccov-qr/opt-talos-perf-reftest-singletons-e10s
test-windows10-64-ccov-qr/opt-talos-perf-reftest-singletons-fis-e10s
test-windows10-64-ccov-qr/opt-talos-perf-reftest-swr-e10s
test-windows10-64-ccov-qr/opt-talos-realworld-webextensions-e10s
test-windows10-64-ccov-qr/opt-talos-realworld-webextensions-fis-e10s
test-windows10-64-ccov-qr/opt-talos-sessionrestore-many-windows-e10s
test-windows10-64-ccov-qr/opt-talos-sessionrestore-many-windows-fis-e10s
test-windows10-64-ccov-qr/opt-talos-sessionrestore-many-windows-swr-e10s
test-windows10-64-ccov-qr/opt-talos-svgr-e10s
test-windows10-64-ccov-qr/opt-talos-svgr-fis-e10s
test-windows10-64-ccov-qr/opt-talos-svgr-swr-e10s
test-windows10-64-ccov-qr/opt-talos-tabswitch-e10s
test-windows10-64-ccov-qr/opt-talos-tabswitch-fis-e10s
test-windows10-64-ccov-qr/opt-talos-tabswitch-swr-e10s
test-windows10-64-ccov-qr/opt-talos-tp5o-e10s
test-windows10-64-ccov-qr/opt-talos-tp5o-fis-e10s
test-windows10-64-ccov-qr/opt-talos-tp5o-swr-e10s
test-windows10-64-ccov-qr/opt-talos-webgl-e10s
test-windows10-64-ccov-qr/opt-talos-webgl-gli-e10s
test-windows10-64-ccov-qr/opt-talos-webgl-swr-e10s
test-windows10-64-ccov-qr/opt-talos-xperf-e10s
test-windows10-64-ccov-qr/opt-talos-xperf-fis-e10s
test-windows10-64-ccov-qr/opt-talos-xperf-swr-e10s
unfortunately I cannot find these running in our CI. If we are fine with no talos/raptor/browsertime/awsy on ccov (which I think it hasn't been for some time (at least since Nov 13th), if not a long time), I am happy to remove all ccov references in our configs:
https://treeherder.mozilla.org/jobs?repo=mozilla-central&tier=1%2C2%2C3&searchStr=ccov&revision=7ddb9d55aa38a29e16431182057c329c4a0c90d0
:sparky, should I remove all ccov references from awsy/talos/raptor/browsertime ?
Flags: needinfo?(gmierz2)
|
|
||
Comment 25•4 years ago
|
||
in doing a diff of ./mach taskgraph full before vs after and filtering out linux64 vs linux1804-64, we have ccov differences and:
after:
test-linux64-shippable-qr/opt-talos-bcv-swr-e10s
test-linux64-shippable-qr/opt-talos-chrome-swr-e10s
test-linux64-shippable-qr/opt-talos-damp-swr-e10s
test-linux64-shippable-qr/opt-talos-g1-swr-e10s
test-linux64-shippable-qr/opt-talos-g3-swr-e10s
test-linux64-shippable-qr/opt-talos-g4-swr-e10s
test-linux64-shippable-qr/opt-talos-g5-swr-e10s
test-linux64-shippable-qr/opt-talos-other-swr-e10s
test-linux64-shippable-qr/opt-talos-perf-reftest-swr-e10s
test-linux64-shippable-qr/opt-talos-sessionrestore-many-windows-swr-e10s
test-linux64-shippable-qr/opt-talos-svgr-swr-e10s
test-linux64-shippable-qr/opt-talos-tabswitch-swr-e10s
test-linux64-shippable-qr/opt-talos-tp5o-swr-e10s
test-linux64-shippable-qr/opt-talos-webgl-swr-e10s
before:
test-linux64-qr/opt-talos-bcv-swr-e10s
test-linux64-qr/opt-talos-chrome-swr-e10s
test-linux64-qr/opt-talos-damp-swr-e10s
test-linux64-qr/opt-talos-g1-swr-e10s
test-linux64-qr/opt-talos-g3-swr-e10s
test-linux64-qr/opt-talos-g4-swr-e10s
test-linux64-qr/opt-talos-g5-swr-e10s
test-linux64-qr/opt-talos-other-swr-e10s
test-linux64-qr/opt-talos-perf-reftest-swr-e10s
test-linux64-qr/opt-talos-sessionrestore-many-windows-swr-e10s
test-linux64-qr/opt-talos-svgr-swr-e10s
test-linux64-qr/opt-talos-tabswitch-swr-e10s
test-linux64-qr/opt-talos-tp5o-swr-e10s
test-linux64-qr/opt-talos-webgl-swr-e10s
this is really just talos from webrender opt -> shippable opt, although in test-platforms.yml there are no differences that should account for this.
|
|
||
Comment 26•4 years ago
|
||
Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/76bb7941b576 Change platform type for linux perf tests. r=perftest-reviewers,sparky
|
||
Updated•4 years ago
|
Flags: needinfo?(gmierz2)
|
|
Assignee | |
Comment 27•4 years ago
|
||
|
|
||
Comment 28•4 years ago
|
||
Pushed by jmaher@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/7f1974350129 peftest jobs use new 1804 workers r=jmaher
|
||
Comment 29•4 years ago
|
||
| bugherder | ||
Status: REOPENED → RESOLVED
Closed: 4 years ago → 4 years ago
Resolution: --- → FIXED
|
||
Comment 30•4 years ago
|
||
| bugherder | ||
You need to log in
before you can comment on or make changes to this bug.
Description
•