Jetstream2 is a new benchmark from Apple:

• https://browserbench.org/JetStream2.0/
• https://webkit.org/blog/8685/introducing-the-jetstream-2-benchmark-suite/

It would be nice if we could use it in the same manner as we can use Speedometer

(If this needs a PI request, let us know how to make that the best way; the JIRA workflow documented on Mana doesn't seem to include test automation) .

Thank you Matthew. I was on PTO so just setting this now. NI'ing :davehunt re: PI request.

Whoops dropped the ball: sphilp filed a PI request for this here: https://moz-pi-test.atlassian.net/browse/PTE-90 (I can't actually see said link, but it's the link they shared :) )

I started the changes on my forked github repository and did a pull request:
https://github.com/mozilla/perf-automation/pull/20/commits/
Robert when you have some spare time, i need your review on this.
Thanks!

Changed the required yml, ini, json, js and html files to add Jetstream2 benchmark test to Raptor.
The changes on the javascript files are on github.

(In reply to Marian Raiciof [:marauder] from comment #4)

I started the changes on my forked github repository and did a pull request:
https://github.com/mozilla/perf-automation/pull/20/commits/
Robert when you have some spare time, i need your review on this.
Thanks!

Great work thanks! Code looks good!

Tried it out locally - applied pull request, started a local webserver, and invoked via:

http://localhost:8081/JetStream2/index.html?raptor

The benchmark ran and completed fine. I merged the PR.

Hi Robert,
Dave created a release for JetStream2 because i didn't have permissions to do it.
Can you double check if all is fine ?
https://github.com/mozilla/perf-automation/releases/tag/jetstream2-v1
Thanks!

(In reply to Marian Raiciof [:marauder] from comment #7)

Hi Robert,
Dave created a release for JetStream2 because i didn't have permissions to do it.
Can you double check if all is fine ?
https://github.com/mozilla/perf-automation/releases/tag/jetstream2-v1
Thanks!

Yep LGTM - you're almost there (see comments in phab) thanks for your hard work on this!

Thanks Robert!
I finished the changes, here is the push to try link:
https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=a669044c659bbe778aaeeadf6ce15085e599fba6

Jetstream2 test did pass on linux machines but it was failing on Windows and OS X.
After i did several tests on a Windows 10 laptop, i realised that the time to get the metrics is terrible slow compared to linux.
I increased the time for a single pagecycle to 2000 seconds. And the overall time to 8000 seconds (4 pagecyles in total).

https://treeherder.mozilla.org/#/jobs?repo=try&tier=1%2C2%2C3&revision=d89f94f89e4ed8c269c75ac27a40c6693929dbcf

https://hg.mozilla.org/mozilla-central/rev/6aff093ae164