Closed
Bug 838657
Opened 12 years ago
Closed 10 years ago
Implement a spec reporter for perf runs
Categories
(Firefox OS Graveyard :: Gaia::PerformanceTest, defect, P1)
Tracking
(b2g-v1.3T affected, b2g-v1.4 wontfix, b2g-v2.0 fixed)
RESOLVED
FIXED
2.0 S3 (6june)
People
(Reporter: julienw, Assigned: hub)
References
Details
(Keywords: perf, Whiteboard: [c=automation p=2 s= u=])
Attachments
(1 file, 3 obsolete files)
In Bug 837139 we implemented a JSON reporter that shows a synthetic view of all suites.
It's also useful to have a more "human" reporter that shows results as soon as they're run.
Reporter | ||
Updated•12 years ago
|
Blocks: gaia-perf-measure
Reporter | ||
Updated•12 years ago
|
Assignee: nobody → felash
Reporter | ||
Updated•12 years ago
|
Assignee: felash → nobody
Updated•12 years ago
|
status-b2g18:
--- → fixed
Updated•12 years ago
|
status-b2g18:
fixed → ---
Comment 1•11 years ago
|
||
I would like to start work in this bug. Wich are the requirements for this implementation?
I guess the better ideia is reuse the JSON implementation and show it on reporter. My doubts is:
1. Where this more "human" report will be done? Console/APP or something like that?
Comment 2•11 years ago
|
||
Julien, I've runned the test-perf from gaia and I've seen how the current implementation of results are.
Could you give some guide where I need to work/study, in terms of code, to create a friendly interface using this the JSON output?
In a fast looking, I'll need to work with Marionette, Is it right?
Another question is, this JSON output is being stored in another place? I guess that It is being used by Datazilla, and that is the motivation to report as JSON, all right?
Comment 3•11 years ago
|
||
You can start taking a look at 'tests/reporters/jsonmozperf.js'. This is the current JSON reporter. And you can create a new reporter based on this.
Datazilla would still use REPORTER=JSONMozPerf but tests ran manually could choose the new reporter that you create.
Reporter | ||
Comment 4•11 years ago
|
||
You don't need to work with mationette, all this part is already done. You just need to create a new reporter and specify it when you run the perf test.
Comment 5•11 years ago
|
||
(In reply to Anthony Ricaud (:rik) from comment #3)
> You can start taking a look at 'tests/reporters/jsonmozperf.js'. This is the
> current JSON reporter. And you can create a new reporter based on this.
>
> Datazilla would still use REPORTER=JSONMozPerf but tests ran manually could
> choose the new reporter that you create.
Thank you for the direction!
Comment 6•11 years ago
|
||
I've done a first proposal in this pull request:
https://github.com/mozilla-b2g/gaia/pull/11566
But I have some doubts about this kind of implementation. It has a lot of code cloned from "jsonmozperf.js".
1. What do you think about a reporter that can be more reusable or more generic?
2. Who can I require a review?
Reporter | ||
Comment 7•11 years ago
|
||
1. it should be possible to use inheritance to factorize all this
2. either anthony (:rik) or me
Comment 8•11 years ago
|
||
(In reply to Julien Wajsberg [:julienw] from comment #7)
> 1. it should be possible to use inheritance to factorize all this
So, I'm thinking in create a supertype that stores the success and failures as the super class and 2 especialized class (ConsoleMozPerf and JSONMozPerf) for the report function, because they differ only in this way.
There is no problem in change the JSONMozPerf, all right? I'm worry about this.
Comment 9•11 years ago
|
||
I have another newbie javascript implementation problem. What is the right way to import a specific script on gaia. I'm having problems with this. I want to make a function "exportable"
Comment 10•11 years ago
|
||
julienw or rik, could one of you review my new pull? It's on
https://github.com/mozilla-b2g/gaia/pull/11566
I've created a BaseMozPerf that does the base job of a PerfReporter.
Waiting for review.
Reporter | ||
Comment 11•11 years ago
|
||
Caio: I added comments on the pull request.
Note that you should add a file as attachment, you can put the PR url inside this file, this makes it easier to request reviews.
Comment 12•11 years ago
|
||
Comment 13•11 years ago
|
||
Julien, I'm with some doubts about implementation. I've commentend them.
Comment 14•11 years ago
|
||
Attachment #792535 -
Attachment is obsolete: true
Comment 15•11 years ago
|
||
Remember to assign this bug for me.
Comment 16•11 years ago
|
||
I've modified the code.
Ps.: When I push a new code, do I need to say it here in bugzilla?
Updated•11 years ago
|
Assignee: nobody → ticaiolima
Reporter | ||
Comment 17•11 years ago
|
||
(In reply to Caio Lima(:caiolima) from comment #16)
>
> Ps.: When I push a new code, do I need to say it here in bugzilla?
It depends. Usually, when your code is ready to review, you need to flip the flag "review" to "?" on your attachment, and add the bugzilla handle for the reviewer (:julien for me, :rik for Anthony).
When we review it, we usually can do 2 different things:
* either we remove the "?" or we put a "-", and in that case, you just need to add the "?" again when you're ready;
* or we don't change anything and in that case you just need to comment here or on github to say you're ready to get reviewed again.
Comment 18•11 years ago
|
||
Comment on attachment 792537 [details]
pull request link
https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Platform/Gaia/Hacking#Submitting_a_patch has some information about submitting a patch.
You don't have to tell every time you push code. Just re-setting the review flag is enough.
Attachment #792537 -
Flags: review?(felash)
Reporter | ||
Comment 19•11 years ago
|
||
Comment on attachment 792537 [details]
pull request link
I'll review this tomorrow if that's ok for you, I'me quite full for today already :/
Comment 20•11 years ago
|
||
(In reply to Julien Wajsberg [:julienw] from comment #19)
> Comment on attachment 792537 [details]
> pull request link
>
> I'll review this tomorrow if that's ok for you, I'me quite full for today
> already :/
No problem for me. :)
Comment 21•11 years ago
|
||
julien, ping review
Reporter | ||
Updated•11 years ago
|
Whiteboard: [c=instrumentation p=] → [c=instrumentation p=][mentor=:julienw]
Updated•11 years ago
|
Status: NEW → ASSIGNED
Whiteboard: [c=instrumentation p=][mentor=:julienw] → [c=automation p=][mentor=:julienw]
Updated•11 years ago
|
Target Milestone: --- → 1.2 C3(Oct25)
Updated•11 years ago
|
Attachment mime type: text/plain → text/x-github-pull-request
Reporter | ||
Comment 22•11 years ago
|
||
We can resume work on this now.
Assignee: ticaiolima → felash
Attachment #792537 -
Attachment is obsolete: true
Attachment #792537 -
Flags: review?(felash)
Assignee | ||
Updated•11 years ago
|
Component: Gaia → Gaia::PerformanceTest
Assignee | ||
Updated•11 years ago
|
Attachment #8350047 -
Attachment mime type: text/plain → text/x-github-pull-request
Assignee | ||
Comment 23•11 years ago
|
||
Maybe I should take over this one? I didn't realise this bug existed.
Reporter | ||
Comment 24•11 years ago
|
||
Yep, please do :)
Updated•11 years ago
|
Priority: -- → P3
Whiteboard: [c=automation p=][mentor=:julienw] → [c=automation p= s= u=][mentor=:julienw]
Target Milestone: 1.2 C3(Oct25) → ---
Assignee | ||
Updated•11 years ago
|
Assignee: felash → hub
Priority: P3 → P2
Assignee | ||
Updated•11 years ago
|
Whiteboard: [c=automation p= s= u=][mentor=:julienw] → [c=automation p= s= u=]
Assignee | ||
Updated•10 years ago
|
Whiteboard: [c=automation p= s= u=] → [c=automation p=2 s= u=]
Assignee | ||
Updated•10 years ago
|
Priority: P2 → P1
Assignee | ||
Comment 25•10 years ago
|
||
Attachment #8350047 -
Attachment is obsolete: true
Attachment #8430285 -
Flags: review?(felash)
Attachment #8430285 -
Flags: review?(eperelman)
Updated•10 years ago
|
Attachment #8430285 -
Flags: review?(eperelman) → review+
Reporter | ||
Comment 26•10 years ago
|
||
Comment on attachment 8430285 [details]
Link to Github pull-request: https://github.com/mozilla-b2g/gaia/pull/19738
I wonder if we should remove the wrapping [] characters but this looks good enough for me, so r=me with a small nit.
Attachment #8430285 -
Flags: review?(felash) → review+
Assignee | ||
Comment 27•10 years ago
|
||
with nit addressed
merged
https://github.com/mozilla-b2g/gaia/commit/ca0390821ff924a3a8a9810be3a73dfbfa679d66
Status: ASSIGNED → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Assignee | ||
Updated•10 years ago
|
Target Milestone: --- → 2.0 S3 (6june)
Assignee | ||
Updated•10 years ago
|
You need to log in
before you can comment on or make changes to this bug.
Description
•