Open Bug 1387316 Opened 7 years ago Updated 2 years ago

[Form Autofill] Create dashboard for the form autofill type counts

Categories

(Toolkit :: Form Autofill, enhancement, P3)

enhancement

Tracking

()

People

(Reporter: steveck, Unassigned)

References

Details

(Whiteboard: [form autofill][autofill-metrics])

User Story

We know how users use the form autofill feature

Acceptance Criteria:
- We know how many times users auto complete an address, edit an address, manually add an address, or disable autofill addresses
- We know the distribution of average number of addresses
- We know the distribution of time complete filling a form

Attachments

(3 files)

Follow up for Bug #990200 that we'll need the generate a dashboard based on the collected data. We already have dashboards in telemetry.mozilla.org[1], but the finalized version will still need PM's input and set new queries in s.t.m.o. [1] https://goo.gl/PNQRB1 :The manual input count, you can switch to other type like autofill or autofill-update
Flags: needinfo?(jcheng)
Flags: needinfo?(chsiang)
Attached image IMG_6879.JPG (deleted) —
Flags: needinfo?(chsiang)
User Story: (updated)
Flags: needinfo?(jcheng)
Depends on: 1397955
Priority: -- → P3
Attached file ATMO notebook WIP (deleted) —
Based on the discussion with Cindy, we'll schedule a daily ATMO report for her.
Component: Form Manager → Form Autofill
Attached file Form_Autofill.ipynb (deleted) —
Hi MattN, I revise your WIP by adding the form filling time telemetry and dynamic submission date(I set it to 2 days before yesterday). Feel free to give any suggestion if you have time, thanks.
Attachment #8929402 - Flags: feedback?(MattN+bmo)
Here is the result[1] I scheduled for daily dashboard in atmo service, but I'm not sure if it's a permalink and refreash everyday... [1] https://nbviewer.jupyter.org/url/s3-us-west-2.amazonaws.com/telemetry-public-analysis-2/formautofill-telemetry-dashboard/data/Form_Autofill.ipynb
Comment on attachment 8929402 [details] Form_Autofill.ipynb Hi Steve, nice job adding the filling time graphs. > "target_date = datetime.datetime.now() - datetime.timedelta(days=3)\n", > "target_date = target_date.strftime(\"%Y%m%d\")\n", > "print(\"The submission date is \" + target_date)\n", > "\n", > "pings = Dataset.from_source(\"telemetry\") \\\n", > " .where(docType=\"main\") \\\n", > " .where(submissionDate=target_date) \\\n", I would recommend giving a lambda here so a range of days can be considered since weekend users are often different than weekday users. To address that I would recommend 7 or 14 days. Example: .where(submissionDate=lambda x: x >= target_date_begin and x <= target_date_end) > " .where(appUpdateChannel=\"beta\") \\\n", This should be "release" probably > " .records(sc, sample=0.1)" You will want to lower this for release or it will take too long. Try 0.01 to start > "df_manual = pd.DataFrame(fill_type_manual_time_data, columns=['manual'])\n", > "df_manual.plot.bar(title=\"Manual filling time(ms) and count\", figsize=[15, 7])" I would recommend using iplot so that the graphs are interactive otherwise I find it hard to read values from narrow bar graphs. I didn't look closely at the rest since I don't do this stuff enough to be able to notice subtle issues via code review. (In reply to Steve Chung [:steveck] from comment #6) > I'm not sure if it's a permalink and refreash everyday... Yes, it is.
Attachment #8929402 - Flags: feedback?(MattN+bmo) → feedback+
Steve, can you please update the dashboard with the above changes? The `beta` data isn't super useful as-is.
Flags: needinfo?(schung)
(In reply to Matthew N. [:MattN] (PM if requests are blocking you) from comment #8) > Steve, can you please update the dashboard with the above changes? The > `beta` data isn't super useful as-is. I scheduled another dashboard for release here[1] with 0.01 sample but it has some error while rendering the form filling time chart. Will try to fix it soon. [1] https://nbviewer.jupyter.org/url/s3-us-west-2.amazonaws.com/telemetry-public-analysis-2/formautofill-telemetry-address-release-dashboard/data/Form_Autofill.ipynb
Flags: needinfo?(schung)
Assignee: steveck324 → nobody
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: