Missing enrollment telemetry for a live experiment
Categories
(Data Platform and Tools :: General, enhancement, P1)
Tracking
(Not tracked)
People
(Reporter: jlockhart, Assigned: bugzilla)
References
Details
Attachments
(1 file)
(deleted),
text/x-github-pull-request
|
Details |
This experiment went live on March 18 2019:
https://experimenter.services.mozilla.com/experiments/firefox-quantum-bar-experiment-1-xul-vs-html/
https://normandy.services.mozilla.com/api/v1/recipe/716/
However in Grafana the enrollment data only shows 0-1 enrollments rather than the normal healthy amount we expect:
I think the data is being lost somewhere in the pipeline, can someone help figure this out?
So far I've determined that the data exists in the Events dataset, and clients are enrolling correctly (and sending us data). Given we don't seem to be facing actual data loss, I'm punting this until next week. My current suspicion is that there was a change in nightly that's causing failures in parsing pings in the streaming jobs, but not in batch mode.
Aha! The event moved to the parent
process some time this nightly cycle (vs dynamic). Fix incoming -- thanks for filing the bug!
Comment 3•6 years ago
|
||
I restarted the datadog job and I see more reasonable data for that study now. Reassigning to :akomar so he can restart the test tube job on Monday to pick up these changes.
Comment 5•6 years ago
|
||
TestTube job has been redeployed from master
.
Updated•6 years ago
|
Enrollment counts look normal now -- thanks :akomar!
Updated•2 years ago
|
Description
•