Kate Hudson :k88hudson Assignee
	Description • 6 years ago

In this bug, we will attempt to run a mock “hello world” experiment end-to-end as if we are running a real pocket experiment. The only difference is that we will not actually ship it to real users.

The purpose of this bug is to test our experiment process and give us early feedback on our architectural decisions from start to finish for Pocket/New tab.

Following this process, we will:

- complete a retrospective to determine what is and isn't working
- produce documentation for the Pocket/Newtab architecture
- produce documentation for the experiment QA process for future reference

These documents will be amended as needed going forward.

	[github robot]
	Comment 2 • 6 years ago

Commit pushed to master at https://github.com/mozilla/activity-stream

https://github.com/mozilla/activity-stream/commit/a8a6d5429cbe8489e62456ac153ceafa5d415f72
Fix Bug 1514913 - Hello world Pocket + New Tab test experiment (#4596)

* Fix Bug 1514913 - Hello world Pocket + New Tab test experiment

* review updates

* Fixes to grid

	Ed Lee :Mardak
	Comment 3 • 6 years ago

https://hg.mozilla.org/mozilla-central/rev/e1439f07a4a4

	Kate Hudson :k88hudson Assignee
	Comment 4 • 6 years ago

I have posted testing instructions here for checking the control and variant for this test: https://gist.github.com/k88hudson/c8cef72a7837deb34338856f9ea150f6

Once this commit makes it to nightly, can you verify?

	Brahmini Nagabandi
	Comment 5 • 6 years ago

Kate - Yes, I can verify.

	Brahmini Nagabandi
	Comment 6 • 6 years ago

QA Test Result :

Tested on Firefox Nightly (Mac OS). v66.0a1 (2018-12-20)

(Not tested on Windows laptop at the moment due to unavailabilty)

Unable to get back to Standard Experience (NewTab/Homepage) after Pref reset.


*Steps to Reproduce: *
1. Setup Pref : `browser.newtabpage.activity-stream.feeds.section.topstories.options` to the expected `value` (per doc)
2. New Experience works as expected in terms of boxes and search --> saving Articles
3. Now reset the Pref to `default` value
BUG :
 Newtab/Home doesn't reflect the Standard Experience
Work Around : Tried closing the existing browser and and re-launch Firefox, doesn't look normal (with having default Pref)

cc: @khudson@mozilla.com

	Brahmini Nagabandi
	Comment 7 • 6 years ago

Tested the experiment against Firefox Nightly on Mac OS and Windows.
Followed the instructions per doc https://gist.github.com/k88hudson/c8cef72a7837deb34338856f9ea150f6


Works as expected.

cc: @khudson@mozilla.com

Thanks,
Brahmini