QA

QA Test Plan: https://wiki.mozilla.org/QA/Mobile/FirefoxTVTestPlan

Fretboard Experiments

We run A/B tests in FFTV, but in testing we want the ability to launch the FFTV app with a specific experiment branch, so we can test/verify specific changes (rather than hoping to be put into a specific bucket).

FFTV can be started from commandline with experiment branches specified (with some sample experiments included):

adb shell am start -n org.mozilla.tv.firefox/org.mozilla.tv.firefox.MainActivity -a android.intent.action.MAIN --esa activeExperiments TvGuideChannels-2195:A,HintBar-2011:B

Experiment input is of the format (and the list must be comma-separated, no spaces): experimentName:branch

Terms

• experimentName: experiment names can be found in this config file
• branch: this determines which branch of the experiment will be launched (this is inconsistent: for TV Guide channels, branch B will show the channels; for HintBar, branch A will show the hint bar)

Caveats

• If you set an override with this command, the app will remain with that set of specified experiments, until either another override with a different set of experiments is run, or the app data is cleared.
• App must be restarted to guarantee the changes show.

This functionality was added in #2320.