inkredabull/ab_testing_requirements.md

Last active January 4, 2016 03:39

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/inkredabull/8562820.js"></script>
Save inkredabull/8562820 to your computer and use it in GitHub Desktop.

Download ZIP

A/B Testing Solution Requirements

Raw

ab_testing_requirements.md

For Rails

(No warranty provided on information accuracy; corrections appreciated.)

	Vanity	A/Bingo	Bandit	Split
Provides mechanism to see which experiment is assigned to which user for analytics purposes out-of-the-box	x
Easy to install	x	x	x	x
Well-written dev docs	x		x	x
Allows for weighted assignment (percentages) of experiment variations	*	x		x
Supports use of a bandit algorithm	x	x	x	x
Has ready-made analytics dashboard	x	x	x	x
Updated in last six months	x			x
Allows for setting variation via URL for testing	?		x	x
Captures time when experiment was assigned

: not explicitly supported but achievable

For Django

(No warranty provided on information accuracy; corrections appreciated.)

	Gargoyle
Supported for 1.6	No
Provides mechanism to see which experiment is assigned to which user for analytics purposes out-of-the-box
Easy to install
Well-written dev docs
Allows for weighted assignment (percentages) of experiment variations
Supports use of a bandit algorithm
Has ready-made analytics dashboard
Updated in last six months
Allows for setting variation via URL for testing
Captures time when experiment was assigned

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment