LATEST POSTS

Video: How to love A/B and Multivariate Testing

BY Janna Bastow on December 26, 2013

Running a multivariate test or even a simple AB test can be daunting. With each variation, there are additional tests to be run and measured, and it can all get overwhelming very quickly.  At ProductTank October, Alex Smith, the Site Development Manager at Charles Tyrwhitt, showed us what he measured and why, and talked about Read more »

Multi-Armed Bandit Testing

BY Davide Scalzo on November 19, 2013

Multi-armed bandit testing involves a statistical problem set-up. The most-used example takes a set of slot machines and a gambler who suspects one machine pays out more or more often than the others.  For every token, they need to decide which slot machine to use in order to maximise winnings from their budget. This set-up Read more »

Everything a product manager needs to know about experiments

BY Simon Cast on August 20, 2012

Introduction Many people know they should be doing experiments and testing their product but when starting out it can be daunting working out where to begin. So, below is my handy guide to experimentation built from scars received on the coal face of experimenting. This post will take you through a birds-eye tour of the Read more »