Multivariate Testing

Running a multivariate test or even a simple AB test can be daunting. With each variation, there are additional tests to be run and measured, and it can all get overwhelming very quickly.  At ProductTank October, Alex Smith, the Site Development Manager at Charles Tyrwhitt, showed us what he measured and why, and talked about Read more »

Multi-armed bandit testing involves a statistical problem set-up. The most-used example takes a set of slot machines and a gambler who suspects one machine pays out more or more often than the others.  For every token, they need to decide which slot machine to use in order to maximise winnings from their budget. This set-up Read more »

Introduction Many people know they should be doing experiments and testing their product but when starting out it can be daunting working out where to begin. So, below is my handy guide to experimentation built from scars received on the coal face of experimenting. This post will take you through a birds-eye tour of the Read more »