I’ve had a few discussions with people and read stuff posted by @distilled on this topic over the last week and felt compelled to write. I’ve been doing split and multivariate tests since 2006, and have watched nearly every one like a hawk. I want to give some practical advice as I’ve personally made every test cockup in the book and wasted many days on fruitless effort – in order to become better and to continue to hopefully improve. I don’t want to come across as saying these methods are wrong – just that my experience tells me that there are better ways to use your time (when testing). The volume of tests you start is important but even more so, is how many you finish every month.