Dr. Ralph Wilson of Web Marketing Today spent a few minutes interviewing FutureNow’s Bryan Eisenberg about testing on sites that have little traffic. You can view the video below. You may also be interested in reading more about the hierarchy of optimization when you are done viewing the video.
Bryan and I have co-authored a new book all about testing and helping you figure out what to test. It’s called Always Be Testing: The Complete Guide to Google Webiste Optimizer (published by Sysbex/Wiley) and we’re expecting it out next month; you can pre-order it now on Amazon.
July 9th, 2008
5:16 pm
Always nice to see Dr. Wilson. I’d say this is good advice even for 100 conversions/week. When a test run is going to take a minimum of 3-4 weeks, you can’t afford to test things at random, mess with low-impact changes, or try to run a huge, multivariate test.
One big problem I have on low-traffic sites is the increased temptation to check results too early. As a research psychologist by training, I ought to know better, but I still find myself peeking in the first week and wanting to stop the test when my favorite version is ahead. It’s a bad, bad habit.
July 10th, 2008
5:55 am
Also, don’t forget that if a test runs for too long, the result might be affected by seasonal fluctuations in your specific business.
Fx. running a test on a skiing trip landing page from November to February is bad, because the visitors are in totally different places in their buying cycle when comparing November to February, and thus they will produce different behavious and results.