I’m still settling in from my trip last week to the Internet Retailer Design conference. If you didn’t attend, you missed a great first-time show, so you’ll have to check it out next year.
Over 800 people showed up to hear the speakers and meet with consultants (like me) to evaluate their current websites — and some even discussed mock-ups and prototypes of new versions of their sites. My back-of-the-napkin calculation is that Internet Retailer gave away around $150,000 worth of consultations, but I’ll ask you the one common question I asked several of the companies I met with just for the price of spending a few minutes reading.
I recall sitting with one of the most recognized brands on the Web and him pulling out his mock-ups. They felt that they had issues around how products were presented and how their navigation worked. They offered a complex menu with way too many options in their current navigation, and were hoping to improve it by using a top level menu with a javascript rollover.
“What research do you have that indicates that new navigation will work better than the current one?” I asked. He was honest and said, “None.”
Internet Retailer did a pre-conference survey and asked the top 500 retailers if they’re doing multivariate or A/B testing, and included the results in their Website Design & Usability Guide.
Amazingly, 76.7% of retailers surveyed don’t test!
Huh? Now that you can get A/B and Multivariate testing tools for free from Google, why aren’t you testing?
We’ve also found that it’s safer to roll out a redesign in stages, in order to avoid the initial drop in conversion that often results from a redesign. Why not roll this out as a series of tests?
If you need help, call us at 877-643-7244 (ext. 3316). We’d be happy to help you make more money before and after your redesign.
February 11th, 2008
6:56 am
You are right Bryan. We all should use these free tools to atleast get started with testing and then might be move to people like you for more insights.
February 11th, 2008
9:48 am
Great points Bryan. There is so much more that goes into improving conversion rate that just the design. Majority of the time, when you do a COMPLETE redesign your conversion rate will drop. So I agree on a phased approach or even a beta site that runs in parallel. A/B testing is key, there will be more benefits from smaller changes than a completely new web site design / user experience.
Plus, there are other considerations when factoring in a redesign, like: trying to not mess up your SEO rankings, ensuring you do not increase your cart abandonment percentage and improving the scent trails and persona click paths.
February 11th, 2008
1:19 pm
“…and were hoping to improve it by using a top level menu with a javascript rollover”
Ugh! I can only speak for myself, but that’s a fast way to lose at least one customer.
Menus that open and close with every twitch of the mouse are a good example of why programmers are rarely marketers. Might as well toss in a Flash intro screen, some sparkles that chase the cursor around and an auto-play WAV file. Better yet, bring back the BLINK tag!
February 11th, 2008
7:17 pm
Every week we get clients in who have just paid for a fancy re-design of their site.
Their only objective in their re-design seems to be aesthetic – they wanted a pretty new site.
The truth is that UGLY SITES CAN WORK.
February 12th, 2008
10:44 am
Bryan,
Again, awesome post. In terms of usability, persuasion architecture, etc. do you know of a good sum all bullet list of the most important components? I think such a simple ‘checklist’ would be awesome to hand to a designer when they start on a new design, although it may not be sufficient as if they knew it by heart but it would be better than nothing.
February 13th, 2008
5:30 pm
[...] a recent study, 76.7% of online retailers said they don't test. Are you? Technorati Tags: Google Website Optimizer, testing, website optimization, website [...]
February 14th, 2008
4:55 am
[...] Eisenberg captured it quite nicely in his recap: Amazingly, retailers aren’t testing their websites [...]
February 21st, 2008
9:12 pm
The Evolution of SFGate (and Thoughts on Measuring Site Redesign)…
Like many San Franciscans I read SFGate every single day. A cup of coffee, my local news fix, and then I’m ready to face the world. But when I reached for the paper earlier this week my routine was derailed…
February 26th, 2008
6:20 pm
[...] cycle of optimization (measure, refine, test). Compare this rigorous approach to the fact that over 75% of online retailers don't do any optimization testing, and you'll begin to see why Amazon remains the envy of [...]
March 4th, 2008
12:43 pm
[...] honest about where we really are. For most companies there is a pretty big gap between intent and reality. The intent is to spend more on analytics while the reality is that 76% of retailers don’t do [...]
March 14th, 2008
7:18 pm
[...] this be why three quarters of online retailers don't test even though it's [...]
August 6th, 2009
8:18 pm
[...] cycle of optimization (measure, refine, test). Compare this rigorous approach to the fact that over 75% of online retailers don’t do any optimization testing, and you’ll begin to see why Amazon remains the envy of [...]