<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Start Multivariate Testing: 7 Critical Questions</title>
	<atom:link href="http://www.grokdotcom.com/index.php/2007/06/12/start-multivariate-testing-7-critical-questions/feed" rel="self" type="application/rss+xml" />
	<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/</link>
	<description>Marketing blog focused on marketing optimization, improving website conversion rates, search engine marketing, web analytics, word of mouth, etc.</description>
	<lastBuildDate>Sat, 21 Nov 2009 08:19:18 -0600</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8.6</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Jim Stone</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-743684</link>
		<dc:creator>Jim Stone</dc:creator>
		<pubDate>Fri, 23 May 2008 03:52:30 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-743684</guid>
		<description>For small online business owners who don&#039;t have a landing page that gets 10,000 page views per day, a fractional factorial (e.g. Taguchi) tool might work out better.

Google&#039;s Website Optimizer can run small Taguchi tests -- just use the main effects results instead of the combination report.  But it&#039;s difficult to run a test with more than 1000 combinations this way if you don&#039;t have a ton of traffic.

Also, if you aim to improve a metric that&#039;s already getting about a 20% conversion rate, you can confirm a 20% improvement (i.e., going from 20% to 24%) much more quickly than you can if you start with a metric getting a 1% conversion rate.

So if you&#039;re optimizing a sales page getting 1%, you might need up to 60,000 visitors to confirm a 20% improvement (i.e., going from 1% to 1.2%).  But going from 20% to 24% can be confirmed in about 1200 visitors.

The key is to find a metric that&#039;s correlated with sales, and which starts out in the &quot;sweet spot&quot; of 10%-50% conversion rate.

There are two nice ways to do this in my experience.  Break the page into multiple pages.  Or measure something like &quot;time on page&quot;.  Then you can measure something (visitors staying &gt; 60 seconds, or visitors clicking to page 2) that starts with about a 20% conversion rate instead of something (sales) that starts with a 1% conversion rate.

To the extent that these other metrics are correlated with sales, you can speed up your testing by a factor of 10 or more.

For those who are interested, the Split Test Accelerator provides a way to run large tests with very little traffic.  It offers faster tests than Google&#039;s Website Optimizer, and it doesn&#039;t cost hundreds or thousands per month like most hosted Taguchi solutions.

All of the tools mentioned in this post are good options, AFAIK.  As mentioned before, the ability to find good factors to test is more important than the tool you use to a large degree.  But some tools are out of some SBO&#039;s budgets, and others take too long for sites with low traffic.</description>
		<content:encoded><![CDATA[<p>For small online business owners who don&#8217;t have a landing page that gets 10,000 page views per day, a fractional factorial (e.g. Taguchi) tool might work out better.</p>
<p>Google&#8217;s Website Optimizer can run small Taguchi tests &#8212; just use the main effects results instead of the combination report.  But it&#8217;s difficult to run a test with more than 1000 combinations this way if you don&#8217;t have a ton of traffic.</p>
<p>Also, if you aim to improve a metric that&#8217;s already getting about a 20% conversion rate, you can confirm a 20% improvement (i.e., going from 20% to 24%) much more quickly than you can if you start with a metric getting a 1% conversion rate.</p>
<p>So if you&#8217;re optimizing a sales page getting 1%, you might need up to 60,000 visitors to confirm a 20% improvement (i.e., going from 1% to 1.2%).  But going from 20% to 24% can be confirmed in about 1200 visitors.</p>
<p>The key is to find a metric that&#8217;s correlated with sales, and which starts out in the &#8220;sweet spot&#8221; of 10%-50% conversion rate.</p>
<p>There are two nice ways to do this in my experience.  Break the page into multiple pages.  Or measure something like &#8220;time on page&#8221;.  Then you can measure something (visitors staying &gt; 60 seconds, or visitors clicking to page 2) that starts with about a 20% conversion rate instead of something (sales) that starts with a 1% conversion rate.</p>
<p>To the extent that these other metrics are correlated with sales, you can speed up your testing by a factor of 10 or more.</p>
<p>For those who are interested, the Split Test Accelerator provides a way to run large tests with very little traffic.  It offers faster tests than Google&#8217;s Website Optimizer, and it doesn&#8217;t cost hundreds or thousands per month like most hosted Taguchi solutions.</p>
<p>All of the tools mentioned in this post are good options, AFAIK.  As mentioned before, the ability to find good factors to test is more important than the tool you use to a large degree.  But some tools are out of some SBO&#8217;s budgets, and others take too long for sites with low traffic.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Artur</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-695168</link>
		<dc:creator>Artur</dc:creator>
		<pubDate>Sun, 04 May 2008 11:07:31 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-695168</guid>
		<description>Hi everyone,

Alasdair, thanks for answering my comment. 

Robert, thanks for answering too.

As i said, i`ve mencioned futurenowinc, and yours services, to my boss. Our site, it`s not optimized for sales. I´m trying to show them that investing on a company that offers services like yours the ROI will be garanted. 

Sorry for my english, i`m portuguese.

Cumps,</description>
		<content:encoded><![CDATA[<p>Hi everyone,</p>
<p>Alasdair, thanks for answering my comment. </p>
<p>Robert, thanks for answering too.</p>
<p>As i said, i`ve mencioned futurenowinc, and yours services, to my boss. Our site, it`s not optimized for sales. I´m trying to show them that investing on a company that offers services like yours the ROI will be garanted. </p>
<p>Sorry for my english, i`m portuguese.</p>
<p>Cumps,</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Robert Gorell</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-568888</link>
		<dc:creator>Robert Gorell</dc:creator>
		<pubDate>Mon, 10 Mar 2008 12:49:50 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-568888</guid>
		<description>Arthur &amp; Alasdair,

We offer website optimization testing as well. In fact, all of our &lt;a href=&quot;http://www.futurenowinc.com/consultingservices.htm&quot; rel=&quot;nofollow&quot;&gt;services&lt;/a&gt; have testing as an integral component.

Remember, the important part isn&#039;t which tool you use to test -- it&#039;s knowing WHAT to test, and how to optimize the site according to visitor motivations.

Hope that helps!

-Editor, GrokDotCom</description>
		<content:encoded><![CDATA[<p>Arthur &#038; Alasdair,</p>
<p>We offer website optimization testing as well. In fact, all of our <a href="http://www.futurenowinc.com/consultingservices.htm">services</a> have testing as an integral component.</p>
<p>Remember, the important part isn&#8217;t which tool you use to test &#8212; it&#8217;s knowing WHAT to test, and how to optimize the site according to visitor motivations.</p>
<p>Hope that helps!</p>
<p>-Editor, GrokDotCom</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alasdair Bailey</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-567740</link>
		<dc:creator>Alasdair Bailey</dc:creator>
		<pubDate>Sun, 09 Mar 2008 23:01:08 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-567740</guid>
		<description>Hi Artur,

you can find more information on those tools and also Maxymiser and Offermatica (now Omniture) by simply googling them. I don&#039;t think many will offer a &#039;price list&#039; because the level of engagement will vary depending on what your organisation is looking to achieve from the multivariate testing.

i hope this helps

Kind regards,
Alasdair</description>
		<content:encoded><![CDATA[<p>Hi Artur,</p>
<p>you can find more information on those tools and also Maxymiser and Offermatica (now Omniture) by simply googling them. I don&#8217;t think many will offer a &#8216;price list&#8217; because the level of engagement will vary depending on what your organisation is looking to achieve from the multivariate testing.</p>
<p>i hope this helps</p>
<p>Kind regards,<br />
Alasdair</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Artur</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-567721</link>
		<dc:creator>Artur</dc:creator>
		<pubDate>Sun, 09 Mar 2008 22:50:24 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-567721</guid>
		<description>I everyone ...

A friend of mine talk to me about your site (grokdotcom.com), and he told me it has some usefull and valid SEO info.

I allready know google´s tool, but i`ve never heard before of
Optimost, SiteSpect, Verster .

I`ll do a search about the price and advise the company where i work to invest in those tools (if they could effort it)

Thanks for the usefull tips ...</description>
		<content:encoded><![CDATA[<p>I everyone &#8230;</p>
<p>A friend of mine talk to me about your site (grokdotcom.com), and he told me it has some usefull and valid SEO info.</p>
<p>I allready know google´s tool, but i`ve never heard before of<br />
Optimost, SiteSpect, Verster .</p>
<p>I`ll do a search about the price and advise the company where i work to invest in those tools (if they could effort it)</p>
<p>Thanks for the usefull tips &#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Work-LIVE SEO Devon</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-557746</link>
		<dc:creator>Work-LIVE SEO Devon</dc:creator>
		<pubDate>Wed, 05 Mar 2008 09:35:25 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-557746</guid>
		<description>Interesting... I have heard mention of multivariate testing before, but am very interested after reading this article.

Grokdotcom does it again.</description>
		<content:encoded><![CDATA[<p>Interesting&#8230; I have heard mention of multivariate testing before, but am very interested after reading this article.</p>
<p>Grokdotcom does it again.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Preview Organic Landing Page Conversion with PPC Tests. &#187; aimClear Search Marketing Blog</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-189878</link>
		<dc:creator>Preview Organic Landing Page Conversion with PPC Tests. &#187; aimClear Search Marketing Blog</dc:creator>
		<pubDate>Thu, 13 Sep 2007 12:15:39 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-189878</guid>
		<description>[...] http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/ [...]</description>
		<content:encoded><![CDATA[<p>[...] <a href="http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/</a> [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Wild Apricot Blog</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-124530</link>
		<dc:creator>Wild Apricot Blog</dc:creator>
		<pubDate>Tue, 31 Jul 2007 14:54:16 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-124530</guid>
		<description>&lt;strong&gt;Google Optimizer: free tool to increase sign-ups, donations or anything else on your site...&lt;/strong&gt;

Google has recently released a new product: a testing tool called Website Optimizer to help sites maximize...</description>
		<content:encoded><![CDATA[<p><strong>Google Optimizer: free tool to increase sign-ups, donations or anything else on your site&#8230;</strong></p>
<p>Google has recently released a new product: a testing tool called Website Optimizer to help sites maximize&#8230;</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Tell the Truth with PPC Ads for Higher Landing Page Conversion, aimClearBlog, Multivariate landing page testing</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-103016</link>
		<dc:creator>Tell the Truth with PPC Ads for Higher Landing Page Conversion, aimClearBlog, Multivariate landing page testing</dc:creator>
		<pubDate>Wed, 11 Jul 2007 03:14:02 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-103016</guid>
		<description>[...] Start Multivariate Testing: 7 Critical Questions [...]</description>
		<content:encoded><![CDATA[<p>[...] Start Multivariate Testing: 7 Critical Questions [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: (EMP) E-Marketing Performance &#187; : &#187; Team Reading List 6.13.07</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-72085</link>
		<dc:creator>(EMP) E-Marketing Performance &#187; : &#187; Team Reading List 6.13.07</dc:creator>
		<pubDate>Wed, 13 Jun 2007 14:19:04 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-72085</guid>
		<description>[...] Start Multivariate Testing: 7 Critical Questions [...]</description>
		<content:encoded><![CDATA[<p>[...] Start Multivariate Testing: 7 Critical Questions [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alasdair Bailey</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-71838</link>
		<dc:creator>Alasdair Bailey</dc:creator>
		<pubDate>Wed, 13 Jun 2007 08:20:08 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-71838</guid>
		<description>Hi Bryan,

Thanks for the coverage of Multivariate testing, it&#039;s an area that not many people know about just yet and as you say, the uplift in conversions can be very strong!

Just one point - the guys that charge monthly do so because it makes sense for many companies to perform this testing on an ongoing basis. Starting with testing on the homepage then moving to pages deeper within the site or PPC/CPM specific landing pages will give almost a year&#039;s worth of work anyway so it&#039;s more cost effective to enter into a contract than to approach each project separately.

There&#039;s also continuous optimisation technology that monitors conversions then automatically optimises towards the best performing content. For some of our clients, running this on an ongoing basis for their homepage means their best performing content for time of day or time of year is always displayed prominently.

Google&#039;s tool is quite rudimentary and the paid for tools offer a far more full featured product in order to justify their pricing.

You also missed a company; Maxymiser is a European based expert in this field, we have our own blog at http://maxymiser.blogspot.com and our website is at http://www.maxymiser.com

Kind regards,
Alasdair</description>
		<content:encoded><![CDATA[<p>Hi Bryan,</p>
<p>Thanks for the coverage of Multivariate testing, it&#8217;s an area that not many people know about just yet and as you say, the uplift in conversions can be very strong!</p>
<p>Just one point &#8211; the guys that charge monthly do so because it makes sense for many companies to perform this testing on an ongoing basis. Starting with testing on the homepage then moving to pages deeper within the site or PPC/CPM specific landing pages will give almost a year&#8217;s worth of work anyway so it&#8217;s more cost effective to enter into a contract than to approach each project separately.</p>
<p>There&#8217;s also continuous optimisation technology that monitors conversions then automatically optimises towards the best performing content. For some of our clients, running this on an ongoing basis for their homepage means their best performing content for time of day or time of year is always displayed prominently.</p>
<p>Google&#8217;s tool is quite rudimentary and the paid for tools offer a far more full featured product in order to justify their pricing.</p>
<p>You also missed a company; Maxymiser is a European based expert in this field, we have our own blog at <a href="http://maxymiser.blogspot.com">http://maxymiser.blogspot.com</a> and our website is at <a href="http://www.maxymiser.com">http://www.maxymiser.com</a></p>
<p>Kind regards,<br />
Alasdair</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Start Multivariate Testing: 7 Critical Questions &#183; Legitimate Work From Home Jobs Blog</title>
		<link>http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/comment-page-1/#comment-71046</link>
		<dc:creator>Start Multivariate Testing: 7 Critical Questions &#183; Legitimate Work From Home Jobs Blog</dc:creator>
		<pubDate>Tue, 12 Jun 2007 17:07:27 +0000</pubDate>
		<guid isPermaLink="false">http://www.grokdotcom.com/2007/06/12/start-multivariate-testing-7-critical-questions/#comment-71046</guid>
		<description>[...] Read more of this story&#8230; [...]</description>
		<content:encoded><![CDATA[<p>[...] Read more of this story&#8230; [...]</p>
]]></content:encoded>
	</item>
</channel>
</rss>
