- Conversion Rate Optimization & Marketing Blog | FutureNow - http://www.grokdotcom.com -
Is Your Data Based on Myth or MythBusting?
Posted By Robert Gorell On August 9, 2007 @ 1:05 pm In A/B Testing,Articles,Research | 6 Comments
“You lose, you smile, and you come back the next day. You win, you smile, you come back the next day.” –Ken Griffey, Jr.
Q. Does “corking” the hollowed center of a baseball bat increase your odds of hitting a home run?
A. No way. Not even close.
It seems many of baseball’s favorite heroes and villains were just vindicated, thanks to the Discovery Channel’s reigning science vigilantes, the MythBusters . With a simple combination — at least they made it look simple — of A/B and multivariate testing, the myth of the corked bat is now officially, totally busted.
Amazing, isn’t it? Amid the hype surrounding Barry Bonds  — whose controversial-yet-stellar career was sealed in the history books this week as he broke Hank Aaron’s record  for most career homers — a crew of special effects nerds set the record straight about cork.
Can Sammy Sosa finally sleep well at night? (Perhaps millions in the bank sooths the joints, but anyone who recalls Sosa’s 2003 corked bat scandal  knows what I mean.) And what of baseball history’s other notorious sluggers? Here’s a brief list of men who can now be called “superstitious” instead of the variety of other adjectives  that have been used:
The 1919 White Sox remain a bit of a stretch. Cork was the least of it; they had mob ties  comin’ out of the cannoli. But maybe that’s the point. Were they using cork to throw games, not to win them?* Did the “cheating” ball players take their cues from the White Sox rather than focusing on how they could optimize their own game? And what about Bonds’ own steroids scandal? Should his detractors put a cork in it, or should Major League Baseball just write in to MythBusters to settle the score?
Speaking of which, back to the MythBusters. Here’s how they did it: First, it should be noted that they got the idea by listening to their audience . Then, using a mechanical bat rig to maintain consistency in hitting speed, they hit a variety of balls that had been kept at a constant humidity — important, since they’d already determined that drier balls go further than humid ones — switching out corked bats for regulation, 100% wood bats. They then measured the distance for each ball, compared the average of the two sets, and found that, believe it or not, the unmodified baseball bat was optimized decades earlier by a company called Louisville Slugger .
Now the baseball forums are going nuts . One was even kind enough to catalog the results of all of the MythBusters’ baseball tests:
1) Corked bats actually reduce the power to hit the ball.
2) Balls kept in a humidor do travel less distance.
3) Sliding is faster than stopping on the base.
4) Throwing a rising fastball is impossible.
5) Hitting the cover off the ball is also impossible. (It took something like 470 mph off the bat to do it.)
Now that we’ve gone 90 years, convinced that our mean, as it were, prejudice about cork had been proved beyond the pale grip of theory, isn’t it time marketers stopped copying the 1919 White Sox, so to say?
Keep swinging for the fences. Just be sure to test your assumptions  before thinking you don’t already have what it takes to hit a home run. This is especially true when testing your website’s performance. Keep your eye on the ball. Make sure you’ve accounted for all known variables  that might affect the results of your online tests. Once you’ve got the fundamentals down, you’ll be in great shape to do it all over again tomorrow — with a smile.
(*I’m no Geraldo Rivera, but I’m guessing we won’t find the answer in Al Capone’s vault .)
Article printed from Conversion Rate Optimization & Marketing Blog | FutureNow: http://www.grokdotcom.com
URL to article: http://www.grokdotcom.com/2007/08/09/are-you-a-marketing-mythbuster/
URLs in this post:
 MythBusters: http://dsc.discovery.com/fansites/mythbusters/mythbusters.html
 Barry Bonds: http://www.time.com/time/specials/2007/article/0,28804,1640086_1640085,00.html
 broke Hank Aaron’s record: http://www.cbsnews.com/stories/2007/08/08/sportsline/main3144504.shtml
 Sosa’s 2003 corked bat scandal: http://www.slate.com/id/2083999/
 other adjectives: http://espn.go.com/page2/s/list/cheaters/ballplayers.html
 mob ties: http://espn.go.com/page2/s/list/readers/baseball/cheaters.html
 they got the idea by listening to their audience: http://community.discovery.com/eve/forums/a/tpc/f/9701967776/m/4711906909
 Louisville Slugger: http://www.slugger.com/
 baseball forums are going nuts: http://www.prosportsdaily.com/forums/showthread.php?t=131218
 test your assumptions: http://www.grokdotcom.com/googlewebsiteoptimizer
 variables: http://www.grokdotcom.com/2007/04/03/64-tips-for-getting-started-with-google-optimizer/
 vault: http://www.anecdotage.com/index.php?aid=15038
Copyright © 2009 FutureNow's GrokDotCom / Marketing Optimization Blog. All rights reserved.