11 comments

• 

  Chris

  7 months ago

  Nice post. Social Media had a similar blog entry a while back.
  http://blog.socialmedia.com/crafting-a-statisti...
  reply
• 

  Jesse

  7 months ago

  Chris,
  
  That's a nice video. I wonder what software they were using?
  reply
• 

  Chris

  7 months ago

  They were using an Excel spreadsheet and were kind enough to make it public.
  http://blog.socialmedia.com/wp-content/uploads/...
  
  I just tried it and had to watch the video a couple of times to understand how to use the spreadsheet.
  reply
• 

  Brendan O'Connor

  7 months ago

  The most important thing to know is a software package to use -- you don't want to muck around coding this yourself. R's t.test() is a good choice. (I've heard Excel can do it too I suppose.)
  reply
• 

  Brendan O'Connor

  7 months ago

  The most important thing to know is a software package to use -- you don't want to muck around coding this yourself. R's t.test() is a good choice. (I guess Excel is good too.)
  reply
• 

  hadley

  7 months ago

  If you're going to use R, why not actually use the appropriate test - in this case it would be prop.test() for testing the different between two proportions.
  reply
• 

  Jesse Farmer

  7 months ago

  Where did my comments go? :(
  reply
• 

  Jesse Farmer

  7 months ago

  Oh, that was weird.
  reply
• 

  hadley

  7 months ago

  "The conversion rate for each treatment is a normally distributed random variable" - are you sure??
  reply
• 

  Jesse Farmer

  7 months ago

  "The conversion rate for each treatment approximates a normally distributed random variable" is more correct.
  reply
• 

  Yvonne

  5 months ago

  If for example, you had a treatment D which had a z-score of -2.94 - would you then be 95% confident that treatment D is worse than the control?
  reply