I like the direction you are going in with this article... keep it going. Andrew King covers similar topic in his new book called Website Optimization.
Jesse
· 1 year ago
Douglas,
Thanks for the kind words. Will do!
Prakash S
· 1 year ago
Does google analytics/ other analytics tool help you with A/B testing? Good intro to A/B testing.
Jesse
· 1 year ago
Prakash,
Google has the Google Website Optimizer, which supports both A/B and multivariate testing, but it's fairly limited. It only measures "conversion" events.
You can't, say, segment Google Analytics reports based on GWO experiments.
Frank Licht
· 1 year ago
Nice article :) Really helped me with the basics. You allready stated the Google Website Optizer is farly limited, but which tool would you recommend then? Thanks in advance!
Jesse
· 1 year ago
Frank,
Give GWO a try, it might do what you need. I usually write my own.
Tim Cederman
· 1 year ago
Great article as always (and the preamble and follow up ones). As someone with a qualitative research background, I've really come around to the importance of data-driven design and taking the bias out of design decisions. However, while you qualified your statement "the landing page with the higher conversion rate is better", I think it's more than just unsustainable incentives (and the like) that need to be taken into account.
Two pages may yield the exact same conversion rate - however they may offer a vastly different quality of the conversion (demographic of the user) and experience for the user. I'm not sure why there is often a rift between qualitative and quantitative research as they are really powerful when used in a complementary fashion. Without being able to actually talk to the user and getting a sense of who they are and what their experience was like it's difficult to infer this information otherwise.
Looking forward to the next two articles!
nicmarson
· 4 months ago
I enjoyed this article, very well presented and great examples. I'll be watching for the follow-ups.
nicmarson
· 4 months ago
By the way, I found it from Ryan Carson's article, "How to do A/B Testing in WordPress".
Dog G
· 3 months ago
Thank you - I've learnt a lot from your article. Now, I've just got to implement it...
All Comments
Andrew King covers similar topic in his new book called Website Optimization.
Thanks for the kind words. Will do!
Google has the Google Website Optimizer, which supports both A/B and multivariate testing, but it's fairly limited. It only measures "conversion" events.
You can't, say, segment Google Analytics reports based on GWO experiments.
Give GWO a try, it might do what you need. I usually write my own.
Two pages may yield the exact same conversion rate - however they may offer a vastly different quality of the conversion (demographic of the user) and experience for the user. I'm not sure why there is often a rift between qualitative and quantitative research as they are really powerful when used in a complementary fashion. Without being able to actually talk to the user and getting a sense of who they are and what their experience was like it's difficult to infer this information otherwise.
Looking forward to the next two articles!
Now, I've just got to implement it...