A/B Testing Resources

You will find below links to resources you might find useful.

A/B Testing strategy & implementation

[fusion_builder_container hundred_percent=”yes” overflow=”visible”][fusion_builder_row][fusion_builder_column type=”1_1″ background_position=”left top” background_color=”” border_size=”” border_color=”” border_style=”solid” spacing=”yes” background_image=”” background_repeat=”no-repeat” padding=”” margin_top=”0px” margin_bottom=”0px” class=”” id=”” animation_type=”” animation_speed=”0.3″ animation_direction=”left” hide_on_mobile=”no” center_content=”no” min_height=”none”][fusion_checklist icon=”fa-angle-right” iconcolor=”#000000″ circle=”no” circlecolor=”” size=”small” class=”resourceslist” id=””]
[fusion_li_item icon=””]How long to run an A/B test for? (definitive guide)[/fusion_li_item]
[fusion_li_item icon=””]Why your Google Analytics data differs from your A/B testing data?[/fusion_li_item]
[fusion_li_item icon=””]Why you shouldn’t run multiple A/B tests at the same time[/fusion_li_item]
[fusion_li_item icon=””]How to best use the Optimizely free plan (Starter)?[/fusion_li_item]
[fusion_li_item icon=””]The maths behind the minimum sample size in A/B testing (advanced topic)[/fusion_li_item]
[/fusion_checklist]

 

External – A/B Testing

[/fusion_builder_column][fusion_builder_column type=”1_1″ background_position=”left top” background_color=”” border_size=”” border_color=”” border_style=”solid” spacing=”yes” background_image=”” background_repeat=”no-repeat” padding=”” margin_top=”0px” margin_bottom=”0px” class=”” id=”” animation_type=”” animation_speed=”0.3″ animation_direction=”left” hide_on_mobile=”no” center_content=”no” min_height=”none”][fusion_checklist icon=”fa-angle-right” iconcolor=”#000000″ circle=”no” circlecolor=”” size=”small” class=”resourceslist” id=””]
[fusion_li_item icon=””]How Not To Run An A/B Test (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]Lazy Assignment and A/B Testing (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]The Low Base Rate Problem (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]A Formula for Bayesian A/B Testing (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]Bayesian A/B Testing of Count Data (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]A/B Testing Duration Data (Evan Miller)[/fusion_li_item]
[fusion_li_item icon=””]The Greatest Factors Limiting Your Testing Program (ConversionXL)[/fusion_li_item]
[/fusion_checklist]

 

External – Analytics

[/fusion_builder_column][fusion_builder_column type=”1_1″ background_position=”left top” background_color=”” border_size=”” border_color=”” border_style=”solid” spacing=”yes” background_image=”” background_repeat=”no-repeat” padding=”” margin_top=”0px” margin_bottom=”0px” class=”” id=”” animation_type=”” animation_speed=”0.3″ animation_direction=”left” hide_on_mobile=”no” center_content=”no” min_height=”none”][fusion_checklist icon=”fa-angle-right” iconcolor=”#000000″ circle=”no” circlecolor=”” size=”small” class=”resourceslist” id=””]
[fusion_li_item icon=””]How To Set Up Goals, Segments & Events in Google Analytics (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]Creating an Ecommerce Tracking Plan for Google Analytics (Justin Cutroni)[/fusion_li_item]
[fusion_li_item icon=””]Conversion Rate Basics & Best Practices (Avinash Kaushik)[/fusion_li_item]
[fusion_li_item icon=””]How to Analyze Your A/B Test Results with Google Analytics (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]7+ Under-Utilized Google Analytics Reports for Conversion Insights (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]12 A/B Split Testing Mistakes I See Businesses Make All The Time (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]Statistical Significance Does Not Equal Validity (or Why You Get Imaginary Lifts) (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]Google Analytics 101: How To Configure Google Analytics To Get Actionable Data (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]Google Analytics 102: How To Set Up Goals, Segments & Events in Google Analytics (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]5 Things You’re Measuring Incorrectly With Digital Analytics & What To Do About It (ConversionXL)[/fusion_li_item]
[/fusion_checklist]

 

External – e-commerce

[/fusion_builder_column][fusion_builder_column type=”1_1″ background_position=”left top” background_color=”” border_size=”” border_color=”” border_style=”solid” spacing=”yes” background_image=”” background_repeat=”no-repeat” padding=”” margin_top=”0px” margin_bottom=”0px” class=”” id=”” animation_type=”” animation_speed=”0.3″ animation_direction=”left” hide_on_mobile=”no” center_content=”no” min_height=”none”][fusion_checklist icon=”fa-angle-right” iconcolor=”#000000″ circle=”no” circlecolor=”” size=”small” class=”resourceslist” id=””]
[fusion_li_item icon=””]8 UX Requirements for Designing a User-Friendly Homepage Carousel (Baymard Institute) Carousels are generally thought to lower CRs but if yours doesn’t and you keep it on your homepage, make sure to follow these guidelines.[/fusion_li_item]
[fusion_li_item icon=””]
How To Make Mobile Convert: The Most Common Mobile Store Mistakes (ConversionXL)[/fusion_li_item]
[fusion_li_item icon=””]How to Make Mobile eCommerce Convert: What’s Effective In Mobile Design Right Now (ConversionXL)[/fusion_li_item]
[/fusion_checklist]

 

External – jQuery for A/B testing

[/fusion_builder_column][fusion_builder_column type=”1_1″ background_position=”left top” background_color=”” border_size=”” border_color=”” border_style=”solid” spacing=”yes” background_image=”” background_repeat=”no-repeat” padding=”” margin_top=”0px” margin_bottom=”0px” class=”” id=”” animation_type=”” animation_speed=”0.3″ animation_direction=”left” hide_on_mobile=”no” center_content=”no” min_height=”none”][fusion_checklist icon=”fa-angle-right” iconcolor=”#000000″ circle=”no” circlecolor=”” size=”small” class=”resourceslist” id=””]
[fusion_li_item icon=””]Execute variation code when an element is created (Eric Newland, CROmetrics, on Optiverse)[/fusion_li_item]
[/fusion_checklist]

 

Some tools: all the tools below are very robust

[/fusion_builder_column][fusion_builder_column type=”1_2″ spacing=”yes” last=”no” background_color=”” background_image=”” background_repeat=”no-repeat” background_position=”left top” border_size=”0px” border_color=”” border_style=”solid” padding=”” class=”” id=””]

A/B Testing (web)

[/fusion_builder_column]
[fusion_builder_column type=”1_2″ spacing=”yes” last=”yes” background_color=”” background_image=”” background_repeat=”no-repeat” background_position=”left top” border_size=”0px” border_color=”” border_style=”solid” padding=”” class=”” id=””]

Web Analytics

[/fusion_builder_column]
[fusion_builder_column type=”1_2″ spacing=”yes” last=”no” background_color=”” background_image=”” background_repeat=”no-repeat” background_position=”left top” border_size=”0px” border_color=”” border_style=”solid” padding=”” class=”” id=””]

Mobile A/B testing & Analytics

[/fusion_builder_column]
[fusion_builder_column type=”1_2″ spacing=”yes” last=”yes” background_color=”” background_image=”” background_repeat=”no-repeat” background_position=”left top” border_size=”0px” border_color=”” border_style=”solid” padding=”” class=”” id=””]

User Interactions & Research

[/fusion_builder_column][/fusion_builder_row][/fusion_builder_container]