Now that you have a better understanding of how to interpret your results, you might be wondering how to set up tests so that you get to significant results more quickly. And, in fact, the principles that define an "effective test" and a test that gets quicker results are one and the same. Here are some of the factors involved:
More visitors in your experiment will help you get significant results more quickly. Running an experiment on your homepage will be lightning-fast compared to a low-traffic page further down your funnel. Why? Because you’ll have more visitors, and a sample size that better reflects your total traffic.
The more conversions that are triggered, the quicker you can get significant results. A goal on the main Call to Action (CTA) will likely blaze past one on your “About Us” link. Why? Because you’re probably going to have more visitors clicking on the main CTA.
More variations can help you get more information, but running an A/B test with 2 variations will get significant data much more quickly than an A/B/C/D/E/F test (6 variations -- yes, people do this). Why? Because each variation can get a significant number of visitors and conversions more quickly. We recommend using between 2-4 variations.