Quiz: What Did You Learn?

Now that you’ve had a chance to learn more about this topic, let’s review what you should have learned with a short quiz. Select the best response to each question. When you've answered all the questions, select the submit button to check your answers.

What are some reasons you could have an inconclusive experiment?
1- Your sample size is too small
2- Your change is too small to make a difference
3- You experimented on something people don’t care about
4- Your traffic is too low

  • 1, 3, 4
  • 3, 4
  • 1, 2, 3, 4
  • 1, 2

How can the confidence interval help you decide whether to continue an experiment?

  • It tells you how long it’ll take you to reach statistical significance
  • If the confidence interval is a high percentage, then there is greater confidence in the results
  • It tells you a range of the resulting lift (or loss) you can expect if you implement the results
  • If your confidence interval is a wide range of percentages, it is likely best to wait for more conclusive results

True or false: If you do not have enough traffic to your site after 5 days, you should stop the experiment and and try something else.

  • True
  • False