Quiz: What Did You Learn?

Now that you’ve had a chance to learn more about this topic, let’s review what you should have learned with a short quiz. Select the best response to each question. When you've answered all the questions, select the submit button to check your answers.

When you begin to consider building solutions to user problems, look for solutions that will:

  • Make the biggest impact in the shortest period of time
  • Are easiest to implement to increase the likelihood they’ll be adopted quickly
  • Gives you the most efficient ROI
  • Make big changes that visitors will be certain to notice and respond to

Which of these statements is true?

  • Inconclusive experiments are only useful if you can find winners in segmentation
  • Using a hypothesis every time guarantees that you’ll be able to elicit good information from every experiment you run
  • Failure is a part of experimentation and can sometimes teach you more than a winner
  • Using fewer variations helps you hone in on exactly what was a success or failure in an experiment

The local maximum is also known as:

  • Controlled planning
  • A refinement approach
  • Focused experimentation
  • Distillation

What is missing from this hypothesis?

“If we simplify our sign-up form, the number of user registrations will increase by 20%.”

  1. It’s not identifying the problem
  2. It’s not addressing a specific solution
  3. It’s not addressing the projected outcome
  • 1, 2, 3
  • 1, 2
  • 2, 3

A hypothesis needs to include everything except:

  • A problem statement
  • A solution
  • A question
  • An expected result

Without a hypothesis, you risk: .

  • The wrath of your Optimizely CSM
  • Results that don’t make any sense based on what you thought you were testing initially
  • Losing documentation of the content and expectations of prior experiments
  • Unfocused experimentation that doesn’t connect to business goals