1. Home
  2. Certifications
  3. Program Manager Level 1 Exam

Program Manager Level 1 Exam

As the Program Manager, aka The Maestro, you require knowledge of all aspects of experimentation, including: strategies involved in setting up an experimentation program, how to design data-driven hypotheses, the basics of creating experiments, how to interpret and share results across your company.

Maestro Level 1

If you feel comfortable with the concepts, please access the exam by clicking Begin. If you are not, we recommend you review the study guide or complete the corresponding learning path.

Price: Free

Concepts

  • Foundations of experimentation cycle and program structure
  • Understand the purpose of a testing charter
  • Decide what is important to include in your charter
  • Build your own testing plan using our starter templates
  • Aligning experimentation goals with business goals
  • Connecting revenue to experimentations
  • Primary, secondary, and monitoring metrics
  • Using direct and indirect data to develop experiment ideas
  • Identifying and defining problem statements
  • Statistics for experimentation
  • How Stats Engine is different from other statistical models
  • Reading the Optimizely results page


Preparing For The Exam

  • Taking action on winning, losing, and inconclusive variations
  • Crafting hypotheses using the Problem > Solution > Result framework
  • Account structure
  • Setting up projects
  • Manage Collaborators
  • Project and account settings
  • Calculating sample sizes
  • Prioritizing ideas with a defined framework
  • Best practices for:
    -Defining experiment components: Pages, Events, Extensions, Audiences
    -Building experiments with those components
    -Creating variations using Visual and Code Editors
    -Basic experiment QA using the Previewer
    -Includes Full Stack and Web
    -Managing hypotheses

Exam Details

  • 50 multiple-choice questions
  • 60 minutes allotted to complete the exam
  • 80% is the passing score
  • No hard-copy or online materials may be referenced during the exam
  • No prerequisites for taking this certification exam