Program Manager Level 1
As the experimentation lead, who we call The Maestro, you will learn strategies involved in setting up an experimentation program, how to design data driven hypotheses, the basics of creating experiments, how to interpret and share results across your company.
Concepts addressed in this path:
- Foundations of experimentation cycle and program structure
- Align experimentation to your business goals
- Build an optimization team
- Understand the purpose of a testing charter
- Decide what is important to include in your charter
- Build your own testing plan using our starter templates
- Connecting revenue to experimentations
- Primary, secondary, and monitoring metrics
- Using direct and indirect data to develop experiment ideas
- Identifying and defining problem statements
- Crafting hypotheses using the Problem > Solution > Result framework
- Account structure
- Setting up projects
- Manage Collaborators
- Project and account settings
- Calculating sample sizes
- Prioritizing ideas with a defined framework
- Best practices for:
- Defining experiment components: Pages, Events, Extensions (to add), Audiences
- Building experiments with those components
- Creating variations using Visual and Code Editors
- Basic experiment QA using the Previewer
- Includes Full Stack and Web
- Managing hypotheses
- Statistics for experimentation
- How Stats Engine is different from other statistical models
- Reading the Optimizely results page
- Taking action on winning, losing, and inconclusive variations
For those who prefer to follow a study-guide instead of reviewing eLearning, we also offer this study guide which provides you articles and other content designed to prepare you for the certification exam.
The certification exam can be accessed at Program Manager Level 1 Exam.
Setting Up Your Experimentation Program Structure
This course will teach you the various ways an experimentation program structure can be set up, as well as which individuals should be involved and what various teams might look like.
The Experimentation Cycle
Experimentation is an iterative cycle. Learn how to develop processes for your experimentation program and improve your optimization methodology.
Align Experimentation to Your Business
The best experimentation programs align closely with the goals of the business. Learn how in this course.
Where Should You Experiment?
Figuring out where to experiment is hard. In this course, you will learn how to use existing site analytics to create high impact tests relevant to your industry.
Leverage Data to Drive Experiments
Learn to explore data from your analytics, heat maps, and other tools to take your experimentation program to the next level.
Solving Problems That Matter
Use your data to identify the problem that matter to your business, and then generate effective solutions to address these problems.
Build Your Optimization Team
You can't be a lone wolf forever. In this course, we'll help you build your experimentation team and nurture a culture of optimization.
Create a Testing Roadmap
In this course, you'll learn how to define your primary and secondary metrics and create roadmap of future experiments.
Prioritize Your Experiments
In this course, you'll develop a prioritization framework to ensure you are focusing on the most impactful experiments.
Write an Effective Hypothesis
At the heart of the scientific method is the hypothesis. Using the framework presented here, you'll learn how to write effective hypotheses for your experiments.
Manage Projects & Collaborators
This course will teach you how to manage projects in Optimizely, and add collaborators with the appropriate permissions.
Prepare Your Site for Optimizely
This course will teach you how to prepare your website for Optimizely Web by creating Pages, Events, and Audiences.
Build an Experiment in Optimizely
This course will take you step-by-step through building an experiment in Optimizely.
Create a Variation in Optimizely
This course will teach you how to use the Optimizely Editor to create variations for your experiments.
NEW! Strategies for Using Optimizely Rollouts
Optimizely Rollouts is a free feature flagging solution development teams can use to roll out features confidently, target key audiences, and easily roll back poor performing features. This course offers insights to the benefits of feature flags and where they can be used in development workflows.
NEW! Optimizely Full Stack: Strategy - Build a Feature
Let's jump into Full Stack and learn a little bit about what SDKs are for, what the datafile is, and how to build our first feature!
QA Your Optimizely Experiment
This course will teach you the various ways in which you can QA your Optimizely experiment before launching it.
Optimization Statistics
In this course, you'll learn how the Optimizely Stats Engine calculates results to enable business decisions.
Information on the Results Page
In this course we'll introduce you to the information available on Optimizely's Results page.
Share your Results with Others
Once you've interpreted your results, why not share them with others to invest in long-term success for your program?
Take Action on Winning Variations
A winning variations is almost always a reason for celebration. But what you do next matters more!
Take Action on Losing Variations
A losing variation can sometimes feel disheartening, but take comfort in knowing you've tapped into something your visitors care about!
Take Action on Inconclusive Variations
How can you make more impactful changes to ensure that your next experiment will be statistically significant?
Certification Exam
Once you've completed the above courses, you are ready to test for the certification. Please visit the Program Manager Level 1 exam.
New Courses
Information on the Results Page
In this course we'll introduce you to the information available on Optimizely's Results page.
Personalization Overview and Strategy
In this course, you will learn various ways of personalizing a website, as well as review best practices for utilizing personalization strategies.
Building Adaptive Audiences in Optimizely Web
In this course, learn about Adaptive Audiences, how to use it, and how it allows you to deliver relevant experiences based on visitor interest.
NEW! Optimizely Full Stack: Technical - Build a Feature
In the first part of our series of how-to courses, you will learn the initial steps to implementing full stack, including installing the SDK and becoming familiar with the datafile, then learn how to build your first feature.