What is A/B Testing?


A/B testing, also known as split testing, is a simple way to test changes to your page against the current design and determine which ones produce positive results.

It takes the guesswork out of website optimization. By testing your changes before implementing them you get quantitative answers about what modifications create positive results. By constantly testing and optimizing your page you can increase revenue, donations, leads, signups, downloads, or whatever else your goal may be.

In a nutshell, here's how it works:

How it works

How it works, a detailed look:

A/B testing involves testing several different versions of a web page with live traffic and then measuring the effect each version has on your conversion rates. Imagine a company, Acme Widgets, that operates a web store selling widgets. Visitors to their site are presented with a "Buy" button on each widget details page, which leads to a purchase funnel ending with a confirmation page:

Before Optimizely

Acme's head of marketing decides that she'd like to test several different colors for the "Buy" button. She uses Optimizely to display a different button randomly to each incoming user:

With Optimizely

Optimizely measures the number of visitors who saw each version of the button and then clicked it. It also measures the number of visitors who completed the purchase funnel and landed on the "Thank You" confirmation page. In this case, Acme's head of marketing determined that using the red "Buy" button would likely result in the largest uplift in conversion rate, so Acme then redesigns their product detail pages accordingly.

After Optimizely

Houston, we have a problem.

Looks like you've boldly gone where no one's gone before, landing you with this error dialog:

An unknown error occured.

If this error persists, please let us know at our support page. Our apologies for any inconvenience this may have caused.

Browser compatibility

You are currently using a browser that is not supported by Optimizely's editor. Please try using one of the following instead:

Create a free account

Sign up for free to get started

You're seconds away from running A/B tests!

Already have an Optimizely account?

Create experiment

Your new experiment will appear under "DRAFTS" until you start it. Then it will appear under "ACTIVE".

Forgot password

We'll send you an email with a link to reset your password.

Implementing Optimizely

Copy this code and paste it immediately after your opening <head> tag:

Because you are using the Shopify App, the Optimizely embed code is already added to your shop automatically!

If you want to run Optimizely on a page NOT hosted by Shopify, copy & paste this code snippet to the top of the <head> tag:

Copy to Clipboard

Include this snippet on every page you want to run experiments on and track as a goal. This snippet will not change. Note the //cdn prefix is NOT a typo.

If you decide to create additional projects, a new snippet will be generated for each new project. For more information, see Managing Multiple Pages - Using Optimizely Projects.

To add new projects, go to My Experiments.

Each project has a unique Project Code snippet that must be included on every page running experiments or being tracked as a goal.

Your account has more than one project, so be sure to add the correct snippet. To view your projects and project codes, go to My Experiments.

Click on Project Code to get your snippet:

Sign in to Optimizely