Whitepaper Whitepaper

The surprising power of web experiments

Get the article

You must provide your contact details to receive this content. This means that we’ll occasionally invite you to Optimizely events and webinars and send you industry insights and product news.

Optimizely will store and process your personal data as described in our Privacy Policy. You can opt out at any time.

In the fast-moving digital world, even experts have a hard time assessing new ideas. Case in point: At Bing a small headline change an employee proposed was deemed a low priority and shelved until one engineer decided to do a quick online controlled experiment—an A/B test—to try it out. The test showed that the change increased revenue by an astonishing 12%.

That experience illustrates why it’s critical to adopt an “experiment with everything” approach, say Ron Kohavi, the head of the Analysis & Experimentation team at Microsoft, and Stefan Thomke, an HBS professor.

In this Harvard Business Review article they describe:

  • How to properly design and execute A/B and other controlled tests
  • Ensure test integrity
  • How to interpret results and avoid pitfalls