Web Experimentation's Q3 Product Roadmap
See what's coming to the world's fastest, smartest experimentation platform and A/B testing solution
Experiment better. faster. stronger. smarter.
No, we're not as old (or cool) as Daft Punk...but when Optimizely created the experimentation category in 2010 after Dan Siroker's success A/B testing Obama's presidential campaign site, the buzzphrase 'data-driven decision-making' became realistic and democratized for everyone with a website.
13 years later, Optimizely continues to bring game-changing capabilities to the market — with speed, collaboration, integration, and intelligence at the center. Veridis Quo?
Because transforming your business means getting the most out of your digital presence. You need every experience in every channel to be as good as it can possibly be. This is daunting - it requires working as efficiently as possible - it requires minimizing your time-to-insight - it requires a bit of digital love.
That's why we've been chosen by companies of all sizes around the world to bring a culture of experimentation into how they operate. There must be something about us...
Watch our Summer Roadmap Webinar from July 12th (and if you already saw it, watch it one more time)
a first-class INTEGRATION Between OPTIMIZELY & GA4
Audience Targeting & Report Generation in GA4
This out-of-the-box integration requires just 1 click to connect the two systems. Web Experimentation users can now integrate with Google Analytics 4 to send their experiment data to Google, send variation viewers to GA4 as audiences, and more.
- Easy Authentication: Connect Web Experimentation and Google Analytics 4 instances with a single click integration that allows you to send visitor events directly to GA4.
- Report Generation: Create an experiment in Web Experimentation and choose the Google Analytics 4 property you want to associate it with. Report Generation is currently in Beta, and you can gain access here.
- Audience Targeting: Coming later this year, you can create audience segments (based on specific user behaviors and demographics, such as age, gender, location, and more) from within GA4, and send it directly to Web Experimentation.
For information on how to set it up, refer to our developer documentation.
An inclusive way of collaborating on experiments
Introducing: Experiment Collaboration
Scaling an experimentation program requires coordination and planning that can burden existing resources and require additional headcount. Though existing planning tools can help, they aren't purpose-built for experimentation and lack deep integration with Optimizely. With Experiment Collaboration, your team can:
- Document the context of an experiment (hypothesis, variations assets, and key learnings), promoting collaboration and preserving discussion
- Track tasks in the design, build, and launch phases of an experiment to ensure experiments are launched on time
- Collaborate on test planning templates to prompt meaningful discussion upfront, and keep that discussion in one place
- Create workflows and codify the experimentation process to build teams that are self-sufficient…regardless of maturity
- Embed design files and directly annotate screenshots to make it easier to collect feedback and land on a winning idea
- Better manage your experimentation program by using a variety of planning visualizations including calendars, timelines, and board views
Experiment Collaboration is now Generally Available. If you're interested in seeing and learning more, reach out to your account manager or drop us a Contact Us.
Read the details in this announcement written by the Principal Product Manager of our Experiment solution, Brad Yee.
Test with extreme precision
Advanced Audience Targeting
Experimenters depend on audience integrations with third-party customer data platforms to extend experimentation and personalization targeting capabilities.
- Use ODP real-time segments out-of-the-box in your experiments, personalization campaigns, and targeted deliveries
- Use existing segments from your CDP (mParticle, etc)
- Build integrations with custom data sources through Optimizely Connect Platform
- Anonymous Targeting: Target users before they log in, and personalize their experience
- (Coming Soon) Upload lists of users to target
Now you can collect valuable visitor behavioral data, create hyper-specific customer segments, and unlock new use cases for advanced audience targeting, for example: experimenting on visitor cohorts such as a marketing list subscriber, past purchaser, or highly engaged shopper.
Advanced Audience Targeting is in Private Beta, you can request access here.
For more information, ask your Customer Success Manager or check out our developer documentation
Target with extreme precision
Real-Time Segments
Briefly noted above, for those of you using ODP (Optimizely Data Platform), Real-Time Segments will allow you to build custom audiences for real-time personalization and target those audiences with a personalized experience through our Experimentation products, using the freshest data available. For example, you could know about someone abandoning their cart in <90 seconds, and then start personalizing their experience.
- Laser-Focused Targeting: Define custom audiences based on demographics, browsing behavior, and past purchases for deeply personal connections and increased brand loyalty
- Agile Adaptation: Respond to changing trends and opportunities by tailoring campaigns on the fly, maximizing marketing impact and staying ahead of the curve
- Enhanced Customer Experiences: Deliver extraordinary experiences with real-time personalization, offering relevant content and offers that leave a lasting impression
- Increased ROI: Drive higher engagement, conversions, and bottom-line growth with Real-Time Segments' personalized messages, making every marketing effort a strategic investment
If you don't have ODP, you can request access to ODP Lite's beta here and be notified when you're able to try it out!
Stay on top of every experiment
Statistical Significance Notifications
With all-new notifications for statistical significance, you can be confident in your experiment launches knowing that if a monitoring metric reaches statistical significance – oftentimes an unanticipated event, like a significant increase in bounce rate – that you will be alerted in case intervention is required.
- Automated email alerts that indicate when any metric in any variation in an experiment reaches statistical significance
- Reduce operational risk by being alerted when primary metrics reach statistical significance
- Increase experiment velocity by timely concluding experiments and launching next experiments
Statistical Significance Notifications are in Open Beta, you can sign up for access here and if you want further information, check out our developer documentation.
An easier configuration of projects
Shadow DOM support
Companies that architect their websites using shadow DOMs usually do so to compartmentalize their work and avoid conflicting changes on the same webpage.
- Allows hidden DOM trees to be attached to elements in the regular DOM tree
- Traverse your shadow tree in the Visual Editor and select elements within it
- Create boundless experiments throughout your site
Click the checkbox in your Settings (pictured to the right) to enable this feature!
A better understanding of experimentation
Sample Ratio Mismatch (SRM)
Roughly 10% of A/B tests run are invalidated because visitor counts in one of the variants has diverged significantly from the intended proportions, causing a Sample Ratio Mismatch.
- Understand the pervasiveness across our clients and why they occur
- Decrease the number of invalid business decisions customers make
- Get an SRM alert, information about why an SRM is happening and how to fix it
- Increase the number of high-quality experiments
Sample Ratio Mismatch is in Private Beta, you can request access here.
A better WAY TO ORGANIZE experimentS
Flexible Experiment List Columns
With flexible list columns, customize the experiment list page by adding new columns to improve organization. For example, choose to view experiments by:
- Days Running
- Primary Metrics used
- The Experiment Creator
Each customized view has a unique URL so that they can be bookmarked in the browser and shared. This feature is fully available now, you can show/hide columns by clicking on the column button in the top-right corner (pictured to the right).
REMOVE OVERLAP & MAINTAIN QUALITY RESULTS
Mutually Exclusive Experiments (for Edge)
When running a Performance Edge experiment, you can now provide “exclusion groups” to make those experiments mutually exclusive.
- Get non-biased results more often
- Increase the number of concurrent experiments that you’re able to run
- Isolate related experiments that are targeting related audiences
- Use when you don't want a visitor to see multiple experiments at the same time.
A BETTER USER EXPERIENCE
UX Delights
- In-product descriptions for URL match types - Differentiate the URL match types to guide users in selecting the appropriate one.
- Show description in an archived experiment - Display the description of an experiment even when it’s been archived.
- Trigger Simpson’s Paradox Warning message - Only display Simpson’s Paradox warning message when variation traffic distribution, not total traffic allocation, is modified in a running experiment to avoid confusion.
- New advanced project-level SPA settings - Provide new advanced project-level SPA settings for automatic page deactivation and undoing of changes affecting all newly created Pages, therefore automating the need for manual configuration per Page.
- SPA Page Trigger Alert - Warn users instantly when they select a page trigger that requires dynamic website support and the project setting is disabled, therefore reducing the possibility of experiment bugs.
- Visual Editor enhancements - Modify message displayed for more intuitiveness when the Page does not load in the Visual Editor and make ‘delete’ button available so the user is still able to delete the change.
For more information on all recent releases, read our Release Notes
Learn more about Optimizely's roadmap
Join us on World, the global Optimizely community site hosting forums, blogs and documentation for the Optimizely platform. Engage with the worldwide Optimizely community and learn about product updates to stay up to date on how to unlock your potential with Optimizely.
Disclosure and Safe Harbor. [2022-8]. This product roadmap is intended to outline our general product direction. It is intended for information purposes only. It may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Customers who purchase our products should make their purchase decisions based upon features and functions that are currently available. Any unreleased services, features, functionality, or enhancements referenced in any document, roadmap, blog, website, press release, or public statement that are not currently available are subject to change at our discretion and may not be delivered as planned or at all. The development, release, and timing of any features or functionality remains at the sole discretion of Episerver Inc. (dba Optimizely).