The Progressive Delivery and Experimentation Virtual Summit

Now more than ever, technology matters. Long before COVID-19 made remote work the norm, digital products were driving value and disruption for organizations. But delivering software safely remained a debate: For years, we thought slow meant more stable code and releases… even though we kept seeing fire drills and suffering through weeks-long releases.

The best, most innovative organizations have realized that it's possible to release code -- in ways that are safer, more stable, and more reliable while providing insights into what users value and need. Nicole Forsgren, author of "Accelerate" and leading software development and DevOps researcher will share insights on what teams can do to improve their software delivery as well as stories from organizations that have seen the benefits of these practices.

• Ship quality code more efficiently
• Create an adaptable engineering culture that delivers products that users need
• Establish best practices for tightening feedback loops with reliable data

In this session, Ellen Chisa, the founder of Dark, will discuss what's desirable (and risky) about programming in production. This workshop will explain the tradeoffs between delivering value to users quickly, and being able to provide the safety and reduced risk that modern software development tools allow. She'll address solutions ranging from no code to the full software development lifecycle, and what it looks like to just use code.

Join the session to learn:

• About modern infrastructure patterns, including how to use "deployless" infrastructure as a step beyond "serverless."
• How working with real data while developing software can reduce errors and decrease time to value.
• To determine when a comprehensive toolchain, no code, or "just code" is the right solution to the challenge your team is facing.

HelloFresh is the global leader in meal kits. As a subscription-based business, with both a digital and in-person user experience, they are not the typical e-commerce platform. Solving product challenges through experimentation is embedded in their culture. Join Abdelrahman Hussein, Software Engineering Lead, and Aleksandra Vangelova, Product Owner from HelloFresh to learn how they built an experimentation architecture that allows them to run and evaluate tests for increasing customer retention.

In this session,

• Understand the challanges of a subscription based product
• Learn about the approach to evaluating retention experiments for such product
• How engineering enables product experimentation in such setup

Selecting the right metrics is key to proving sustainable business impact through experimentation. When it comes to product optimization, only focussing on simple metrics like conversion rates is a short-sighted product strategy. Choosing the wrong indicators of success leads to misguided decisions that hamper growth, innovation, and velocity. In this session, Luís Trindade, Principal Product Manager from the global fashion platform Farfetch, will discuss best practices for identifying metrics to understand and address the constantly evolving needs of your users. Join the session for best practices using data to invest in features that drive sustainable growth and deliver customer value.

Learn how to:

• Instrument product experiments with better and faster results
• Use data to get customer insights and problem solve
• Define a north star metric and a single goal tree to align priorities for success
• Drive efficiency by increasing accuracy for measurement and estimation

Your product is the most important influence on your user experience and lifetime value. The ability to continually learn from your product changes and maximize your outcomes is a critical indicator of driving revenue for your business. Don't be complacent with incremental changes, learn how to find insights that will drive a 10x impact for your business.

This session will cover:

• Using your product as the influencer for your user’s experience and lifetime value.
• Learning from your product changes and maximize your outcomes to drive revenue for your business
• Finding insights that will drive a 10x impact for your business

Has the outcome of an experiment ever gone so strongly against your intuition that you doubt its correct implementation? This is certainly a possibility, as correctly implementing an online experiment is fraught with data quality challenges. There is a considerable amount of engineering and processing of data before it reaches the analysis, leaving plenty of room for bugs and biases to creep in. One of the strongest signals of an incorrect implementation is a sample ratio mismatch (SRM) - when the number of users assigned to each variation differs significantly from what is expected under the intended random allocation.

This talk will:

• Demo a novel SRM test which allows experimentation teams to rapidly detect if there is a bug in the implementation, even while the experiment is running, allowing developers to quickly fix the underlying issue.
• Provide an introduction to both the mathematics of the SRM test as well as the newly open sourced library which developers can immediately integrate into their platform.

Developing a robust A/B/n testing program is critical for every product organization. But there is not a one size fits all approach. Your program must be tailored to your business and audience to be successful. Join Oji Udezue, VP of Product at Calendly, who will share how to craft high-impact customer insights and product experiments, tailored for your company. Oji will draw insights from 20+ years of Product Management at companies like Microsoft and Atlassian and discuss the importance of using qualitative methods to help develop smarter hypotheses with the right tools and practices for your organization.

In this session you will learn:

• Why a strong experimentation culture is important for your product organization
• Proven ways to execute high-impact A/B/n tests with high-quality customer discovery
• The importance of conducting interviews with successful and unsuccessful customers and how to see through your customer’s eyes with live watching techniques

Segment supports a huge ecosystem of partners and platforms, but there are always requests for more customizable options. What if, instead of answering each custom request, we empower customers and partners to build exactly what they’re looking for? Join PM Andy Yeo as he discusses the ideas, conversations, testing, and validation that brought their latest product release—Functions—to life.

When you attend this webinar, you will:

• Learn how product teams go from customer feedback to shipping features
• Walk away with tactics for testing and iterating to launch features that solve customer needs
• Hear an exclusive preview of an upcoming product launch at Segment