Controlled Experiments: An indispensable tool for modern developers
Controlled experiments, or A/B tests, are the gold standard for optimizing websites. From Amazon's checkout flow to Google's search results, A/B tests can help companies improve workflows to download software, sign-up for subscriptions, click on content, or make a purchase. But, controlled experiments have roots far beyond optimizing websites for conversion. In its simplest form, controlled experiments help establish a causal relationship of a change for a target audience.
Microsoft's experimentation (ExP) team takes the basics of controlled experiments, and applies the concept in unsuspecting places to help software development teams restructure the way they think about shipping even the most mundane changes. This talk will give you a flavor of how Microsoft's ExP team works with products like Bing, Office, and Xbox to weave controlled experiments into the day-to-day software engineering processes. From trusting the data to using it to make backlog decisions, you will learn how controlled experiments are an essential tool to making informed decisions at Microsoft.
Presented By WWU Alumna Jennifer Beckmann
Jennifer Beckmann is a Principal Program Manager for the Experimentation platform (ExP) team at Microsoft. She helps guide and develop the Experimentation services that runs hundreds of experiments every day at Microsoft. Her mission is to help scale experimentation both technically and culturally across the company. She teaches the Introduction to Experimentation course for teams who are aspiring to apply A/B techniques to their product discovery process, and helps teams integrate the technology and culture into product. Jennifer earned her BS from Western Washington University and her PhD in database systems from the University of Wisconsin-Madison. Prior to joining the ExP team she was in the Microsoft SQL Server team as a developer.