Building a culture of experimentation at Pinterest
YOW! Data 2018
A successful experimentation program consists of much more than mere randomization and measurement. How do you help stakeholders understand the right things to measure, avoid common pitfalls, and learn to rely on A/B tests as the best way to measure a new system or feature? Building a culture of experimentation and the right tools to support it is just as important as the statistics behind the comparisons themselves - and potentially much trickier to get right.
Andrea Burbank joined Pinterest as a data scientist in 2012, building its first successful AB testing framework, dozens of data pipelines, and a culture of testing and experimentation. Prior to Pinterest, she worked as a software engineer at Bing and as a natural language scientist on ranking and relevance at Powerset, a semantic search engine acquired by Microsoft in 2008. She has a BS in physics and a BA in linguistics from Stanford University.