Lenny's Greatest HitsAll Songs
Home·Growth Engine
Test Everything

Growth Engine · Track 4

Test Everything

Driving Indie Rock · Energetic, defiant, awestruck

Ronny Kohavi · The ultimate guide to A/B testing

A/B testingexperimentationhumility
0:002:39⌨Space - play / pause
← → - seek ±10s
N - next track
P - previous track
“I'm a big fan of test everything. Even small bug fixes can sometimes have surprising, unexpected impact.”- Ronny Kohavi

The Story Behind This Song

A tiny change sat on Bing's backlog for half a year: move the ad text. One engineer said 'I'm building this.' Two days to ship, let it run. The alarm went off: 'Too good to be true, go find the bug.' But there was no bug. Just $100 million in annual revenue.

Lyrics

Based on

The ultimate guide to A/B testing
Ronny KohaviPodcast
PreviousFind Your North StarNextThe First Thousand