Chicago Web Conf 2012

Chicago Web Conf 2012
Chicago Web Conf 2012

I presenting a talk yesterday at Chicago Web Conf 2012 on A/B Testing Your Designs With Real Users, focusing on the role of A/B in digital product development.

I showed at a high level how we use the A/B testing solution Optimizely where I work at Cars.com to test our designs in ways that are quantitatively measurable. Like other A/B test solutions, Optimizely allows you to quickly create and implement tests and start collecting data immediately.

In addition to showing some examples of our tests and results, I also tried to show how A/B testing can fit into a company’s larger user experience testing strategy. My goal was to leave attendees with five key takeaways regarding A/B testing:

  • It’s not a replacement for testing with individuals.
  • Small changes can lead to big improvements.
  • It takes little effort to test those changes once a solution is in place.
  • This kind of testing can take some of the team friction out of the design process.
  • It can help you get better solutions to market faster.

My slides are available (PDF format).