lacunary - Mathnotes

A/B Testing

An A/B test is a two-sample statistical inference problem. Given two @random-variables

  • X

When we're running an A/B test, we have two groups of users, group A and group B.

We change some functionality for group A and leave it stable for group B. We want to see if there is a statistically significant difference between group A and group B for some metric.