link
Sample size calculator
Required sample size per variant---
A/B TEST CALCULATOR
One calculator for pre-test planning and post-test analysis.
To explore calculator without real test data:
1
How long has the test been running?
Test duration
Additional days needed---
2
Test data
Control
Conversion rate---
Variation 1
Conversion rate---
Lift---
Extra monthly transactions---
Monthly monetary contribution---
P-value---
SignificanceNot significant
SRM-alert: We detected a possible traffic distribution mismatch. Check the technical implementation of your test.
3
Test statistic details and supporting calculators
link
Duration calculator
How long in total to run the test---
Monthly monetary contribution based on data above
Monthly contribution---
Minimum detectable effect (MDE)
| Week | MDE |
|---|---|
| 1 | --- |
| 2 | --- |
| 3 | --- |
| 4 | --- |
| 5 | --- |
| 6 | --- |
4
Results
Results
Significance calculation method
Probability of being a winner
% chance of out performing
ControlVariation 1
0.00.20.30.50.70.81.0
Probability density
Conversion Rate (%)