๐ A/B Test Significance Calculator
Enter control and variant data to automatically calculate conversion rates, uplift, Z-score, P-value, and statistical significance. Supports 90%/95%/99% confidence levels. Runs entirely in your browser.
Experiment Data
Control
Variant
Quick examples:
Control Conversion Rate
โ
Variant Conversion Rate
โ
Relative Uplift
โ
Absolute Uplift
โ
| Z-Score | โ |
| P-value | โ |
| Confidence Interval (95%) | โ |
| Statistical Power | โ |
About A/B Test Significance
A/B test significance testing determines whether the difference between your control and variant is caused by a real effect rather than random variation. This tool uses the two-proportion Z-test to evaluate the statistical significance of conversion rate differences between two groups.
How to Use
- Enter data: Fill in the total visitors and conversions for both the control and variant groups
- Choose confidence level: 90% (quick tests), 95% (standard), or 99% (high-stakes)
- Review results: Conversion rate comparison, uplift, Z-score, P-value, and significance verdict
Calculation Method
This calculator uses the two-proportion Z-test with the following formulas:
- Pooled conversion rate:
p = (xโ + xโ) / (nโ + nโ) - Standard error:
SE = โ(pร(1-p)ร(1/nโ + 1/nโ)) - Z-score:
Z = (pโ - pโ) / SE - P-value:
P = 2ร(1 - ฮฆ(|Z|))(two-tailed)
Frequently Asked Questions
- What does a significant result mean? โ At the chosen confidence level, the variant's uplift is unlikely (probability below the threshold) to be random noise.
- What if the result is not significant? โ Your sample size may be too small, or there may be no real difference. Try collecting more data and retesting.
- Is my data safe? โ All calculations run locally in your browser. Nothing is uploaded to any server.