Updated
Using A/B test calculator
Compare two independent conversion rates using a pooled two-proportion z statistic and two-sided approximate p-value.
z = (rate B − rate A)/√(pooled rate × (1 − pooled rate) × (1/nA + 1/nB)). Requires independent observations and a suitable normal approximation. Sparse outcomes, repeated peeking and multiple comparisons can invalidate interpretation; no automatic winner or causal claim.
A worked example
Example inputs: group a visitors = 1000, group a conversions = 100, group b visitors = 1000, group b conversions = 120. Conversion-rate difference (percentage points) = 2.
Before you use the result
z = (rate B − rate A)/√(pooled rate × (1 − pooled rate) × (1/nA + 1/nB)). Requires independent observations and a suitable normal approximation. Sparse outcomes, repeated peeking and multiple comparisons can invalidate interpretation; no automatic winner or causal claim.
Example results for group a visitors
These examples use Group A conversions: 100; Group B visitors: 1000; Group B conversions: 120. They are reference calculations, not recommended settings.
| Group A visitors | Conversion-rate difference (percentage points) |
|---|---|
| 500 | -8 |
| 1000 | 2 |
| 2000 | 7 |
Cite this page
ToolOctopus. “A/B test calculator.” Updated 2026-09-26. https://tooloctopus.com/ab-test-calculator.
Add an access date if your instructions require one.
Citation formatting uses citeproc-js by Frank Bennett and Citation Style Language styles. Licence and source code.
