A/B test calculator

Compare two independent conversion rates using a pooled two-proportion z statistic and two-sided approximate p-value.

Privacy: runs in your browser

This tool processes your input in this browser. Inputs and results are excluded from analytics. Draft saving is optional and stays on this device; delete saved text with the draft controls. Loading text from a URL is optional and contacts that server; its URL and your IP address are visible to the server. When a button sends your result to another tool, it waits in this tab until that tool opens it, for up to a minute, and is then deleted.

Copy link includes the inputs you choose to share in the address. Anyone with that link can reopen them. Files and generated results are excluded. Password and key tools share settings only.

More options

Answer

…

More results
Compare with other numbers

Save the current answer, then change an input to compare. This clears when you leave.

Rounding and decimal places

Rounding changes how numbers are shown, not how they are calculated.

Automatic precision rounds answers for reading: up to six significant digits, with whole numbers kept in full. Thousands separators such as 1,000 are accepted; use a dot for decimals.

More
Quick calculator

Use +, −, ×, ÷, parentheses and %. This doesn’t change the tool above.

Keyboard shortcuts

Sharing and starting over

A copied link includes what you entered and your settings, so anyone with it can see them. Leave private text out. Files and results are not included; random draws are made again.

Start over puts the tool back to its starting values and closes any open file or device. Drafts you saved stay on this device until you delete them.

How it works

z = (rate B − rate A)/√(pooled rate × (1 − pooled rate) × (1/nA + 1/nB)). Requires independent observations and a suitable normal approximation. Sparse outcomes, repeated peeking and multiple comparisons can invalidate interpretation; no automatic winner or causal claim.

Next: Normal distribution calculator

Next: Sample size calculator

Worked example

If version A converts 100 of 1,000 visitors (10%) and version B converts 120 of 1,000 (12%), B is up 2 percentage points, a 20% relative lift, with a pooled z of 1.43 and a two-sided p-value of about 0.15.

How the conversion-rate difference changes with group A visitors

Other inputs keep their starting values: Group A conversions: 100; Group B visitors: 1,000; Group B conversions: 120. Examples only, not recommendations.

Group A visitorsConversion-rate difference (percentage points)
500-8
1,0002
2,0007
Cite this page

ToolOctopus. “A/B test calculator.” Updated . https://tooloctopus.com/ab-test-calculator.

Add an access date if your instructions require one.

Citation formatting uses citeproc-js by Frank Bennett and Citation Style Language styles. License and source code.

Find a tool

Type a task, a unit pair, a sum or a time zone. ↓ to choose, Enter to open.