Significance Calculator
Quickly calculate the statistical significance and observed power of your A/B tests.
Group A(Control)
Audience
Conversions
Conversion Rate
1.00%Group B(Test)
Audience
Conversions
Conversion Rate
1.10%Test TypeOne-sided: Detects if Group B is better than Group A. Cannot detect negative impact.Two-sided: Detects if Group B is better OR worse than Group A. This is the safest, most rigorous standard for reliable reporting.
One-sided: Detects if Group B is better than Group A. Cannot detect negative impact.
Two-sided: Detects if Group B is better OR worse than Group A. This is the safest, most rigorous standard for reliable reporting.
Confidence Target
The probability that a detected lift is not due to random chance. 95% is the industry standard (a 5% risk of a false positive), while 90% is often used for lower-risk changes.