AB Test Significance Calculator

WHAT IT DOES AB Test Significance Calculator is a floating calculator panel that computes statistical significance for A/B tests. Enter visitors and conversions for Control and Variant groups. The panel calculates conversion rates, the difference between groups, the p-value (significance level), and a verdict — Significant (p < 0.05), Marginally Significant (p < 0.10), or Not Significant (p ≥ 0.10). This helps you make data-driven decisions about whether your test results are reliable. WHERE IT RUNS This script runs on any website you visit. It reads only the page you are looking at, never other tabs, bookmarks, or browser data. All data stays in your browser — nothing is sent anywhere. HOW TO USE Click the AB Test Significance Calculator panel button in the BotGentz extension toolbar. The panel appears at the edge of the page. Enter visitors and conversions for the Control group, then visitors and conversions for the Variant group. The panel updates instantly — showing conversion rates for both groups, the difference, p-value, and a verdict. Use "Copy Results" to copy the full analysis to your clipboard. You can save your default values — they persist across pages. TECHNICAL MECHANISM The calculator uses a two-proportion z-test (pooled) to estimate statistical significance. It compares the conversion rates of the Control and Variant groups, calculating the pooled proportion and standard error. The z-score is computed as (p2 - p1) / SE, and the p-value is derived from the standard normal distribution using an approximation. The verdict is based on the p-value — p < 0.05 is Significant, p < 0.10 is Marginally Significant, and p ≥ 0.10 is Not Significant. All calculations run client-side in pure JavaScript, with no external dependencies. The UI updates in real time as you type. THE PANEL The panel is a floating overlay that you can drag anywhere on the screen by its header. It remembers its position per site so it reappears where you left it. The panel can be collapsed into a small handle to get it out of the way, and snapped to the edge of the page. It can be resized to fit your workflow. Press Escape to close the panel. PLEASE NOTE This script requires the free BotGentz extension to run. All data stays in your browser — nothing is transmitted or shared. The panel works on any website. The calculator is for estimation purposes only — statistical significance depends on sample size and other factors. Sites change — the script may need updates to match new site structures.