How to use split balance check: is your A/B split really even?
Whether the visits landing on version A and version B match the split you meant, using a sample ratio mismatch test.


What it does
You give the two page addresses and the share meant for A; quietstats counts visits landing on each, compares them with the intended split with a chi-square test and flags a mismatch above 9 (about 3 standard errors).
Why it matters
If a 50/50 test is not close to 50/50, a redirect, a cache or bots are skewing it and its results cannot be trusted. Check this before reading any winner.
How to use it
- Open Deep dives → Analysis lab → Split balance check, or search “Split balance check” on All reports (or go to /app/lab/splitbalance?site=YOUR_SITE).
- Pick the two versions and the share meant for A at the top.
- The default range is 30 days; pick another at the top.
- Download any table with its CSV link; small numbers show as “<5” there too.
How it works
- Open your dashboard, go to Deep dives (or Reports on a phone) and open Analysis lab.
- Under Tools, tap Split balance check. You can also search for it on the All reports screen.
- Pick a date range (and any options at the top), read the “How to read this” notes, and download any table as CSV.
Privacy
- Collected: Nothing new: it reads the pageviews, events, goals or daily totals you already have
- Not collected: Anything about a single visitor
- Not collected: Links between days: visitor ids still reset at midnight
- No cookies, and nothing stored on the visitor’s device.
- Reports show totals only: never a visitor list, IP address or single visit.
Limits
- Counts visits that land on each version
- Up to 92 days and 200,000 pageviews per screen
- Read from the database only when you open it, then kept for 10 minutes
Plans
Every plan, including Free. quietstats is free during launch: the Free plan covers 1 site and 5,000 pageviews a month, and no card is needed. See pricing.
Questions
Is the split I type saved?
No. What you type is used to work out this page only and is never saved.
Does it store anything new?
No. It is worked out from the pageviews and events you already have when you open the screen, and only the totals are kept for 10 minutes.
Related
Feature page: Split balance check: is your A/B split really even? → What it is, why it matters, privacy and how other tools do it.