How to use test planner: how long should an A/B test run?
How many visits and days an A/B test needs at your traffic to find a 5%, 10%, 20%, 30% or 50% lift.


What it does
Using your current conversion rate for the goal and your visits per day, quietstats works out the visits needed for a two-version test (50/50 split, 95% confidence, 80% power) for each lift, and how many days that takes.
Why it matters
Most tests on small sites stop too early and crown a winner by chance. Planning the length first avoids that.
How to use it
- Open Deep dives → Analysis lab → Test planner, or search “Test planner” on All reports (or go to /app/lab/testplanner?site=YOUR_SITE).
- Pick a goal at the top, then a lift.
- The default range is 30 days; pick another at the top.
- Download any table with its CSV link; small numbers show as “<5” there too.
How it works
- Open your dashboard, go to Deep dives (or Reports on a phone) and open Analysis lab.
- Under Tools, tap Test planner. You can also search for it on the All reports screen.
- Pick a date range (and any options at the top), read the “How to read this” notes, and download any table as CSV.
Privacy
- Collected: Nothing new: it reads the pageviews, events, goals or daily totals you already have
- Not collected: Anything about a single visitor
- Not collected: Links between days: visitor ids still reset at midnight
- No cookies, and nothing stored on the visitor’s device.
- Reports show totals only: never a visitor list, IP address or single visit.
Limits
- Needs at least 20 visits in the range
- Assumes a 50/50 split and a steady rate
- Up to 92 days and 200,000 pageviews per screen
- Read from the database only when you open it, then kept for 10 minutes
Plans
Every plan, including Free. quietstats is free during launch: the Free plan covers 1 site and 5,000 pageviews a month, and no card is needed. See pricing.
Questions
What if it says over a year?
Test bigger changes (they have bigger lifts), or test on a page with more traffic.
Does it store anything new?
No. It is worked out from the pageviews and events you already have when you open the screen, and only the totals are kept for 10 minutes.
Related
Feature page: Test planner: how long should an A/B test run? → What it is, why it matters, privacy and how other tools do it.