Start free

What is an A/B test?

Showing two versions of a page to different visits and comparing how many reach a goal.

How quietstats counts a/B test

What it tells you
Which version of a page did better, and how sure you can be.
How it is counted
Visits and goal completions per version, with a two-proportion test.
Read it well
Decide in advance what “better” means and how long to run; do not stop early on a lucky day.
Watch out
Small tests can’t prove small differences. “No clear winner” is a real answer.

From the metrics handbook: A/B test result.

Worked example

Version A gets 1,000 visits and 30 sign-ups (3.0%); version B gets 1,000 visits and 45 sign-ups (4.5%). B looks better, and a two-proportion test (z ≈ 1.77) says a gap this size would still happen by chance more than 5% of the time, so keep the test running.

Made-up round numbers, to show the arithmetic.

Where to see it

A/B test in quietstats. Exact formulas are on the methodology page.

Try quietstats on your own site

Free for one site and 5,000 pageviews a month, no card needed. No cookies and nothing stored on your visitors’ devices.

Start freeSee the live demo

Related features

Browse all 448 features →

Explore quietstats

See your traffic (119)

Live visitors and live eventsTrend charts, headline cards and any date rangeCompare any two date rangesWorld map, countries and regionsDevices, browsers, operating systems and screens

Sources and campaigns (63)

Sources and channelsAI search referralsUTM campaignsSearch keywords from Google Search ConsoleShort links

Behaviour and content (80)

Top pagesPage transitionsScroll depth and engaged timeClick mapVisitor journeys

Goals, events and conversions (83)

Goals and funnelsCustom events and conversion ratesRevenue cards and revenue by sourceEngagement goalsA/B tests with your own tags and a plain-English confidence note

Reports, sharing and alerts (44)

Alerts inbox and rulesReport snapshotsPassword-protected snapshotsOptional public stats pageAnonymous benchmarks against similar sites

Data in and out (42)

CSV and Excel downloadsStats APIImport from Plausible or GA4API playgroundTSV and XML export for every report

Privacy and performance (17)

Zero cookies, privacy built inUnder 1 KB script and single-page appsPages never countedPrivacy proof page and badge for your siteSigned-in sessions

Why quietstats

Why quietstatsPricingLive demoStart free

Compare

quietstats comparedFeature comparisonvs Google Analyticsvs Plausiblevs Fathom Analyticsvs Simple Analyticsvs Umamivs Matomovs Cloudflare Web Analyticsvs GoatCountervs Piwik PROvs PostHogvs Microsoft Clarityvs Pirsch Analyticsvs MixpanelGoogle Analytics alternatives

Learn

Website analytics guidesMetrics handbookAnalytics glossaryPlaybooksGDPR and cookie-free analyticsInstall on SquarespaceInstall on WixInstall on GhostInstall on Google Tag ManagerBlog

Playbooks and tools

Script size calculatorCookie banner checkerPlaybook: Local businessPlaybook: Online shopPlaybook: Blog or publisherPlaybook: SaaS or appPlaybook: Charity or community groupPlaybook: Agency with clientsUTM link checkerConversion rate calculatorCookie banner traffic-loss calculator