AI crawler report
See which AI and search crawlers (GPTBot, ClaudeBot, PerplexityBot, Googlebot and others) read your pages, and how often.
What it does
An AI crawlers card on your dashboard: requests from each crawler and who runs it, split into AI training, AI search, AI assistant and search engine crawlers, a day-by-day chart of AI against search engine requests, the pages AI crawlers read most, and when each crawler was last seen.
Why it matters
AI assistants can only cite and recommend pages they have read. This shows whether ChatGPT, Claude, Perplexity and the rest can see your content long before they send you a single visitor, and whether a robots.txt change actually took effect.
How to use it
- Open your dashboard and find AI crawlers. It is empty until your server reports crawler requests.
- Open How to set it up and copy the Cloudflare Worker, Express / Node or WordPress snippet: your site ID is already filled in. Deploy it on the server that serves your pages.
- Within minutes, requests from GPTBot, ClaudeBot, PerplexityBot, Googlebot and others appear by crawler, type and page. Busy site? Send 1 in 10 crawler requests with w: 10.
curl -X POST "https://quietstats.co.uk/api/crawl" -H "content-type: application/json" -d '{"s":"YOUR_SITE_ID","u":"https://example.com/","ua":"GPTBot/1.2"}'Replace YOUR_SITE_ID with the ID shown on your site’s Manage page.
How it works
- Crawlers don’t run JavaScript, so your quietstats tag can’t see them. You add a few lines to your server instead: a Cloudflare Worker, Express or Node middleware, or a WordPress hook (the dashboard shows each one with your site ID filled in).
- For requests whose user agent names a known crawler, the hook sends quietstats the page address and the user agent. Requests from people send nothing.
- quietstats keeps a daily total per crawler and page. The query string is dropped, and the user agent is only used to pick the crawler’s name.
- quietstats.co.uk counts crawlers on its own pages the same way, which is what you see on the live demo.
Privacy
- Collected: Crawler name (from its user agent), page path and day
- Collected: Nothing about people: no IP address, no visitor hash, no cookies
- No cookies, and nothing stored on the visitor’s device.
- Reports show totals only: never a visitor list, IP address or single visit.
Limits
- Needs a small server-side hook (0 bytes added to the tracking script)
- Crawlers are identified by user agent, not verified by IP address
- Not affected by dashboard filters
- Rows: 1 written per crawler request your hook reports; 3 reads per dashboard view
Plans
Every plan, including Free. quietstats is free during launch: the Free plan covers 1 site and 5,000 pageviews a month, and no card is needed. See pricing.
Questions
Do crawlers count as visitors?
No. Crawlers are not people, so they are never counted as visitors or pageviews. They only appear in the AI crawlers card.
My site is busy. Will this add up?
Send 1 in 10 crawler requests with w: 10 in the body and each one counts as 10. Totals stay close and the hook does a tenth of the work.
Can someone fake crawler visits?
Anyone who knows your site ID could send made-up totals, just as with pageviews. The URL must be on your own domain and only known crawler names are accepted.