Product1 min read

See which pages AI crawlers read, and which they never quote

Connect Cloudflare and Proofsource shows every AI crawler that reads your site, the pages it fetched, and the pages AI reads but never quotes. Export the raw log as CSV.

The AI traffic screen: a headline count of AI reads in 14 days, the pages AI reads but never quotes, and reads split by purpose.
AI traffic: how often AI read your site, which crawler read most, and which pages it never quotes. Shown with sample data.

AI engines read your site before they answer about you. Now you can see every read, page by page, and spot the pages AI reads but never quotes.

  1. 1Connect Cloudflare
    The AI traffic setup: choose Cloudflare, then paste your zone ID and an API token.
  2. 2Find pages never quoted
    The Pages tab filtered to Never quoted: six pages with their AI reads, top crawlers and zero quotes.
  3. 3Open every request
    One page's requests: time, crawler, path, IP address, IP check and source, with an Export CSV button.
From connecting Cloudflare to the exact requests behind one page. Shown with sample data.
Diagram: AI crawlers read your site on Cloudflare; each page is then either quoted in answers or read but never quoted, which is the page to fix first.
A page AI reads three or more times but never quotes is the one to fix first.
  1. AI crawlers read

    GPTBot, ClaudeBot, PerplexityBot and other AI crawlers fetch your pages.

  2. Cloudflare reports it

    Each request: time, crawler, page, IP address and IP check.

  3. Matched to answers

    Proofsource checks whether the answers it tracks ever quote that page.

  4. Fix what is ignored

    Read three or more times and quoted zero times: fix it first.

3+
reads with zero quotes flags a page
7 · 14 · 30
day windows
CSV
the raw request log, any time

Every crawler, checked

The Crawlers tab: each AI crawler with its purpose, visits, share of all reads and the share verified by IP address.
Each crawler's purpose, visits and IP check: verified means the visit came from an address that crawler publishes. Shown with sample data.

Availability

Live for every brand today: open AI traffic and connect Cloudflare, or send access logs from any other host.

AI crawler access

Further reading

Published · Questions or feedback? Write to us

Questions

Which crawlers does it recognise?

Known AI crawlers such as GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot and Perplexity-User, each labelled with what it reads for.

Do I need Cloudflare?

No. Cloudflare is the quickest route, and any other host or server can send its access logs instead.

What does "never quoted" mean?

AI crawlers read the page three or more times in the window, and none of the answers Proofsource tracks for you cited it.

See what AI reads on your site, and what it ignores.