Free tools to check what AI can read on your site.
Three free checks, no sign-up: which AI crawlers your robots.txt lets in, whether your llms.txt is written to the proposal, and a generator to write one. Each runs on your live site and shows its working.
Pick a tool
robots.txt checker for AI crawlers
Paste your domain and see, for GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Googlebot, Bingbot and the rest, whether your robots.txt lets each one in, with the line that decides it.
llms.txt validator
Fetches your llms.txt and checks the title, the summary, the sections and every link against the llmstxt.org proposal, line by line.
llms.txt generator
Write an llms.txt in your browser: your name, a one-line summary and your key pages, in the llmstxt.org format, checked as you type.
Read next
The shortlist is being written right now.
See which buyer questions name your brand, who gets named instead, and what to fix. 200 answers. 25 Prompts/Question. Top AI engines. 2 days. Free. No card.
Google AI OverviewsGoogle AI Mode
