Free tool
AI readiness checker for your website
See whether ChatGPT, Claude, Perplexity and other AI tools can read your website. We check your robots.txt rules for AI crawlers, llms.txt, sitemap and the signals on your homepage, then tell you what to fix.
What the AI readiness checker tests
AI assistants such as ChatGPT, Claude and Perplexity can only quote your website if their crawlers are allowed in and can read your pages. The checker looks at the same files and tags those crawlers read.
- robots.txt rules for seven AI user agents: GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and CCBot.
- Whether an llms.txt file and an XML sitemap exist.
- The title, meta description, canonical link, language, Open Graph tags and JSON-LD types of your homepage.
- The number of H1 headings, any noindex rule, and how much text is in the HTML before JavaScript runs.
Search crawlers and training crawlers
Not all AI crawlers do the same job. Some fetch pages to answer a person right now or to build an AI search index. Others collect text to train future models. Blocking the first kind keeps you out of those answers. Blocking the second kind is a common, deliberate choice.
What to fix first
Start with anything marked as failed: a search crawler blocked in robots.txt, a noindex rule, or a homepage with almost no text in its HTML. Those stop AI tools from reading you at all. Then work on the title, description and structured data, which help them describe your business correctly.
The check reads your homepage only. Run it again after each change, and keep in mind that crawlers may take days or weeks to visit again.
Frequently asked questions
How do I check if ChatGPT can crawl my website?
Look at your robots.txt for rules that name OAI-SearchBot, ChatGPT-User or GPTBot, or that block all user agents. This checker does that for you and also tests whether your homepage text is readable without JavaScript.
Should I block GPTBot or ClaudeBot?
That is your decision. GPTBot and ClaudeBot collect content for model training, and many sites block them on purpose. Blocking them does not remove you from ChatGPT search, which uses OAI-SearchBot.
What is llms.txt?
llms.txt is a proposed standard: a Markdown file at the root of your site that summarizes what the site is about and links to its most useful pages. It is optional, and not every AI tool reads it yet, so the checker marks a missing file as something to improve, not a failure.
Why does text without JavaScript matter?
Some crawlers read only the HTML your server sends and do not run JavaScript. If your content is added in the browser, they may see an almost empty page. Server-side rendering or static pages fix this.
Does the checker change anything on my site?
No. It makes a few ordinary requests for your homepage, robots.txt, llms.txt and sitemap.xml, the same files any visitor or crawler can open. Results are not stored.
See it answer from your own website
Paste your website address and chat with an agent built from your pages. It takes about a minute.
Create your agent freeFree plan, no credit card needed.