Skip to content

Free tool · no signup

Can ChatGPT read your website?

Check in seconds whether AI search crawlers from ChatGPT, Claude and Perplexity can reach your site, or whether robots.txt, a firewall or JavaScript is keeping them out.

We read your robots.txt and load your homepage as each crawler. Nothing is stored or shared.

What this checker tests

AI assistants answer many questions by searching the web first. Each one sends its own crawler: OAI-SearchBot for ChatGPT, Claude-SearchBot for Claude, PerplexityBot for Perplexity. If a crawler can’t load your pages, your site can’t be used in the answer.

There are three common ways sites shut them out by accident: a rule in robots.txt, a firewall or CDN setting that blocks “bots”, and content that only appears after JavaScript runs, which most AI crawlers don’t do.

This tool checks all three from our server, plus whether a “noindex” tag hides your homepage from search engines. It’s the same check that runs inside every stuckUP report. Which crawler does what, and which to allow: AI crawlers explained.

Questions

Should I block GPTBot?

It’s your choice. GPTBot collects pages to train OpenAI’s models; blocking it doesn’t remove you from ChatGPT search, which uses OAI-SearchBot. Don’t block OAI-SearchBot if you want to be found.

Does Cloudflare block AI crawlers?

It can. Cloudflare’s AI crawler and bot protection settings can turn AI crawlers away, and newer sites may have this switched on by default. If this checker shows a 403 or a challenge page for an AI search bot, look at the bot settings in your Cloudflare (or other CDN) dashboard and allow verified AI search bots.

Why do you test from your server and not from my computer?

AI crawlers visit from data centres, not from a home or office connection, and many firewalls treat the two differently. Loading your homepage from our server is closer to what a crawler sees.

Is a pass a guarantee that AI can read my site?

No. It means nothing obvious is blocking AI crawlers: robots.txt allows them, your homepage loads for them from our server, and its text doesn’t depend on JavaScript. Real crawlers come from their own addresses, which some firewalls treat differently, and being readable doesn’t mean AI will recommend you.