Skip to content

Glossary · Crawler

OAI-SearchBot

OAI-SearchBot is the crawler OpenAI uses to find and read pages for ChatGPT search. It isn’t used to train models. If your robots.txt or firewall blocks it, ChatGPT can’t show your pages in its search answers or link to them, though it may still name you from other sites.

By Narek NikoghosyanUpdated

OAI-SearchBot vs GPTBot

OAI-SearchBotFinds pages for ChatGPT search. Block it and you can drop out of ChatGPT’s answers.
GPTBotCollects pages that may train OpenAI’s models. Blocking it doesn’t remove you from ChatGPT search.

How to allow it

User-agent: OAI-SearchBot
Allow: /

Check your robots.txt, and any “block AI bots” setting at Cloudflare or your host: those often block search crawlers along with training ones.

Where to see it in stuckUP

The free AI crawler checker tests whether OAI-SearchBot and the other AI crawlers can read your site. Every stuckUP report runs the same check.