OAI-SearchBot is OpenAI's search crawler, identified by the user-agent OAI-SearchBot, that indexes web pages so ChatGPT can surface and cite them in live search-powered answers.

Why it matters

When ChatGPT browses the web to answer "best X tool for Y," the pages it can link come from what OAI-SearchBot has indexed. Blocking it means your site can't appear as a clickable citation in ChatGPT answers, even if GPT models already know your brand from training data via GPTBot. For SaaS founders chasing AI citations, OAI-SearchBot access is table stakes: it's the crawler that turns your content into referral traffic, not just model knowledge.

How to use it

  • Explicitly allow OAI-SearchBot in robots.txt, even if you block GPTBot for training reasons, the two are independent decisions.
  • Verify in server logs that it reaches your money pages (comparisons, alternatives, pricing) and that your CDN's bot protection isn't challenging it with CAPTCHAs.
  • Track ChatGPT referrals in analytics (referrer chatgpt.com) to measure whether indexed pages are actually converting into cited traffic.
Paul-Marie Hamon
Paul-Marie Hamon
Founder @ Readyt

Paul-Marie is the founder of Readyt, the Reddit growth platform for SaaS. He has generated 16K€+ in pre-sales in 2 months using nothing but Reddit, and now helps founders turn Reddit threads into their #1 acquisition channel.