[ search crawler · OpenAI ]
OAI-SearchBot: OpenAI's search crawler.
OpenAI's search crawler. It builds the index OpenAI uses to show sites in AI search results. Its intent is search index: stores your pages so they can show up in search results.
IP ranges last updated Oct 25, 2026
[ technical facts ]
- operator
- OpenAI
- intent
- search index
- user agent contains
oai-searchbot- robots.txt token
OAI-SearchBot- verification
- published IP rangesverified
- official IP list
- openai.com/searchbot.json
- ranges in registry
- 14 ranges loaded
- last updated
- Oct 25, 2026
- operator docs
- platform.openai.com/docs/bots
[ verify ]
How to verify a real OAI-SearchBot request.
OpenAI publishes the IP ranges OAI-SearchBot uses. A request is real when its IP is inside that list.
- 01Check the User-Agent header contains "oai-searchbot" (case-insensitive). That is only a claim: anyone can send it.
- 02Download OpenAI's published list (https://openai.com/searchbot.json) and check the request IP falls inside one of its ranges.
- 03Inside the list: the real OAI-SearchBot. Outside it: a request using OAI-SearchBot's name from someone else's server.
Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every OAI-SearchBot request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.
[ robots.txt ]
Block or allow OAI-SearchBot in robots.txt.
Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. OpenAI runs other crawlers with their own tokens, so a rule for OAI-SearchBot leaves GPTBot (training) and ChatGPT-User (answer fetch) untouched.
User-agent: OAI-SearchBot
Disallow: /
User-agent: OAI-SearchBot
Allow: /
robots.txt only binds crawlers that choose to follow it. A scraper sending OAI-SearchBot's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.
[ questions ]
OAI-SearchBot, answered.
[ free scan ]
