Skip to content
    HadoSEO

    [ search crawler · OpenAI ]

    OAI-SearchBot: OpenAI's search crawler.

    OpenAI's search crawler. It builds the index OpenAI uses to show sites in AI search results. Its intent is search index: stores your pages so they can show up in search results.

    search indexverifiable by published IP ranges

    IP ranges last updated Oct 25, 2026

    [ technical facts ]

    operator
    OpenAI
    intent
    search index
    user agent contains
    oai-searchbot
    robots.txt token
    OAI-SearchBot
    verification
    published IP rangesverified
    official IP list
    openai.com/searchbot.json
    ranges in registry
    14 ranges loaded
    last updated
    Oct 25, 2026

    [ verify ]

    How to verify a real OAI-SearchBot request.

    OpenAI publishes the IP ranges OAI-SearchBot uses. A request is real when its IP is inside that list.

    1. 01Check the User-Agent header contains "oai-searchbot" (case-insensitive). That is only a claim: anyone can send it.
    2. 02Download OpenAI's published list (https://openai.com/searchbot.json) and check the request IP falls inside one of its ranges.
    3. 03Inside the list: the real OAI-SearchBot. Outside it: a request using OAI-SearchBot's name from someone else's server.

    Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every OAI-SearchBot request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.

    [ robots.txt ]

    Block or allow OAI-SearchBot in robots.txt.

    Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. OpenAI runs other crawlers with their own tokens, so a rule for OAI-SearchBot leaves GPTBot (training) and ChatGPT-User (answer fetch) untouched.

    block OAI-SearchBot
    User-agent: OAI-SearchBot
    Disallow: /
    allow OAI-SearchBot
    User-agent: OAI-SearchBot
    Allow: /

    robots.txt only binds crawlers that choose to follow it. A scraper sending OAI-SearchBot's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.

    [ questions ]

    OAI-SearchBot, answered.

    [ free scan ]

    How much of your site can AI actually see?

    No signup required · results in ~60 seconds