Skip to content
    HadoSEO

    [ AI training crawler · OpenAI ]

    GPTBot: OpenAI's AI training crawler.

    OpenAI's training crawler. It collects public pages that may be used to train OpenAI's models. Its intent is training: downloads your content to train AI models.

    trainingverifiable by published IP ranges

    IP ranges last updated Oct 25, 2026

    [ technical facts ]

    operator
    OpenAI
    intent
    training
    user agent contains
    gptbot
    robots.txt token
    GPTBot
    verification
    published IP rangesverified
    official IP list
    openai.com/gptbot.json
    ranges in registry
    none loaded (source unreachable at last refresh)
    last updated
    Oct 25, 2026

    [ verify ]

    How to verify a real GPTBot request.

    OpenAI publishes the IP ranges GPTBot uses. A request is real when its IP is inside that list.

    1. 01Check the User-Agent header contains "gptbot" (case-insensitive). That is only a claim: anyone can send it.
    2. 02Download OpenAI's published list (https://openai.com/gptbot.json) and check the request IP falls inside one of its ranges.
    3. 03Inside the list: the real GPTBot. Outside it: a request using GPTBot's name from someone else's server.

    Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every GPTBot request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.

    [ robots.txt ]

    Block or allow GPTBot in robots.txt.

    Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. OpenAI runs other crawlers with their own tokens, so a rule for GPTBot leaves OAI-SearchBot (search index) and ChatGPT-User (answer fetch) untouched.

    block GPTBot
    User-agent: GPTBot
    Disallow: /
    allow GPTBot
    User-agent: GPTBot
    Allow: /

    robots.txt only binds crawlers that choose to follow it. A scraper sending GPTBot's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.

    [ questions ]

    GPTBot, answered.

    [ free scan ]

    How much of your site can AI actually see?

    No signup required · results in ~60 seconds