[ AI training crawler · OpenAI ]
GPTBot: OpenAI's AI training crawler.
OpenAI's training crawler. It collects public pages that may be used to train OpenAI's models. Its intent is training: downloads your content to train AI models.
IP ranges last updated Oct 25, 2026
[ technical facts ]
- operator
- OpenAI
- intent
- training
- user agent contains
gptbot- robots.txt token
GPTBot- verification
- published IP rangesverified
- official IP list
- openai.com/gptbot.json
- ranges in registry
- none loaded (source unreachable at last refresh)
- last updated
- Oct 25, 2026
- operator docs
- platform.openai.com/docs/bots
[ verify ]
How to verify a real GPTBot request.
OpenAI publishes the IP ranges GPTBot uses. A request is real when its IP is inside that list.
- 01Check the User-Agent header contains "gptbot" (case-insensitive). That is only a claim: anyone can send it.
- 02Download OpenAI's published list (https://openai.com/gptbot.json) and check the request IP falls inside one of its ranges.
- 03Inside the list: the real GPTBot. Outside it: a request using GPTBot's name from someone else's server.
Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every GPTBot request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.
[ robots.txt ]
Block or allow GPTBot in robots.txt.
Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. OpenAI runs other crawlers with their own tokens, so a rule for GPTBot leaves OAI-SearchBot (search index) and ChatGPT-User (answer fetch) untouched.
User-agent: GPTBot
Disallow: /
User-agent: GPTBot
Allow: /
robots.txt only binds crawlers that choose to follow it. A scraper sending GPTBot's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.
[ questions ]
GPTBot, answered.
[ free scan ]
