What is the Google-Extended user agent?

Requests from Google-Extended carry "google-extended" in the User-Agent header (matching is case-insensitive). The full string includes a version number that changes over time; Google's documentation lists the current one. In robots.txt, the token is Google-Extended.

How do I block Google-Extended in robots.txt?

Add "User-agent: Google-Extended" followed by "Disallow: /" to your robots.txt. Blocking Google-Extended does not block Googlebot: each has its own token and its own rule. robots.txt is a request, not a lock: a scraper using Google-Extended's name ignores it, which is why verification matters.

Can I see when Google-Extended visits my site?

Yes. HadoSEO logs every Google-Extended request by page, and labels it declared, since Google publishes nothing to verify it against. For a one-off look, the free log file analyzer reads a week of your server logs in the browser.

[ AI training token · Google ]

Google-Extended: Google's AI training token.

A Google user-agent token tied to AI training. Google lists it with its common crawlers; it is separate from Googlebot. Its intent is training: downloads your content to train AI models.

traininguser agent only

IP ranges last updated Oct 25, 2026

Check a Google-Extended IP All AI crawlers

[ technical facts ]

operator: Google
intent: training
user agent contains: google-extended
robots.txt token: Google-Extended
verification: user agent onlydeclared
official IP list: not published
operator docs: developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers

[ verify ]

How to verify a real Google-Extended request.

Google publishes no IP list or reverse DNS pattern for Google-Extended, so a request using its name can't be confirmed. HadoSEO labels it declared: recognized by user agent only.

01Check the User-Agent header contains "google-extended" (case-insensitive). That is only a claim: anyone can send it.
02Google publishes no IP list or reverse DNS pattern for Google-Extended that HadoSEO can check, so there is no way to prove a request is real.
03Treat it as declared: it says it is Google-Extended, and nothing confirms or contradicts that.

Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every Google-Extended request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.

[ robots.txt ]

Block or allow Google-Extended in robots.txt.

Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. Google runs other crawlers with their own tokens, so a rule for Google-Extended leaves Googlebot (search index) untouched.

block Google-Extended

User-agent: Google-Extended
Disallow: /

allow Google-Extended

User-agent: Google-Extended
Allow: /

robots.txt only binds crawlers that choose to follow it. A scraper sending Google-Extended's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.

[ questions ]

Google-Extended, answered.

[ free scan ]