[ AI training crawler · Meta ]
Meta-ExternalAgent: Meta's AI training crawler.
Meta's AI training crawler. It is separate from facebookexternalhit, which builds link previews. Its intent is training: downloads your content to train AI models.
IP ranges last updated Oct 25, 2026
[ technical facts ]
- operator
- Meta
- intent
- training
- user agent contains
meta-externalagent- robots.txt token
Meta-ExternalAgent- verification
- user agent onlydeclared
- official IP list
- not published
[ verify ]
How to verify a real Meta-ExternalAgent request.
Meta publishes no IP list or reverse DNS pattern for Meta-ExternalAgent, so a request using its name can't be confirmed. HadoSEO labels it declared: recognized by user agent only.
- 01Check the User-Agent header contains "meta-externalagent" (case-insensitive). That is only a claim: anyone can send it.
- 02Meta publishes no IP list or reverse DNS pattern for Meta-ExternalAgent that HadoSEO can check, so there is no way to prove a request is real.
- 03Treat it as declared: it says it is Meta-ExternalAgent, and nothing confirms or contradicts that.
Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every Meta-ExternalAgent request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.
[ robots.txt ]
Block or allow Meta-ExternalAgent in robots.txt.
Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively.
User-agent: Meta-ExternalAgent
Disallow: /
User-agent: Meta-ExternalAgent
Allow: /
robots.txt only binds crawlers that choose to follow it. A scraper sending Meta-ExternalAgent's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.
[ questions ]
Meta-ExternalAgent, answered.
[ free scan ]
