What is Claude-SearchBot?

Anthropic's search crawler. It indexes pages so Claude can find them when it searches the web. Intent: search index. Stores your pages so they can show up in search results.

What is the Claude-SearchBot user agent?

Requests from Claude-SearchBot carry "claude-searchbot" in the User-Agent header (matching is case-insensitive). The full string includes a version number that changes over time; Anthropic's documentation lists the current one. In robots.txt, the token is Claude-SearchBot.

How do I verify Claude-SearchBot?

Anthropic publishes the IP ranges Claude-SearchBot uses. A request is real when its IP is inside that list. Paste an IP into HadoSEO's free bot verifier to check it against the published data.

How do I block Claude-SearchBot in robots.txt?

Add "User-agent: Claude-SearchBot" followed by "Disallow: /" to your robots.txt. Blocking Claude-SearchBot does not block ClaudeBot or Claude-User: each has its own token and its own rule. robots.txt is a request, not a lock: a scraper using Claude-SearchBot's name ignores it, which is why verification matters.

Can I see when Claude-SearchBot visits my site?

Yes. HadoSEO logs every Claude-SearchBot request by page, checks it against Anthropic's published data, and flags requests that use the name from IPs Anthropic doesn't own. For a one-off look, the free log file analyzer reads a week of your server logs in the browser.

[ search crawler · Anthropic ]

Claude-SearchBot: Anthropic's search crawler.

Anthropic's search crawler. It indexes pages so Claude can find them when it searches the web. Its intent is search index: stores your pages so they can show up in search results.

search indexverifiable by published IP ranges

IP ranges last updated Oct 25, 2026

Check a Claude-SearchBot IP All AI crawlers

[ technical facts ]

operator: Anthropic
intent: search index
user agent contains: claude-searchbot
robots.txt token: Claude-SearchBot
verification: published IP rangesverified
official IP list: claude.com/crawling/bots.json
ranges in registry: none loaded (source unreachable at last refresh)
last updated: Oct 25, 2026
operator docs: support.anthropic.com/en/articles/8896518

[ verify ]

How to verify a real Claude-SearchBot request.

Anthropic publishes the IP ranges Claude-SearchBot uses. A request is real when its IP is inside that list.

01Check the User-Agent header contains "claude-searchbot" (case-insensitive). That is only a claim: anyone can send it.
02Download Anthropic's published list (https://claude.com/crawling/bots.json) and check the request IP falls inside one of its ranges.
03Inside the list: the real Claude-SearchBot. Outside it: a request using Claude-SearchBot's name from someone else's server.

Skip the lookups: the free bot verifier checks one IP against the same registry, and the log file analyzer checks every Claude-SearchBot request in a week of access logs. Requests that fail are flagged as spoofed, not hidden.

[ robots.txt ]

Block or allow Claude-SearchBot in robots.txt.

Add one of these groups to the robots.txt at your domain root. The token matches case-insensitively. Anthropic runs other crawlers with their own tokens, so a rule for Claude-SearchBot leaves ClaudeBot (training) and Claude-User (answer fetch) untouched.

block Claude-SearchBot

User-agent: Claude-SearchBot
Disallow: /

allow Claude-SearchBot

User-agent: Claude-SearchBot
Allow: /

robots.txt only binds crawlers that choose to follow it. A scraper sending Claude-SearchBot's user agent from its own servers won't, which is why HadoSEO checks the IP behind every request.

[ questions ]

Claude-SearchBot, answered.

[ free scan ]