Skip to content
    See every crawl by page and by botSee every crawl, by page
    HadoSEO

    [ scan-bot ]

    About HadoSEO's scan requests

    When someone runs our free AI crawler scan on a site, HadoSEO fetches up to 5 of its pages using the user agents of common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Googlebot) plus one headless browser render. The point is to show the site owner exactly what each crawler receives.

    Every request we send identifies itself out of band with two headers, regardless of the user agent being simulated:

    From: [email protected]
X-Scan-By: https://hadoseo.com/scan-bot

    Scans are started by a person, fetch at most 5 pages plus robots.txt and sitemap.xml, respect a strict rate limit, and never run continuously. We store page metrics and a 4 KB HTML sample for 30 days, then delete them.

    Opting out

    To stop scans of your site, block requests carrying the X-Scan-By header above in your WAF, or email [email protected] with your domain and we'll exclude it.