Crawler disclosure

When a customer adds a domain, our site audit fetches a small number of public URLs on that domain, once when it's added and then about once a week. This page explains what that involves, so site owners who see us in their logs get a straight answer.

How we identify

VisibilityCopilotBot/1.0 (+https://visibilitycopilot.com)

One request per audit uses a GPTBot-style user agent (Mozilla/5.0 (compatible; GPTBot/1.0)) against the homepage. Its only purpose is to tell the site owner whether their firewall blocks AI crawlers.

What we request

• /robots.txt, /sitemap.xml, and /llms.txt
• The homepage, over both https and http, on the apex and www hosts
• Up to about 10 URLs from the sitemap and a few links from the homepage and llms.txt

That's typically a few dozen GET requests per audit.

What we never do

• Submit forms, log in, or try to reach authenticated content
• Get around paywalls, rate limits, or bot protection
• Run JavaScript or do anything beyond reading the returned response

Opting out

Email support@visibilitycopilot.com from an address at the domain, and we'll stop auditing it regardless of who submits it.

Authorisation

Customers confirm they own or are permitted to analyse the domains they submit. If you think a domain was submitted without permission, contact us and we'll investigate and remove it.