Good bot scan

Check whether your website lets good bots in. Enter a domain to see if ScanGovBot can reach and scan it.

Checking if we can reach ...

What is a good bot?

  • It crawls slowly and follows the rules in your robots.txt.
  • It says who it is on every request, using a user-agent that names the bot.
  • It publishes a page explaining that user-agent, so you can look up who is visiting.

About

This tool checks whether ScanGovBot can reach your website using two methods:

  • Standard HTTP fetch
  • Playwright browser fallback

If both methods fail, ScanGov may not be able to audit your site, and other good bots are likely being turned away too.

Common issues

  • Web application firewalls (WAFs) blocking automated requests
  • Server returning error status codes (403, 503, etc.)
  • SSL/TLS certificate problems
  • Site not responding within timeout period

ScanGovBot

Learn more about ScanGovBot.