About WebverdioBot

WebverdioBot is the crawler behind Webverdio’s website audits.

When it visits

Only when someone requests an audit of a website, confirms the request by email and confirms that they own the site or have permission to have it audited. It does not crawl the web on its own.

What it does

  • It follows robots.txt: the rules for WebverdioBot, or the rules for all bots when there is no WebverdioBot section.
  • It sends about two requests per second at most, and visits at most a few hundred pages per audit.
  • It opens pages in a normal browser to take screenshots and to test speed, accessibility and errors.
  • It never submits forms, places orders, creates accounts or logs in, and it does no security testing beyond reading public headers.

Its user agent contains WebverdioBot/0.1 (+https://www.webverdio.com/bot). Speed tests run in Google Lighthouse, which identifies itself as Chrome-Lighthouse.

How to keep it out

Add this to your robots.txt. The next audit request for your site will then stop before visiting any page:

User-agent: WebverdioBot
Disallow: /

Questions? Email hello@webverdio.com.