About MissWrenchBot

If MissWrenchBot turned up in your access logs, someone used one of the tools on this site to check your address. The crawler doesn’t wander the web by itself and it builds no index.

What it requests

A typical check loads one page and sometimes the files that page references, such as stylesheets, scripts and images, to measure size, headers or caching. The dead link finder follows links within a single site. It takes its time and stops at a fixed number of pages.

How it identifies itself

Requests carry this user agent:

Mozilla/5.0 (compatible; MissWrenchBot/1.0; +https://misswrench.com/crawler/)

Keeping it out

The link finder obeys robots.txt. To exclude it, add:

User-agent: MissWrenchBot
Disallow: /

Single-page checks are made on behalf of a person looking at your site and behave like a browser visit.