About crawlbench

crawlbench is an open benchmark for SEO and AI-search audit crawlers. It exists because the buying market for these tools is currently evaluated on feature matrices and vendor blog posts — not on whether the tools actually find issues.

Why

There are dozens of "site audit" products and a flood of new GEO/AEO entrants for AI search. None of them publish detection rates against a public, reproducible corpus. crawlbench is the missing reference point.

How it's run

The corpus is open source and self-hostable. The site you're reading is a static Astro build deployed via GitHub Pages. All scoring is reproducible — given a corpus version and a tool invocation, anyone can verify a result.

License & contact

Code and corpus are MIT-licensed. Contact via GitHub issues or pull requests on the project repository.