Tools
Crawlers and audit tools currently included in the benchmark corpus. Submissions welcome via pull request — see methodology for inclusion criteria.
seo commercial
Ahrefs Site Audit
Ahrefs
both commercial
Botify
Botify
geo freemium
LLMClicks AI Readiness Analyzer
LLMClicks
both commercial
Lumar
Lumar (formerly DeepCrawl)
both commercial
Oncrawl
Oncrawl
seo commercial
Screaming Frog SEO Spider
Screaming Frog Ltd
seo commercial
Semrush Site Audit
Semrush
both commercial
SEOcrawl
SEOcrawl
seo commercial
Sitebulb
Sitebulb Ltd
seo oss
SiteOne Crawler
SiteOne / janreges (open source)
geo freemium
SiteTest AI Visibility Checker
SiteTest