SiteOne Crawler

Cross-platform CLI crawler covering SEO, security, accessibility and performance. Includes a --ci quality-gate flag for build pipelines. Native binary (no runtime dependency) makes it the most CI/CD-friendly option in the benchmark.

seo oss self-hosted

Vendor: SiteOne / janreges (open source)
Homepage: https://github.com/janreges/siteone-crawler
Pricing: Free (MIT)

Score · v0.1

No score available for this tool in the latest run.

Claimed capabilities

What the vendor says this tool does, from its marketing pages — not crawlbench's measured detection above. Sourced 2026-06-09. See the full capability matrix.

Crawlability	✓	robots.txt, redirects, status codes, sitemap.xml/index parsing
Indexability	◐	generates sitemap; canonical/noindex/pagination not documented
On-page	✓	titles + uniqueness, descriptions, headings, missing H1
Structured data	✗	no JSON-LD/schema.org validation documented
Internationalization	✗	no hreflang/locale handling documented
Performance	◐	response times, perf score, WebP/Brotli; no Core Web Vitals
JS rendering	✗	static analysis; --disable-javascript, no headless rendering
AI readiness / GEO	✗	no AI-crawler rules or answer-engine readiness documented

Sources

Integration ecosystem

MCP: None
API: No
CI/CD integration: Yes
Agentic interface: No

Notes

Run from the CLI against the corpus root URL. Default ruleset, no custom configuration.