SiteOne Crawler

Cross-platform CLI crawler covering SEO, security, accessibility and performance. Includes a --ci quality-gate flag for build pipelines. Native binary (no runtime dependency) makes it the most CI/CD-friendly option in the benchmark.

seo oss self-hosted

Vendor: SiteOne / janreges (open source)
Homepage: https://github.com/janreges/siteone-crawler
Pricing: Free (MIT)

Score · v0.1-preview

51%

overall detection rate · 72 / 140 issues found · 7 false positives

Tested on the Free (MIT) plan · version v2.1.0. Detection capability is often plan-gated; this score reflects the plan above.

By category

crawlability

80%

16 / 20

indexability

67%

12 / 18

on page

64%

14 / 22

structured data

39%

7 / 18

internationalization

42%

5 / 12

performance

43%

6 / 14

js rendering

36%

5 / 14

ai crawlability

33%

4 / 12

geo visibility

30%

3 / 10

Claimed capabilities

What the vendor says this tool does, from its marketing pages — not crawlbench's measured detection above. Sourced 2026-06-09. See the full capability matrix.

Crawlability	✓	robots.txt, redirects, status codes, sitemap.xml/index parsing
Indexability	◐	generates sitemap; canonical/noindex/pagination not documented
On-page	✓	titles + uniqueness, descriptions, headings, missing H1
Structured data	✗	no JSON-LD/schema.org validation documented
Internationalization	✗	no hreflang/locale handling documented
Performance	◐	response times, perf score, WebP/Brotli; no Core Web Vitals
JS rendering	✗	static analysis; --disable-javascript, no headless rendering
AI readiness / GEO	✗	no AI-crawler rules or answer-engine readiness documented

Sources

Integration ecosystem

MCP: None
API: No
CI/CD integration: Yes
Agentic interface: No

Notes

Run from the CLI against the corpus root URL. Default ruleset, no custom configuration.