← All tools

Screaming Frog SEO Spider

Industry-standard desktop crawler for technical SEO audits. Covers ~300+ issue types across crawlability, indexing, on-page, structured data and internationalization.

seo commercial desktop
Vendor
Screaming Frog Ltd
Homepage
https://www.screamingfrog.co.uk/seo-spider/
Pricing
£199/year (free up to 500 URLs)

Score · v0.1

31%
overall detection rate · 94 / 303 issues found · 0 false positives · 2,809 ignored
Tested on the Free plan · version 24.1. Detection capability is often plan-gated; this score reflects the plan above.

By category

status code
84%
27 / 32
canonical
40%
6 / 15
redirect
44%
4 / 9
internationalization
9%
4 / 44
content
22%
2 / 9
description
100%
7 / 7
title
100%
8 / 8
headings
50%
3 / 6
images
0%
0 / 9
structured data
0%
0 / 2
url
36%
5 / 14
meta robots
53%
8 / 15
x robots
100%
3 / 3
security
31%
5 / 16
html validation
25%
3 / 12
social
0%
0 / 6
javascript
0%
0 / 14
crawler trap
8%
1 / 13
ai readiness
0%
0 / 13
mobile
0%
0 / 6
links
9%
1 / 11
pagination
0%
0 / 6
sitemap
0%
0 / 7
robots txt
0%
0 / 8
link discovery
39%
7 / 18

Claimed capabilities

What the vendor says this tool does, from its marketing pages — not crawlbench's measured detection above. Sourced 2026-06-09. See the full capability matrix.

Crawlability ✓
Indexability ✓
On-page ✓
Structured data ✓ Schema.org/JSON-LD validation, rich results
Internationalization ✓ hreflang audit
Performance ✓ via PageSpeed Insights / Lighthouse / CrUX integration
JS rendering ✓ headless Chromium rendering
AI readiness / GEO ◐ AI-crawler user-agents only; no GEO/citability audit
Sources

Integration ecosystem

MCP
Official · crawler control · local · 8 tools
Shipped with v24.0. Exposes crawl_site, crawl_status, list_crawls, export_crawl, read_crawl_data, delete_crawl, storage_summary, sf_check. Also supports embeddings export for semantic clustering. GUI must be closed before MCP can access the crawl database.
API
No
CI/CD integration
No
Agentic interface
No

Notes

The de-facto reference desktop crawler used by SEO consultants and in-house teams worldwide. Strong granularity, custom extraction, and JavaScript rendering. Tested on macOS using the latest GA release available at run time.