Crawler.sh

Crawler.sh

Free Local AEO & SEO Spider and a Markdown content extractor

445 followers

A fast, local-first web crawler and AEO & SEO analysis tool. Crawl entire sites in seconds from the terminal or a native desktop app, run automated SEO checks, extract content as clean Markdown, and export to JSON, CSV, or Sitemap XML.

Crawler.sh awards

1

Launches

Crawler.sh

1

Awards

daily #2

Launch Awards

March 2nd, 2026

Crawler.sh

Launch of the Day

March 2nd, 2026