Launched this week
Crawler.sh

Crawler.sh

Free Local AEO & SEO Spider and a Markdown content extractor

445 followers

A fast, local-first web crawler and AEO & SEO analysis tool. Crawl entire sites in seconds from the terminal or a native desktop app, run automated SEO checks, extract content as clean Markdown, and export to JSON, CSV, or Sitemap XML.