Firecrawl is the easiest way to extract data from the web. Developers use us to reliably convert URLs into LLM-ready markdown or structured data with a single API call.
This is the 6th launch from Firecrawl. View more
Firecrawl CLI
Launching today
Firecrawl CLI is an all-in-one toolkit for scraping, searching, and browsing the web. Built for AI agents and developers, it delivers clean, reliable data with maximum token efficiency - outperforming native Claude Code fetch with >80% coverage.
Free Options
Launch Team
Firecrawl
Hey Product Hunt! 👋 Eric here.
We launched Firecrawl CLI, your agent’s complete web data toolkit.
Every developer building with agents eventually hits the same wall, reliable web data access.
Most tools break on JavaScript-heavy sites or dump entire pages into context, wasting tokens and slowing down reasoning.
Firecrawl CLI fixes that.
It gives agents a unified interface to:
- scrape pages into clean Markdown or JSON
- search and return complete results in one step
- browse interactive or gated pages through a cloud browser
- crawl and map entire sites for structured coverage
Firecrawl CLI uses a file-based approach for context management, so results are written to the filesystem and agents can use bash methods for efficient search and retrieval.
To install it, just run:
$ npx -y -cli@latest init --all --browser
Once installed, your agent knows how to get live web data whenever it needs it.
Real use cases:
- Enrich AI agents and knowledge bases with live, structured web data for more accurate reasoning and responses
- Power deep research workflows by collecting verifiable sources, documentation, and papers across the web
- Automate data and market intelligence gathering - tracking competitors, product updates, and industry trends in real time
- Capture information from dynamic or login-gated sites to access data hidden behind dashboards, forms, and authenticated workflows.
Works with all popular harnesses like Claude Code, Codex, and OpenCode.
You can try it now: https://docs.firecrawl.dev/sdks/cli
We’d love to hear what you build with it!
the file-based approach for context management is such a smart design choice. been building agents that need web data and the biggest headache is always getting clean output without burning tokens on garbage html. curious how the cloud browser handles sites with heavy client-side rendering tho, like SPAs built on next.js or similar?
Firecrawl
@mihir_kanzariya Thank you! It handles heavy client side sites very well - that is the exact reason we built it to complement and extend scrape :)
Firecrawl
@bengeekly We do!!
AutonomyAI
Awesome project! shared with our dev team :)
Firecrawl
@lev_kerzhner Sweet - ty!!
Copus
Having reliable web data extraction is one of those unglamorous but absolutely critical pieces for AI agents. The fact that most tools break on JS-heavy sites or waste tokens on full page dumps is a real pain point. A CLI that handles scraping, searching, and browsing in one place with clean output is exactly what the agent ecosystem needs. Nice work on the 6th launch!
Firecrawl
@handuo Thank you and I would agree 100%