stackpicks.dev
firecrawl

firecrawl

🔥 Search, scrape, and clean the web for AI agents.

123k stars7.5k forks360 watchers76 open issuesTypeScriptAGPL-3.0

TL;DR · 30-second scan

What it is

firecrawl (TypeScript)🔥 Search, scrape, and clean the web for AI agents.

What it does for you

You're building a RAG agent, a competitive-intel tool, or any system that ingests web content as training/search data.

Best for

AI & ML

123k GitHub starsLicense: AGPL-3.0Last updated 2 hours ago
EDITOR'S DEEP TAKE

The 2026 default for LLM-grade scraping. Fires Playwright behind the scenes, returns clean markdown ready to feed into RAG. Self-host for free or use the hosted tier — both expose the same API. The sweet spot when you want a scraper that knows what a content-page looks like vs a nav-page, and skips the cruft automatically.

Use this if

You're building a RAG agent, a competitive-intel tool, or any system that ingests web content as training/search data.

Skip if

You're scraping structured APIs (JSON endpoints) — overkill. Use plain fetch + Zod.

Categories
Topics
aicrawlermarkdownscraperhtml-to-markdownllmscrapingweb-crawlerai-scrapingwebscrapingweb-scrapingweb-dataweb-data-extractionai-agentsdata-extractionai-crawlerai-searchweb-scraperweb-search
Maintainer? Embed our badge

Add this badge to your README to show your project is curated on StackPicks. Free, lightweight (180×28 SVG), and gives your visitors a one-click way to see honest take + alternatives.

Preview
Featured on StackPicks
Markdown (for GitHub README)
[![Featured on StackPicks](https://stackpicks.dev/api/badge/firecrawl-firecrawl)](https://stackpicks.dev/repo/firecrawl-firecrawl)
HTML (for blogs / docs)
<a href="https://stackpicks.dev/repo/firecrawl-firecrawl"><img src="https://stackpicks.dev/api/badge/firecrawl-firecrawl" alt="Featured on StackPicks" width="180" height="28" /></a>

Are you the maintainer of firecrawl/firecrawl? Add the badge and we'll feature your project in the next weekly newsletter (~2,000 builders).

Created 16 Apr 2024
Last push 2 hours ago
Stats refreshed 1 hour ago