stackpicks.dev
Preview mode — 177 repos, zero database

The open-source stack,
curated by builders.

Tell us what you're building or what you need. We'll surface the right repo, with an honest take on whether to use it.

try

Paste any owner/repo for a live preview · github.com/... URLs work · press / or Ctrl+K to focus

Filtered byScraping & Crawlingclear

Scraping & Crawling

7 repos
byfirecrawl
firecrawl

The 2026 default for LLM-grade scraping. Fires Playwright behind the scenes, returns clean markdown ready to feed into RAG. Self-host for free or use the hosted tier — both expose the same API. The sw…

Scraping & CrawlingAI & ML
You're building a RAG agent, a competitive-intel tool, or any system that ingests web content as training/search data.
You're scraping structured APIs (JSON endpoints) — overkill. Use plain fetch + Zod.
firecrawl/firecrawlView
byunclecode
crawl4ai

Python-native LLM-friendly crawler. Strong at extracting structured data (JSON schemas) from messy HTML using an embedded LLM. Heavier setup than Firecrawl but more control over extraction prompts. Be…

Scraping & CrawlingAI & ML
You're in Python, want self-hosted, and need extraction with an exact JSON schema.
You don't need LLM-driven extraction — Scrapy or Crawlee will be cheaper and faster.
unclecode/crawl4aiView
5 more curated repos · members only

Unlock the full directory.

Free preview shows a small sample. Pay once — lifetime access to every curator take, every bundle, every weekly deep-dive. No renewals.

See pricing
Don't see what you need?

We'll add it in 60 minutes.

Tell us what tool or use case is missing. We'll research the best repo for it, write an honest take, add it to the directory, and email you the link. No paywall, no signup required.

We respond in under 60 minutes during business hours (10:00–18:00 IST).

Preview — the curated 104 — StackPicks