Preview mode — 111 repos, zero database

The open-source stack,
curated by builders.

Tell us what you're building or what you need. We'll surface the right repo, with an honest take on whether to use it.

try

Paste any owner/repo to preview live · github.com/... URLs work too

Filtered byScraping & Crawlingclear

Scraping & Crawling

8 repos

mendableai

firecrawl

The 2026 default for LLM-grade scraping. Fires Playwright behind the scenes, returns clean markdown ready to feed into RAG. Self-host for free or use the hosted tier — both expose the same API. The sw…

Scraping & CrawlingAI & ML

You're building a RAG agent, a competitive-intel tool, or any system that ingests web content as training/search data.

You're scraping structured APIs (JSON endpoints) — overkill. Use plain fetch + Zod.

mendableai/firecrawlView

unclecode

crawl4ai

Python-native LLM-friendly crawler. Strong at extracting structured data (JSON schemas) from messy HTML using an embedded LLM. Heavier setup than Firecrawl but more control over extraction prompts. Be…

Scraping & CrawlingAI & ML

You're in Python, want self-hosted, and need extraction with an exact JSON schema.

You don't need LLM-driven extraction — Scrapy or Crawlee will be cheaper and faster.

unclecode/crawl4aiView

6 more curated repos · members only

Unlock the full directory.

Free preview shows a small sample. Pay once — lifetime access to every curator take, every bundle, every weekly deep-dive. No renewals.

See pricing

Don't see what you need?

We'll add it in 60 minutes.

Tell us what tool or use case is missing. We'll research the best repo for it, write an honest take, add it to the directory, and email you the link. No paywall, no signup required.

The open-source stack,curated by builders.

Scraping & Crawling

Unlock the full directory.

We'll add it in 60 minutes.

The open-source stack,
curated by builders.