stackpicks.dev
gocolly

colly

Elegant Scraper and Crawler Framework for Golang

25.3k stars1.9k forks316 watchers142 open issuesGoApache-2.0

TL;DR · 30-second scan

What it is

colly (Go)Elegant Scraper and Crawler Framework for Golang

What it does for you

You're in Go and need scraping with low memory + single-binary deploy.

25.3k GitHub starsLicense: Apache-2.0Last updated 5 days ago
EDITOR'S DEEP TAKE

Go's answer to Scrapy. Built-in rate limiting, caching, parallelism, and storage backends. Compiles to a single binary which makes deployment to a cheap VPS trivial. Use when you want to scrape millions of pages from a ₹500/mo box.

Use this if

You're in Go and need scraping with low memory + single-binary deploy.

Skip if

You're not in Go — Crawlee or Scrapy will have a richer ecosystem.

Topics
golangscraperframeworkcrawlerscrapingcrawlingspidergo
Maintainer? Embed our badge

Add this badge to your README to show your project is curated on StackPicks. Free, lightweight (180×28 SVG), and gives your visitors a one-click way to see honest take + alternatives.

Preview
Featured on StackPicks
Markdown (for GitHub README)
[![Featured on StackPicks](https://stackpicks.dev/api/badge/gocolly-colly)](https://stackpicks.dev/repo/gocolly-colly)
HTML (for blogs / docs)
<a href="https://stackpicks.dev/repo/gocolly-colly"><img src="https://stackpicks.dev/api/badge/gocolly-colly" alt="Featured on StackPicks" width="180" height="28" /></a>

Are you the maintainer of gocolly/colly? Add the badge and we'll feature your project in the next weekly newsletter (~2,000 builders).

Created 29 Sept 2017
Last push 5 days ago
Stats refreshed 1 hour ago