alephdata/memoriousGitHub
Choose when you want a Python-based scraping pipeline with document parsing, but it lacks Go's service-oriented architecture.
Lightweight web scraping toolkit for documents and structured data.
- 316
- Python
- MIT
active5mo ago
slotix/dataflowkit Alternatives
web scraping / crawling framework
Dataflow kit is a Go web scraping framework that downloads HTML (with optional headless Chrome rendering), parses it using CSS selectors, and encodes extracted data to CSV, Excel, JSON, XML.
Same job, different approach
Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.
firecrawl/firecrawlGitHub
Choose when you prefer a managed API service with JS rendering, but it's AGPL and heavier than a self-contained Go library.
The context API to search, scrape, and interact with the web at scale. 🔥
- 170.7k
- TypeScript
- AGPL-3.0
active2mo ago
lorien/grabGitHub
Choose when your stack is Python and you need a mature scraping framework, but it won't integrate into Go services.
Web Scraping Framework
- 2.5k
- Python
- MIT
slowing1.0y ago
gocolly/collyGitHub
Choose when you want an in-process Go scraping library instead of a multi-service pipeline, but it needs extra setup for JS rendering.
Elegant Scraper and Crawler Framework for Golang
- 25.5k
- Go
- Apache-2.0
active2mo ago
elixir-crawly/crawlyGitHub
Choose when your stack is Elixir and you need a crawling framework, but it's not Go and less actively maintained.
Crawly, a high-level web crawling & scraping framework for Elixir.
- 1.1k
- Elixir
- Apache-2.0
slowing1.2y ago
crwlrsoft/crawlerGitHub
Choose when working in PHP and need a crawler/scraper library, but it's not Go and has a smaller ecosystem.
Library for Rapid (Web) Crawler and Scraper Development
- 371
- PHP
- MIT
active5mo ago
Older generation, or narrower
An earlier or more limited way to do the job. Still the right call when you need something small, proven, or CPU-only.
psf/requests-htmlGitHub
Choose for simple Python HTML parsing and scraping, but it lacks headless rendering and a full pipeline.
Pythonic HTML Parsing for Humans™
- 13.8k
- Python
- MIT
dormant2.5y ago
Listed as an alternative to
These projects were analysed and named dataflowkit among their alternatives. The relationship is not symmetric — how dataflowkit rates them is a separate judgement, made when dataflowkit is analysed in its own right.
go-rod/rodGitHub
calls dataflowkit “Choose it over Rod only if you need a legacy Go structured-data scraping framework and can accept a 3-year-old unmaintained dependency.”
A Chrome DevTools Protocol driver for web automation and scraping.
7.1kGoactive