ScrapeGraphAI/Scrapegraph-aiGitHub
calls crw “Choose when you need a fast, self-hosted, Firecrawl-compatible API in Rust for scraping and search.”
Python scraper based on AI
29.8kPythonactive
us/crw Alternatives
crw is queued for analysis. Crawling candidates and ranking them takes a few minutes. This page updates itself when the list exists — you can also come back later.
What is known so far comes from the other direction:
Listed as an alternative to
These projects were analysed and named crw among their alternatives. The relationship is not symmetric — how crw rates them is a separate judgement, made when crw is analysed in its own right.
adbar/trafilaturaGitHub
calls crw “Use when you want a lightweight Rust self-hosted scrape/crawl/search API with MCP support rather than a Python/CLI toolkit.”
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
6.7kPythonactive
scrapy/scrapyGitHub
calls crw “Choose when you want a self-hosted Firecrawl-compatible API in Rust instead of a Python scraper.”
Scrapy, a fast high-level web crawling & scraping framework for Python.
64.1kPythonactive
gocolly/collyGitHub
calls crw “Choose when you want a self-hosted, Firecrawl-compatible API in Rust for AI agents.”
Elegant Scraper and Crawler Framework for Golang
25.5kGoactive
apify/crawleeGitHub
calls crw “Choose for a self-hosted Firecrawl-compatible API; not a library.”
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
25.5kTypeScriptactive
code4craft/webmagicGitHub
calls crw “Choose it when you want a self-hosted Firecrawl-compatible scraping/crawling API.”
A scalable web crawler framework for Java.
11.7kJavaslowing
apify/crawlee-pythonGitHub
calls crw “Choose when you need a lightweight self-hosted Firecrawl-compatible API server in Rust.”
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
9.5kPythonactive
alirezamika/autoscraperGitHub
calls crw “Choose it for a self-hosted Firecrawl-compatible scraping/search API in Rust, not a library.”
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
7.9kPythonactive