AltHub

ScrapeGraphAI/Scrapegraph-ai Alternatives

LLM-powered web scraping

Python library that uses LLMs and graph logic to create scraping pipelines for extracting structured data from websites and documents based on natural language instructions.

29.8kPythonMITactive ยท last push 2mo agoGitHub

Drop-in peers

Same problem, same approach. Swapping one for another is a config change, not a rewrite.

raznem/parseraGitHub

Choose when you want a minimal, lightweight LLM scraper in Python without graph pipelines or integrations.

Lightweight library for scraping web-sites with LLMs

1.4k
Python
GPL-2.0
slowing10mo ago

Same job, different approach

Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.

gocolly/collyGitHub

Choose when you want a fast, dependency-free Go crawler with explicit control, no LLM costs.

Elegant Scraper and Crawler Framework for Golang

25.5k
Go
Apache-2.0
active2mo ago
any4ai/AnyCrawlGitHub

Choose when you need a TypeScript-native LLM scraper with built-in SERP extraction and multi-threading.

AnyCrawl ๐Ÿš€: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

3.4k
TypeScript
MIT
active2mo ago
jae-jae/QueryListGitHub

Choose when you're working in PHP and need a simple, traditional crawler without AI.

:spider: The progressive PHP crawler framework! ไผ˜้›…็š„ๆธ่ฟ›ๅผPHP้‡‡้›†ๆก†ๆžถใ€‚

2.7k
PHP
none
active3mo ago
spider-rs/spiderGitHub

Choose when you need a high-performance Rust crawler to produce clean data for LLMs without runtime LLM calls.

Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust

2.7k
Rust
MIT
active2mo ago
D4Vinci/ScraplingGitHub

Choose when you need an adaptive Python scraper with strong anti-bot and full-scale crawling, no LLM graph setup.

๐Ÿ•ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

76.7k
Python
BSD-3-Clause
active2mo ago
apify/crawleeGitHub

Choose when you want a battle-tested Node.js scraping library with browser automation and high extensibility.

Crawleeโ€”A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

25.5k
TypeScript
Apache-2.0
active2mo ago
code4craft/webmagicGitHub

Choose when you need a stable Java crawler with lifecycle management and a large community.

A scalable web crawler framework for Java.

11.7k
Java
Apache-2.0
slowing10mo ago
apify/crawlee-pythonGitHub

Choose when you want a feature-rich Python scraper with async support and browser automation, no LLM graph.

Crawleeโ€”A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

9.5k
Python
Apache-2.0
active2mo ago
alirezamika/autoscraperGitHub

Choose when you want to learn CSS selectors from examples automatically, avoiding LLM dependencies.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

7.9k
Python
MIT
active3mo ago
firecrawl/firecrawlGitHub

Choose when you prefer a scalable hosted/self-hosted API service for AI extraction rather than embedding a Python library.

The context API to search, scrape, and interact with the web at scale. ๐Ÿ”ฅ

170.7k
TypeScript
AGPL-3.0
active2mo ago
scrapy/scrapyGitHub

Choose when you want a mature, high-performance Python scraping framework with rich middleware support, no LLM.

Scrapy, a fast high-level web crawling & scraping framework for Python.

64.1k
Python
BSD-3-Clause
active2mo ago
adbar/trafilaturaGitHub

Choose when you need lightweight text and metadata extraction to build clean datasets, no LLM or crawling pipelines.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

6.7k
Python
Apache-2.0
active2mo ago
oxylabs/oxylabs-ai-studio-pyGitHub

Choose when you want Oxylabs' managed AI scraping service with a simple Python SDK and no infrastructure.

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

3.4k
Python
MIT
active2mo ago
oxylabs/ai-crawler-pyGitHub

Choose when you need Oxylabs' AI-guided crawling and extraction via Python SDK for managed scaling.

Crawl a website starting from a URL, find relevant pages, and extract data โ€“ all guided by your natural language prompt.

3.2k
none
active2mo ago
Anakin-Inc/anakinGitHub

Choose when you want a self-hosted Go API to convert websites to markdown/JSON with anti-detect and proxies.

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

2.3k
Go
AGPL-3.0
active2mo ago
0xMassi/webclawGitHub

Choose when you prefer a Rust-first scraper with CLI/API/MCP and no Python dependency.

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data โ€” all from Rust. CLI, REST API, and MCP server.

2.3k
Rust
AGPL-3.0
active2mo ago
BrowserCash/teracrawlGitHub

Choose when you want a managed API that uses remote browsers to output clean Markdown for LLMs.

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

280
TypeScript
MIT
slowing11mo ago
vakra-dev/readerGitHub

Choose when you need open-source TypeScript web infrastructure for AI agents with clean markdown and browser sessions.

Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents.

558
TypeScript
Apache-2.0
active2mo ago
us/crwGitHub

Choose when you need a fast, self-hosted, Firecrawl-compatible API in Rust for scraping and search.

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

851
Rust
AGPL-3.0
active2mo ago
oxylabs/ai-scraper-pyGitHub

Choose when you want Oxylabs' AI scraper via Python SDK for managed extraction at scale.

AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with unmatched precision. Ideal for scalable AI scraping tasks across diverse web sources, this tool simplifies complex scraping operations into efficient, intelligent workflows.

1.1k
none
active7mo ago

End-user tools

Does the same job, but ships as an app. Useful to a person, not swappable into a codebase.

brightdata/brightdata-mcpGitHub

Choose when you're building MCP-based AI agents and want Bright Data's managed web access, not a local library.

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

2.6k
JavaScript
MIT
active2mo ago
alex-on-ai/WebReaperGitHub

Choose when you want a standalone binary AI scraper with a bundled Claude Code skill, not a library.

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

148
C#
MIT
active3mo ago
umbrellaDocumentation/Web-Data-ScraperGitHub

Choose when you need a no-code visual scraper that exports to sheets and similar, not an embeddable library.

Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets, and Webhook.

133
JavaScript
none
slowing7mo ago

Listed as an alternative to

These projects were analysed and named Scrapegraph-ai among their alternatives. The relationship is not symmetric โ€” how Scrapegraph-ai rates them is a separate judgement, made when Scrapegraph-ai is analysed in its own right.

firecrawl/firecrawlGitHub

calls Scrapegraph-ai โ€œChoose when you need Python-native LLM-guided extraction that can use local models, avoiding a hosted API.โ€

The context API to search, scrape, and interact with the web at scale. ๐Ÿ”ฅ

170.7kTypeScriptactive
D4Vinci/ScraplingGitHub

calls Scrapegraph-ai โ€œChoose when you want LLM-based extraction instead of writing selectors and stealth logic.โ€

๐Ÿ•ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

76.7kPythonactive
scrapy/scrapyGitHub

calls Scrapegraph-ai โ€œChoose when you prefer AI-driven extraction from messy pages over hand-written selectors.โ€

Scrapy, a fast high-level web crawling & scraping framework for Python.

64.1kPythonactive
gocolly/collyGitHub

calls Scrapegraph-ai โ€œChoose when you want AI/LLM-based extraction instead of hand-coded CSS/XPath rules.โ€

Elegant Scraper and Crawler Framework for Golang

25.5kGoactive
apify/crawleeGitHub

calls Scrapegraph-ai โ€œChoose for AI-driven extraction in Python; uses LLM prompts instead of manual selectors.โ€

Crawleeโ€”A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

25.5kTypeScriptactive
getmaxun/maxunGitHub

calls Scrapegraph-ai โ€œChoose when you want AI/LLM-driven extraction in Python as a library, not a no-code UI.โ€

๐Ÿ”ฅ The open-source no-code platform for web scraping, crawling, search and AI data extraction โ€ข Turn websites into structured APIs in minutes ๐Ÿ”ฅ

17.3kTypeScriptactive
code4craft/webmagicGitHub

calls Scrapegraph-ai โ€œChoose it when you want LLM-guided scraping in Python instead of a classic rule-based crawler.โ€

A scalable web crawler framework for Java.

11.7kJavaslowing
apify/crawlee-pythonGitHub

calls Scrapegraph-ai โ€œChoose when you want LLM-powered natural-language extraction rather than hand-coded selectors.โ€

Crawleeโ€”A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

9.5kPythonactive
alirezamika/autoscraperGitHub

calls Scrapegraph-ai โ€œChoose it for natural-language extraction with LLMs, accepting extra dependencies and cost over rule learning.โ€

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

7.9kPythonactive
adbar/trafilaturaGitHub

calls Scrapegraph-ai โ€œUse when you want LLM-driven extraction to arbitrary structured schemas and can tolerate heavier inference cost.โ€

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

6.7kPythonactive
brightdata/cliGitHub

calls Scrapegraph-ai โ€œwhen you want an open-source Python AI scraping library instead of a managed CLI/APIโ€

Official Bright Data CLI - scrape, search, and extract structured web data directly from your terminal.

6.4kTypeScriptactive