ScrapeGraphAI/Scrapegraph-aiGitHub
calls reader “Choose when you need open-source TypeScript web infrastructure for AI agents with clean markdown and browser sessions.”
Python scraper based on AI
29.8kPythonactive
vakra-dev/reader Alternatives
reader is queued for analysis. Crawling candidates and ranking them takes a few minutes. This page updates itself when the list exists — you can also come back later.
What is known so far comes from the other direction:
Listed as an alternative to
These projects were analysed and named reader among their alternatives. The relationship is not symmetric — how reader rates them is a separate judgement, made when reader is analysed in its own right.
gocolly/collyGitHub
calls reader “Choose when you need a TypeScript library that scrapes and cleans web content into markdown for AI agents.”
Elegant Scraper and Crawler Framework for Golang
25.5kGoactive
adbar/trafilaturaGitHub
calls reader “Use when you want a self-hosted web scraping service that returns clean markdown and browser sessions for agents.”
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
6.7kPythonactive
scrapy/scrapyGitHub
calls reader “Choose when your AI agents need a self-hosted web-access API instead of embedding a Python framework.”
Scrapy, a fast high-level web crawling & scraping framework for Python.
64.1kPythonactive
apify/crawleeGitHub
calls reader “Choose for a web service that provides scraping API; not a library.”
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
25.5kTypeScriptactive
code4craft/webmagicGitHub
calls reader “Choose it when you want a self-hosted scraping/crawling service with browser sessions.”
A scalable web crawler framework for Java.
11.7kJavaslowing
apify/crawlee-pythonGitHub
calls reader “Choose when you want a ready-to-use web scraping API/service for AI agents instead of writing crawler code.”
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
9.5kPythonactive
alirezamika/autoscraperGitHub
calls reader “Choose it if you prefer a web infrastructure/API for AI agents, not a library to embed.”
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
7.9kPythonactive