firecrawl/firecrawlGitHub
calls QueryList “Choose when you need a PHP scraping/crawling framework to embed in existing PHP applications.”
The context API to search, scrape, and interact with the web at scale. 🔥
170.7kTypeScriptactive
jae-jae/QueryList Alternatives
QueryList is queued for analysis. Crawling candidates and ranking them takes a few minutes. This page updates itself when the list exists — you can also come back later.
What is known so far comes from the other direction:
Listed as an alternative to
These projects were analysed and named QueryList among their alternatives. The relationship is not symmetric — how QueryList rates them is a separate judgement, made when QueryList is analysed in its own right.
D4Vinci/ScraplingGitHub
calls QueryList “Choose when your project is in PHP and you need a progressive scraping framework.”
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
76.7kPythonactive
scrapy/scrapyGitHub
calls QueryList “Choose for PHP projects needing a lightweight crawler framework.”
Scrapy, a fast high-level web crawling & scraping framework for Python.
64.1kPythonactive
ScrapeGraphAI/Scrapegraph-aiGitHub
calls QueryList “Choose when you're working in PHP and need a simple, traditional crawler without AI.”
Python scraper based on AI
29.8kPythonactive
gocolly/collyGitHub
calls QueryList “Choose when you need a PHP-based crawler framework rather than integrating Go into a PHP backend.”
Elegant Scraper and Crawler Framework for Golang
25.5kGoactive
apify/crawleeGitHub
calls QueryList “Choose for PHP projects needing a simple crawler framework.”
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
25.5kTypeScriptactive
getmaxun/maxunGitHub
calls QueryList “Choose when building scrapers in PHP and want a lightweight framework rather than a no-code UI.”
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
17.3kTypeScriptactive
code4craft/webmagicGitHub
calls QueryList “Choose it when you want a PHP crawler framework with a simpler, progressive API.”
A scalable web crawler framework for Java.
11.7kJavaslowing
apify/crawlee-pythonGitHub
calls QueryList “Choose for a PHP crawler framework when your stack is PHP.”
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
9.5kPythonactive
alirezamika/autoscraperGitHub
calls QueryList “Choose it for a PHP framework with classic rule-based scraping instead of Python auto-learning.”
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
7.9kPythonactive
adbar/trafilaturaGitHub
calls QueryList “Use when you need a PHP scraper framework with jQuery-style DOM traversal.”
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
6.7kPythonactive