calls crawly “Choose for Elixir projects that want a high-level crawler framework.”
Scrapy, a fast high-level web crawling & scraping framework for Python.
crawly is queued for analysis. Crawling candidates and ranking them takes a few minutes. This page updates itself when the list exists — you can also come back later.
What is known so far comes from the other direction:
These projects were analysed and named crawly among their alternatives. The relationship is not symmetric — how crawly rates them is a separate judgement, made when crawly is analysed in its own right.
calls crawly “Choose for Elixir projects that want a high-level crawler framework.”
Scrapy, a fast high-level web crawling & scraping framework for Python.
calls crawly “Choose when you are in the Elixir ecosystem and want a high-level crawling framework.”
Elegant Scraper and Crawler Framework for Golang
calls crawly “Choose for Elixir projects; comparable high-level crawling framework.”
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
calls crawly “Choose it when you want a crawler framework for the Elixir/BEAM ecosystem.”
A scalable web crawler framework for Java.
calls crawly “Choose for an Elixir-based crawling framework using actor-model concurrency.”
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
calls crawly “Choose it when building scrapers in Elixir with a high-level framework, not Python auto-learning.”
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
calls crawly “Use when you are in Elixir/Erlang and want a BEAM-native high-level crawling/scraping framework.”
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
calls crawly “Choose when your stack is Elixir and you need a crawling framework, but it's not Go and less actively maintained.”
Extract structured data from web sites. Web sites scraping.