Use when you need multi-step browser task automation (forms/clicks) rather than one-shot page parsing.
Automate browser based workflows with AI
- 22.8k
- Python
- AGPL-3.0
LLM web scraping / structured data extraction
A TypeScript library that uses LLMs and Playwright to turn any webpage into structured data via schemas like Zod/JSON.
Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.
Use when you need multi-step browser task automation (forms/clicks) rather than one-shot page parsing.
Automate browser based workflows with AI
Choose when you want deterministic, lightweight scraping without an LLM dependency.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Choose when you need full crawl orchestration and manual parsing rather than LLM-driven extraction.
CrawleeβA web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Use when you need an agentic Python bot that can navigate and extract across multiple pages.
π Make websites accessible for AI agents. Automate tasks online with ease.
Use when you want a TypeScript browser-agent SDK with act/extract primitives.
The SDK For Browser Agents
Use when you need a TypeScript agent toolkit to browse interactively before extracting data.
Let AI agents browse the web. An autonomous toolkit for browser-based AI agents.
Does the same job, but ships as an app. Useful to a person, not swappable into a codebase.
Choose when you want a no-code visual platform instead of a code library.
π₯ The open-source no-code platform for web scraping, crawling, search and AI data extraction β’ Turn websites into structured APIs in minutes π₯
Choose when you prefer a self-hosted or managed scraping API over embedding a library.
The context API to search, scrape, and interact with the web at scale. π₯
Use when you need a quick hacker-style CLI to scrape/extract rather than integrating a library.
Swiss-army tool for scraping and extracting data from online assets, made for hackers
These projects were analysed and named llm-scraper among their alternatives. The relationship is not symmetric β how llm-scraper rates them is a separate judgement, made when llm-scraper is analysed in its own right.
calls llm-scraper βIf you only need LLM-based structured data extraction from pages, not full browser control.β
π Make websites accessible for AI agents. Automate tasks online with ease.
calls llm-scraper βTypeScript library for structuring web pages with LLMs; choose when source is a webpage and your stack is JavaScript/Node.β
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.