AltHub

zylon-ai/private-gpt Alternatives

private AI application layer / RAG API / LLM orchestration

PrivateGPT is an open-source API layer for building private AI applications on local models, offering RAG, tools, MCP, text-to-SQL, and more, with a Claude-compatible API.

57.5kPythonApache-2.0active Β· last push 2mo agoGitHub

Same job, different approach

Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.

HKUDS/LightRAGGitHub

Choose if you want a lightweight, community-maintained Python RAG toolkit instead of a full API layer.

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

39.1k
Python
MIT
active2mo ago
microsoft/graphragGitHub

Choose if you need knowledge-graph-driven retrieval with Microsoft's approach.

A modular graph-based Retrieval-Augmented Generation (RAG) system

35.6k
Python
MIT
active2mo ago
HKUDS/RAG-AnythingGitHub

Choose if you prefer a simple-to-use Python RAG pipeline framework.

"RAG-Anything: All-in-One RAG Framework"

23.0k
Python
MIT
active2mo ago
Tencent/WeKnoraGitHub

Choose if you prefer a Go-based knowledge platform with integrated wiki and agents.

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

20.4k
Go
NOASSERTION
active2mo ago
neuml/txtaiGitHub

Choose if you need a lightweight Python library for semantic search that can also run as a service.

πŸ’‘ All-in-one AI framework for semantic search, LLM orchestration and language model workflows

12.9k
Python
Apache-2.0
active2mo ago
StarTrail-org/LEANNGitHub

Choose if you need highly optimized local RAG with minimal storage footprint.

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

12.8k
Python
MIT
active2mo ago
infiniflow/ragflowGitHub

Choose if you need a robust, feature-rich RAG server with deep document understanding and a UI.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

89.1k
Go
Apache-2.0
active2mo ago
pathwaycom/llm-appGitHub

Choose if you need ready-to-run templates with live data synchronization for RAG and AI pipelines.

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚑Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

59.0k
Jupyter Notebook
MIT
active3mo ago
deepset-ai/haystackGitHub

Choose if you want modular, explicit control over pipeline components in an orchestration framework.

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

26.3k
Python
Apache-2.0
active2mo ago
eosphoros-ai/DB-GPTGitHub

Choose if you need a data-centric AI assistant with UI and text-to-SQL capabilities.

open-source agentic AI data assistant for the next generation of AI + Data products.

19.9k
Python
MIT
active30d ago
llmware-ai/llmwareGitHub

Choose if you prefer enterprise RAG pipelines with small, specialized models.

Unified framework for building enterprise RAG pipelines with small, specialized models

14.8k
Python
Apache-2.0
active5mo ago

Older generation, or narrower

An earlier or more limited way to do the job. Still the right call when you need something small, proven, or CPU-only.

SciPhi-AI/R2RGitHub

Choose if you need a simpler REST API for retrieval only, but it lacks the broader Claude-compatible feature set.

SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

8.0k
Python
MIT
slowing11mo ago
vanna-ai/vannaGitHub

Text-to-SQL focused tool; choose if you only need SQL chat, but it is archived/stale.

πŸ€– Chat with your SQL database πŸ“Š. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval πŸ”„.

23.8k
Python
MIT
archived8mo ago
airweave-ai/airweaveGitHub

Context retrieval API; choose if you only need retrieval, not the broader API layer.

Open-source context retrieval layer for AI agents

6.6k
Python
MIT
active4mo ago

End-user tools

Does the same job, but ships as an app. Useful to a person, not swappable into a codebase.

LearningCircuit/local-deep-researchGitHub

End-user deep research tool; choose if you want a ready-made research app on local LLMs.

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

9.0k
Python
MIT
active2mo ago
zilliztech/deep-searcherGitHub

End-user deep research app; choose if you want a standalone research tool for private data.

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

8.1k
Python
Apache-2.0
slowing11mo ago
PromtEngineer/localGPTGitHub

End-user app for chatting with documents locally; an older simpler tool.

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

22.2k
Python
MIT
active2mo ago
h2oai/h2ogptGitHub

End-user private chat app with document support; archived and stale.

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

12.0k
Python
Apache-2.0
archived1.0y ago

Listed as an alternative to

These projects were analysed and named private-gpt among their alternatives. The relationship is not symmetric β€” how private-gpt rates them is a separate judgement, made when private-gpt is analysed in its own right.

pathwaycom/llm-appGitHub

calls private-gpt β€œwhen you want a simple self-hosted RAG API with local models rather than a customizable template”

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚑Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

59.0kJupyter Notebookactive
PromtEngineer/localGPTGitHub

calls private-gpt β€œChoose when you need a complete API layer with MCP, tools, and text-to-SQL support, or prefer an OpenAI-compatible inference backend.”

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

22.2kPythonactive
infiniflow/ragflowGitHub

calls private-gpt β€œChoose it when you want an API-only private RAG layer for local models rather than a full UI/agent platform.”

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

89.1kGoactive
HKUDS/LightRAGGitHub

calls private-gpt β€œChoose when you want a self-hosted API server for private RAG using local models, instead of a library.”

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

39.1kPythonactive
microsoft/graphragGitHub

calls private-gpt β€œChoose it when you want a private AI API server with RAG and local models rather than a library to integrate.”

A modular graph-based Retrieval-Augmented Generation (RAG) system

35.6kPythonactive
VectifyAI/PageIndexGitHub

calls private-gpt β€œChoose when you want a self-hosted API server for private AI with RAG, tools, and MCP, rather than embedding a document-index library in your code.”

πŸ“‘ PageIndex: Document Index for Vectorless, Reasoning-based RAG

35.3kPythonactive
HKUDS/RAG-AnythingGitHub

calls private-gpt β€œOut-of-the-box API layer for private local RAG; choose when you need a complete local RAG server.”

"RAG-Anything: All-in-One RAG Framework"

23.0kPythonactive
memvid/memvidGitHub

calls private-gpt β€œChoose when you want a self-hosted API layer for private AI apps with RAG and local models, not an embedded library.”

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

16.4kRustactive
llmware-ai/llmwareGitHub

calls private-gpt β€œChoose if you want a ready-built local RAG API server, not an embeddable framework.”

Unified framework for building enterprise RAG pipelines with small, specialized models

14.8kPythonactive
neuml/txtaiGitHub

calls private-gpt β€œChoose when you want a locally hosted API layer for private AI with RAG, OpenAI-compatible.”

πŸ’‘ All-in-one AI framework for semantic search, LLM orchestration and language model workflows

12.9kPythonactive
StarTrail-org/LEANNGitHub

calls private-gpt β€œChoose when you want a ready-to-run private AI API service with RAG endpoints, not an embeddable library.”

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

12.8kPythonactive
SciPhi-AI/R2RGitHub

calls private-gpt β€œChoose as a runnable API layer for private AI, not as a library to embed.”

SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

8.0kPythonslowing