AltHub

langfuse/langfuse Alternatives

LLM observability / evaluation / LLMOps

Langfuse is an open-source, self-hostable LLM engineering platform for observability (tracing), evals, metrics, prompt management, playground, and datasets.

33.6kTypeScriptNOASSERTIONactive ยท last push 1mo agoGitHub

Drop-in peers

Same problem, same approach. Swapping one for another is a config change, not a rewrite.

lmnr-ai/lmnrGitHub

Choose when you want an agent-centric tracing and evals platform with a modern open-source backend.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

3.3k
TypeScript
Apache-2.0
active18d ago
openlit/openlitGitHub

Choose when you want OpenTelemetry-native observability plus GPU monitoring and guardrails in one platform.

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. ๐Ÿš€๐Ÿ’ป Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

2.7k
TypeScript
Apache-2.0
active1mo ago
Helicone/heliconeGitHub

Choose when you want one-line-code LLM observability with a self-hostable dashboard and eval features.

๐ŸงŠ Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ๐Ÿ“

6.1k
TypeScript
Apache-2.0
active1mo ago
comet-ml/opikGitHub

Choose when you want a Python-first LLM observability and evaluation platform with a self-hosted dashboard.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

21.8k
Python
Apache-2.0
active1mo ago
Arize-ai/phoenixGitHub

Choose when you want notebook-centric LLM tracing and evaluation in an open-source Python tool.

AI Observability & Evaluation

11.2k
Python
NOASSERTION
active1mo ago
coze-dev/coze-loopGitHub

Choose when you want an agent optimization platform that tightly couples debugging, evaluation, and iteration.

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

5.7k
Go
Apache-2.0
active19d ago
pezzolabs/pezzoGitHub

Choose when prompt management/versioning is your primary pain point and you want attached observability.

๐Ÿ•น๏ธ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

3.3k
TypeScript
Apache-2.0
active2mo ago
langwatch/langwatchGitHub

Choose when your focus is LLM evaluations and agent testing with a dedicated eval UI.

The platform for LLM evaluations and AI agent testing

4.8k
TypeScript
Apache-2.0
active17d ago

Same job, different approach

Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.

tensorzero/tensorzeroGitHub

Choose when you want an LLM gateway that optimizes prompts from production traces instead of a passive observability platform.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

11.7k
Rust
Apache-2.0
archived4mo ago
mlflow/mlflowGitHub

Choose when your team already uses MLflow and wants LLM tracing/evals inside a broader ML lifecycle platform.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

27.6k
Python
Apache-2.0
active1mo ago
SigNoz/signozGitHub

Choose when you want one OpenTelemetry-native APM for infrastructure and LLM traces and can skip LLM-specific eval features.

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

32.0k
TypeScript
NOASSERTION
active1mo ago

Older generation, or narrower

An earlier or more limited way to do the job. Still the right call when you need something small, proven, or CPU-only.

JudgmentLabs/judgevalGitHub

Choose when you only need an agent evaluation/monitoring engine and can wire it into your own stack.

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

1.1k
Python
Apache-2.0
active21d ago

Listed as an alternative to

These projects were analysed and named langfuse among their alternatives. The relationship is not symmetric โ€” how langfuse rates them is a separate judgement, made when langfuse is analysed in its own right.

mlflow/mlflowGitHub

calls langfuse โ€œChoose Langfuse when you need dedicated LLM/agent tracing, evals, and prompt management, and can forgo MLflow's classic ML experiment tracking and registry.โ€

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

27.6kPythonactive
comet-ml/opikGitHub

calls langfuse โ€œChoose for a TypeScript/Python LLM observability and eval platform with self-hosting and broad framework integrations.โ€

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

21.8kPythonactive
Arize-ai/phoenixGitHub

calls langfuse โ€œChoose for a mature LLM observability/eval platform with prompt management and a large integration ecosystem.โ€

AI Observability & Evaluation

11.2kPythonactive
traceloop/openllmetryGitHub

calls langfuse โ€œUse Langfuse when you want a ready-made LLM observability/eval UI and prompt management instead of a low-level OTel library.โ€

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

7.4kPythonactive