AltHub

ferro-labs/ai-gateway Alternatives

LLM gateway / AI proxy

A Go-native, OpenAI-compatible LLM gateway that routes requests across 30+ providers with caching, guardrails, A/B testing and cost controls.

256GoApache-2.0active · last push 26d agoGitHub

Drop-in peers

Same problem, same approach. Swapping one for another is a config change, not a rewrite.

ENTERPILOT/GoModelGitHub

Choose it when you want the same Go single-binary gateway but with Anthropic-native API compatibility and MIT licensing.

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

1.2k
Go
MIT
active25d ago
maximhq/bifrostGitHub

Choose it when you need cluster mode and tighter per-request overhead at high RPS with the same Go single-binary model.

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

8.2k
Go
Apache-2.0
active24d ago

Same job, different approach

Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.

experientiallabs/experientialGitHub

Choose it when you want BYOK marketplace routing plus traffic-learned model/cost recommendations, accepting a Python service.

Experiential is the open source, zero markup gateway for BYOK, self-hosted and 1000+ marketplace models. It learns from your traffic to cut costs, recommend better models, and train a specialized model you own.

5.3k
Python
Apache-2.0
active24d ago
theopenco/llmgatewayGitHub

Choose it when you want a TypeScript gateway with bundled usage analytics and admin UI instead of a single Go binary.

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

1.6k
TypeScript
NOASSERTION
active25d ago
mozilla-ai/otariGitHub

Choose it when self-service virtual keys and per-key budgets are the priority and a Python runtime is acceptable.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

479
Python
Apache-2.0
active25d ago
LianjiaTech/bella-openapiGitHub

Choose it when you also need embeddings, ASR/TTS and image endpoints with billing and rate limiting on the JVM.

Bella OpenAPI是一个提供了丰富的AI调用能力的API网关,可类比openrouter,与之不同的是除了提供聊天补全(chat-completion)能力外,还提供了文本向量化(text-embedding)、语音识别(ASR)、语音合成(TTS)、文生图、图生图等多种AI能力,同时集成了计费、限流和资源管理功能。且集成的所有能力都经过了大规模生产环境的验证。

238
Java
MIT
active3mo ago
BerriAI/litellmGitHub

Choose it when you need the broadest provider/SDK ecosystem and Python extensibility, accepting a heavier Python deployment.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

60.1k
Python
NOASSERTION
active10d ago
Portkey-AI/gatewayGitHub

Choose it when you want 50+ built-in guardrails and a TypeScript/Node deployment rather than a Go binary.

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

13.0k
TypeScript
MIT
active5mo ago

Listed as an alternative to

These projects were analysed and named ai-gateway among their alternatives. The relationship is not symmetric — how ai-gateway rates them is a separate judgement, made when ai-gateway is analysed in its own right.

BerriAI/litellmGitHub

calls ai-gateway “when you want a Go-native gateway with caching, guardrails, and A/B tests instead of a Python stack”

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

60.1kPythonactive
maximhq/bifrostGitHub

calls ai-gateway “a direct Go/Apache-2.0 swap when you want in-process caching, guardrails and A/B routing without Bifrost's MCP and cluster scope.”

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

8.2kGoactive
BlockRunAI/ClawRouterGitHub

calls ai-gateway “Pick it for a Go gateway with caching, guardrails and A/B tests at smaller scale than LiteLLM.”

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

6.6kTypeScriptactive
decolua/9routerGitHub

calls ai-gateway “Use it when you want a Go-native enterprise gateway with caching, guardrails and A/B testing rather than a free coding-agent router.”

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

29.4kJavaScriptactive