ollama/ollamaGitHub
calls sglang “GPU serving framework optimized for throughput; choose it for datacenter batch serving rather than a laptop CLI.”
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
181.3kGoactive