oobabooga/textgenGitHub
calls shimmy “choose it for a single Rust binary using WebGPU, avoiding both Python and llama.cpp”
Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
47.7kPythonactive