AltHub

openai/whisper Alternatives

speech recognition / ASR

OpenAI Whisper is a robust general-purpose speech recognition model trained on large-scale weak supervision, supporting multilingual transcription and speech translation.

107.8kPythonMITactive · last push 3mo agoGitHub

Same job, different approach

Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.

speechbrain/speechbrainGitHub

Choose when you need a flexible research toolkit to train or fine-tune custom ASR models rather than use a fixed pretrained Whisper.

A PyTorch-based Speech Toolkit

11.8k
Python
Apache-2.0
active4mo ago
PaddlePaddle/PaddleSpeechGitHub

Choose when you need a full speech toolkit with streaming and Chinese-first ASR pipelines.

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

12.7k
Python
Apache-2.0
active2mo ago
QwenAudio/SenseVoiceGitHub

Choose when you need a lightweight multilingual ASR model with lower latency for supported languages and do not require Whisper's translation capability.

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

9.2k
C
MIT
active1mo ago
modelscope/FunASRGitHub

Choose when you need a production ASR toolkit with streaming, VAD, punctuation, and OpenAI-compatible/MCP serving.

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

20.0k
Python
MIT
active2mo ago
wenet-e2e/wenetGitHub

Choose when you need a production-first streaming ASR toolkit with ONNX/TensorRT deployment.

Production First and Production Ready End-to-End Speech Recognition Toolkit

5.2k
Python
Apache-2.0
active4mo ago
espnet/espnetGitHub

Choose for a research-oriented end-to-end speech processing toolkit with many ASR recipes and model architectures.

End-to-End Speech Processing Toolkit

9.9k
Python
Apache-2.0
active2mo ago
moonshine-ai/moonshineGitHub

Choose when you need very low-latency streaming STT for voice agents, despite narrower language support than Whisper.

Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces

10.9k
C++
NOASSERTION
active2mo ago
NVIDIA-NeMo/SpeechGitHub

Choose when you need a scalable framework for training and deploying custom ASR/TTS models at scale.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

18.3k
Python
Apache-2.0
active2mo ago

Older generation, or narrower

An earlier or more limited way to do the job. Still the right call when you need something small, proven, or CPU-only.

pannous/tensorflow-speech-recognitionGitHub

An older TensorFlow seq2seq ASR implementation; only useful for legacy codebases or historical reference.

🎙Speech recognition using the tensorflow deep learning framework, sequence-to-sequence neural networks

2.2k
Python
NOASSERTION
dormant2.7y ago
athena-team/athenaGitHub

An older sequence-to-sequence speech toolkit that is largely unmaintained; only for legacy dependency.

an open-source implementation of sequence-to-sequence based speech processing engine

967
C++
Apache-2.0
dormant3.9y ago
zzw922cn/Automatic_Speech_RecognitionGitHub

An outdated TensorFlow end-to-end ASR demo for English/Mandarin, stale and limited.

End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow

2.8k
Python
MIT
dormant3.6y ago

End-user tools

Does the same job, but ships as an app. Useful to a person, not swappable into a codebase.

jianchang512/sttGitHub

A desktop/offline subtitle-generation tool that wraps ASR models, not an embeddable library.

Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具,输出json、srt字幕、纯文字格式

4.8k
Python
GPL-3.0
slowing9mo ago
buxuku/SmartSubGitHub

A desktop app for subtitle generation, translation, dubbing, and burning; built on Whisper/FunASR, not embeddable.

视频转字幕、字幕翻译、AI 配音与声音克隆、字幕烧录——免费开源的一站式桌面工具。基于 Whisper / FunASR 等本地模型离线语音转文字,批量处理 + 全平台 GPU 加速,跨 Windows / macOS / Linux。Free, open-source desktop app to generate, translate, dub & burn video subtitles — local Whisper speech-to-text, AI dubbing & voice cloning, offline, GPU-accelerated.

4.7k
TypeScript
MIT
active2mo ago

Listed as an alternative to

These projects were analysed and named whisper among their alternatives. The relationship is not symmetric — how whisper rates them is a separate judgement, made when whisper is analysed in its own right.

QwenAudio/SenseVoiceGitHub

calls whisper “a widely used multilingual ASR model; choose for larger language coverage and community, trading away emotion/event tags.”

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

9.2kCactive
Const-me/WhisperGitHub

calls whisper “Reference Python implementation of the same Whisper model; choose it for canonical Python code or model training, not for C++ GPGPU speed.”

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

10.6kC++active
facebookresearch/seamless_communicationGitHub

calls whisper “ASR model that translates speech into English text, if you only need text output and lighter deployment.”

Foundational Models for State-of-the-Art Speech and Text Translation

11.8kJupyter Notebookactive