Choose when you need a flexible research toolkit to train or fine-tune custom ASR models rather than use a fixed pretrained Whisper.
A PyTorch-based Speech Toolkit
- 11.8k
- Python
- Apache-2.0
speech recognition / ASR
OpenAI Whisper is a robust general-purpose speech recognition model trained on large-scale weak supervision, supporting multilingual transcription and speech translation.
Solves the same problem with a different architecture or at a different layer. Expect to rewrite the integration.
Choose when you need a flexible research toolkit to train or fine-tune custom ASR models rather than use a fixed pretrained Whisper.
A PyTorch-based Speech Toolkit
Choose when you need a full speech toolkit with streaming and Chinese-first ASR pipelines.
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
Choose when you need a lightweight multilingual ASR model with lower latency for supported languages and do not require Whisper's translation capability.
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
Choose when you need a production ASR toolkit with streaming, VAD, punctuation, and OpenAI-compatible/MCP serving.
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Choose when you need a production-first streaming ASR toolkit with ONNX/TensorRT deployment.
Production First and Production Ready End-to-End Speech Recognition Toolkit
Choose for a research-oriented end-to-end speech processing toolkit with many ASR recipes and model architectures.
End-to-End Speech Processing Toolkit
Choose when you need very low-latency streaming STT for voice agents, despite narrower language support than Whisper.
Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces
Choose when you need a scalable framework for training and deploying custom ASR/TTS models at scale.
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
An earlier or more limited way to do the job. Still the right call when you need something small, proven, or CPU-only.
An older TensorFlow seq2seq ASR implementation; only useful for legacy codebases or historical reference.
🎙Speech recognition using the tensorflow deep learning framework, sequence-to-sequence neural networks
An older sequence-to-sequence speech toolkit that is largely unmaintained; only for legacy dependency.
an open-source implementation of sequence-to-sequence based speech processing engine
An outdated TensorFlow end-to-end ASR demo for English/Mandarin, stale and limited.
End-to-end Automatic Speech Recognition for Madarian and English in Tensorflow
Does the same job, but ships as an app. Useful to a person, not swappable into a codebase.
A desktop/offline subtitle-generation tool that wraps ASR models, not an embeddable library.
Voice Recognition to Text Tool / 一个离线运行的本地音视频转字幕工具,输出json、srt字幕、纯文字格式
A desktop app for subtitle generation, translation, dubbing, and burning; built on Whisper/FunASR, not embeddable.
视频转字幕、字幕翻译、AI 配音与声音克隆、字幕烧录——免费开源的一站式桌面工具。基于 Whisper / FunASR 等本地模型离线语音转文字,批量处理 + 全平台 GPU 加速,跨 Windows / macOS / Linux。Free, open-source desktop app to generate, translate, dub & burn video subtitles — local Whisper speech-to-text, AI dubbing & voice cloning, offline, GPU-accelerated.
These projects were analysed and named whisper among their alternatives. The relationship is not symmetric — how whisper rates them is a separate judgement, made when whisper is analysed in its own right.
calls whisper “a widely used multilingual ASR model; choose for larger language coverage and community, trading away emotion/event tags.”
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
calls whisper “Reference Python implementation of the same Whisper model; choose it for canonical Python code or model training, not for C++ GPGPU speed.”
High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model
calls whisper “ASR model that translates speech into English text, if you only need text output and lighter deployment.”
Foundational Models for State-of-the-Art Speech and Text Translation