Ming Voice

Speakrail is a fully local, full-duplex voice assistant that runs on a single 24 GB NVIDIA GPU such as an RTX 4090. It combines Voxtral Mini 4B Realtime for speech recognition with a turn-taking head that evaluates the conversation every 80 ms, and uses Gemma 4 12B with a Speakrail LoRA to decide whether to speak, listen, interrupt, yield, or interject. Breeze TTS 2 produces the assistant's speech; peek decoding can begin preparing a response before the turn is fully confirmed, while listening notes preserve longer or corrected requests. The local web application provides tools for weather, timers, notes, lists, calculations, unit conversion, and optional web search or external model access. It is distributed as Docker Compose services and requires Linux, Docker with NVIDIA Container Toolkit, roughly 75 GB of disk space, and a suitable NVIDIA GPU. Speakrail's code is licensed under Apache 2.0, while the default Breeze TTS 2 model and generated audio are restricted to research and non-commercial use.

Moonshine Voice is an open-source AI toolkit for developers building real-time voice agents and applications. It provides on-device speech-to-text, intent recognition, and text-to-speech, including streaming transcription that processes audio while the user is still speaking. The project offers speech-to-text models ranging from higher-accuracy models to approximately 1 MB models and provides one library for Python, JavaScript/WASM, iOS, Android, macOS, Linux, Windows, and Raspberry Pi. It is used by Gemma Translator for speech recognition and speech output, and can run without an account or API keys. The project is distributed under the MIT License, including its models by default, with legacy non-streaming models for non-English languages covered by a non-commercial Moonshine Community License.

Voicebox is a local-first, open-source AI voice studio developed in the jamiepine/voicebox repository. It combines voice cloning, text-to-speech, speech-to-text dictation, voice profiles, audio effects, and agent voice output in a desktop application. It generates speech through seven switchable TTS engines, including Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox, HumeAI TADA, and Kokoro, and supports voice cloning from reference audio, preset voices, multilingual generation, automatic text chunking, crossfading, and multi-track story editing. Whisper-based transcription powers global dictation, in-app recording, and the transcription API; an optional local Qwen3 LLM can refine dictation or rewrite text according to a voice profile's persona. The application exposes REST endpoints for speech generation, agent speech, transcription, and profile management, plus a built-in MCP server with tools for speaking, transcribing, and browsing captures and profiles. It runs models and stores voice data locally, using Tauri with a React/TypeScript frontend and FastAPI backend; platform backends include MLX on Apple Silicon and PyTorch on CUDA, ROCm, XPU, DirectML, or CPU. The repository is licensed under the MIT License and provides macOS, Windows, and Docker distribution, with Linux build-from-source instructions.

whisper.cpp is a C/C++ implementation of OpenAI's Whisper automatic speech-recognition model for speech-to-text inference. It is designed for offline, on-device use and supports CPU-only inference, GPU and NPU acceleration, integer quantization, mixed F16/F32 precision, voice activity detection, and a C-style API. The implementation targets macOS, iOS, Android, Linux, Windows, WebAssembly, Raspberry Pi, Docker, and other platforms, with optimizations including ARM NEON, Apple's Accelerate and Metal frameworks, x86 AVX, POWER VSX, Vulkan, CUDA-related NVIDIA support, ROCm, OpenVINO, and other backends. The repository includes the whisper-cli example, which transcribes 16-bit WAV audio using Whisper models converted to ggml format; its zero-dependency implementation is intended for integration into applications such as on-device captioning tools.

VoiceStudio is an open-source, fully local desktop application for voice cloning and design, text-to-speech, transcription, dictation, video dubbing, and long-form audio production. It runs on macOS Apple Silicon, Windows, Linux, or Docker and keeps voices, projects, settings, and generated files on the machine by default. The application combines a Tauri desktop shell, a React and Vite interface, and a local FastAPI backend with registries for multiple TTS and ASR engines. Its workflows can transcribe and translate video, preserve speaker assignments, synthesize replacement speech, render audiobook chapters, separate vocals, diarize speakers, process batch jobs, and route work to CPU, CUDA, Apple Silicon MPS/MLX, ROCm, or optional remote workers. It also exposes local REST, SSE, WebSocket, OpenAI-compatible audio, and MCP interfaces, including speech synthesis and transcription endpoints. VoiceStudio is licensed under AGPL-3.0; downloaded models and tokenizers retain their own licenses. The local workflow requires no account, API key, subscription, or usage meter, although remote workers, configured external ASR endpoints, analytics, and other network-backed functions are opt-in. The repository describes the software as an active beta and distributes packaged desktop releases as well as source code.