VoiceStudio

Voicebox is a local-first, open-source AI voice studio developed in the jamiepine/voicebox repository. It combines voice cloning, text-to-speech, speech-to-text dictation, voice profiles, audio effects, and agent voice output in a desktop application. It generates speech through seven switchable TTS engines, including Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox, HumeAI TADA, and Kokoro, and supports voice cloning from reference audio, preset voices, multilingual generation, automatic text chunking, crossfading, and multi-track story editing. Whisper-based transcription powers global dictation, in-app recording, and the transcription API; an optional local Qwen3 LLM can refine dictation or rewrite text according to a voice profile's persona. The application exposes REST endpoints for speech generation, agent speech, transcription, and profile management, plus a built-in MCP server with tools for speaking, transcribing, and browsing captures and profiles. It runs models and stores voice data locally, using Tauri with a React/TypeScript frontend and FastAPI backend; platform backends include MLX on Apple Silicon and PyTorch on CUDA, ROCm, XPU, DirectML, or CPU. The repository is licensed under the MIT License and provides macOS, Windows, and Docker distribution, with Linux build-from-source instructions.

Moonshine Voice is an open-source AI toolkit for developers building real-time voice agents and applications. It provides on-device speech-to-text, intent recognition, and text-to-speech, including streaming transcription that processes audio while the user is still speaking. The project offers speech-to-text models ranging from higher-accuracy models to approximately 1 MB models and provides one library for Python, JavaScript/WASM, iOS, Android, macOS, Linux, Windows, and Raspberry Pi. It is used by Gemma Translator for speech recognition and speech output, and can run without an account or API keys. The project is distributed under the MIT License, including its models by default, with legacy non-streaming models for non-English languages covered by a non-commercial Moonshine Community License.

VoxCPM is an open-source tokenizer-free text-to-speech system from OpenBMB for multilingual speech generation, voice design, and voice cloning. Its latest major release, VoxCPM2, directly generates continuous speech representations in the latent space of AudioVAE V2 through a four-stage diffusion-autoregressive pipeline: LocEnc, TSLM, RALM, and LocDiT. It accepts text, optional natural-language voice descriptions, or reference audio with transcripts, and produces streaming or batch speech audio; VoxCPM2 supports 30 languages, voice-style controls, controllable and continuation-based cloning, and native 48 kHz output. The project provides a Python package and command-line interface, a local web demo, fine-tuning through full supervised training or LoRA, and serving options including an OpenAI-compatible vLLM-Omni endpoint. Its code and model weights are released under the Apache-2.0 license. The project warns that generated voices can be misused for impersonation, fraud, or disinformation, and notes that voice-design and controllable-cloning results can vary between runs.

Speech To Speech is an open-source, modular voice-agent pipeline from Hugging Face. It chains voice activity detection, speech-to-text, a language model, and text-to-speech as separate stages connected by queues; each stage has interchangeable backends. The language-model stage supports OpenAI-compatible protocols and can use hosted providers, Hugging Face Inference Providers, vLLM, or llama.cpp, while the system streams transcripts, generated text, tool calls, and synthesized audio. The project exposes the core OpenAI Realtime event set through WebSocket and WebRTC and includes commands for running a realtime server, a microphone-and-speaker client, or a local setup. It is distributed as a Python package and requires Python 3.10 or newer. The repository says the pipeline is used as the conversation backend for Reachy Mini robots.

BetterWispr is a free, open-source, local-first voice-dictation app for macOS. It uses Apple on-device speech recognition, NVIDIA Parakeet, or Whisper to transcribe speech locally and paste the result into the active application; built-in models work offline after download. It supports hold-to-talk or toggle shortcuts, vocabulary and phrase replacements, voice commands, correction learning, and locally stored transcript history. Its meeting mode provides live transcripts, titles, summaries, and action items using Apple Intelligence or a local Ollama model. Optional Sarvam AI, Smallest AI, and OpenAI-compatible endpoints can be added, in which case audio is sent to the selected endpoint rather than handled entirely on-device. The project requires macOS 14 or later, recommends Apple Silicon, and is distributed under the Apache-2.0 license.