Speech To Speech

Voicebox is a local-first, open-source AI voice studio developed in the jamiepine/voicebox repository. It combines voice cloning, text-to-speech, speech-to-text dictation, voice profiles, audio effects, and agent voice output in a desktop application. It generates speech through seven switchable TTS engines, including Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox, HumeAI TADA, and Kokoro, and supports voice cloning from reference audio, preset voices, multilingual generation, automatic text chunking, crossfading, and multi-track story editing. Whisper-based transcription powers global dictation, in-app recording, and the transcription API; an optional local Qwen3 LLM can refine dictation or rewrite text according to a voice profile's persona. The application exposes REST endpoints for speech generation, agent speech, transcription, and profile management, plus a built-in MCP server with tools for speaking, transcribing, and browsing captures and profiles. It runs models and stores voice data locally, using Tauri with a React/TypeScript frontend and FastAPI backend; platform backends include MLX on Apple Silicon and PyTorch on CUDA, ROCm, XPU, DirectML, or CPU. The repository is licensed under the MIT License and provides macOS, Windows, and Docker distribution, with Linux build-from-source instructions.

Speechify is an AI voice and text-to-speech platform that reads written material aloud and also provides speech-to-text, conversational, and business-focused AI tools. Its SpeechifyAI service offers text-to-speech and realtime voice-agent APIs through a single interface, with streaming synthesis, zero-shot voice cloning from a consented reference clip, SSML-based emotion control, and multilingual output for English, German, Mexican Spanish, French, Italian, and Brazilian Portuguese. The service includes the Simba model family, which the site describes as streaming-native speech models designed to model voice identity, expression, and language for realtime conversation. Speechify was co-founded by Cliff Weitzman, who initially built it to consume written material through audio.

VoiceStudio is an open-source, fully local desktop application for voice cloning and design, text-to-speech, transcription, dictation, video dubbing, and long-form audio production. It runs on macOS Apple Silicon, Windows, Linux, or Docker and keeps voices, projects, settings, and generated files on the machine by default. The application combines a Tauri desktop shell, a React and Vite interface, and a local FastAPI backend with registries for multiple TTS and ASR engines. Its workflows can transcribe and translate video, preserve speaker assignments, synthesize replacement speech, render audiobook chapters, separate vocals, diarize speakers, process batch jobs, and route work to CPU, CUDA, Apple Silicon MPS/MLX, ROCm, or optional remote workers. It also exposes local REST, SSE, WebSocket, OpenAI-compatible audio, and MCP interfaces, including speech synthesis and transcription endpoints. VoiceStudio is licensed under AGPL-3.0; downloaded models and tokenizers retain their own licenses. The local workflow requires no account, API key, subscription, or usage meter, although remote workers, configured external ASR endpoints, analytics, and other network-backed functions are opt-in. The repository describes the software as an active beta and distributes packaged desktop releases as well as source code.

LiveKit Agents is an open-source Python framework for building programmable, real-time multimodal voice agents that run as server-side participants. It combines speech-to-text, large language models, text-to-speech, and realtime APIs with LiveKit's WebRTC clients, telephony stack, RPC and data APIs, and MCP tool support. The framework provides agent sessions, server-side job scheduling and dispatch, semantic turn detection based on a transformer model, multi-agent handoffs, and tools for voice, text-only, transcription, vision, and video-avatar applications. Agents can be tested with native test integration, including event assertions and LLM-based judges, and can run locally in console mode, in development mode with hot reloading, or in production mode. The framework can use LiveKit Cloud or a self-hosted LiveKit server and is distributed as a Python package with plugins for model providers. The Agents framework is licensed under Apache-2.0; LiveKit turn-detection models use the LiveKit Model License.

Moonshine Voice is an open-source AI toolkit for developers building real-time voice agents and applications. It provides on-device speech-to-text, intent recognition, and text-to-speech, including streaming transcription that processes audio while the user is still speaking. The project offers speech-to-text models ranging from higher-accuracy models to approximately 1 MB models and provides one library for Python, JavaScript/WASM, iOS, Android, macOS, Linux, Windows, and Raspberry Pi. It is used by Gemma Translator for speech recognition and speech output, and can run without an account or API keys. The project is distributed under the MIT License, including its models by default, with legacy non-streaming models for non-English languages covered by a non-commercial Moonshine Community License.