expo-gpt-live

VoiceStudio is an open-source, fully local desktop application for voice cloning and design, text-to-speech, transcription, dictation, video dubbing, and long-form audio production. It runs on macOS Apple Silicon, Windows, Linux, or Docker and keeps voices, projects, settings, and generated files on the machine by default. The application combines a Tauri desktop shell, a React and Vite interface, and a local FastAPI backend with registries for multiple TTS and ASR engines. Its workflows can transcribe and translate video, preserve speaker assignments, synthesize replacement speech, render audiobook chapters, separate vocals, diarize speakers, process batch jobs, and route work to CPU, CUDA, Apple Silicon MPS/MLX, ROCm, or optional remote workers. It also exposes local REST, SSE, WebSocket, OpenAI-compatible audio, and MCP interfaces, including speech synthesis and transcription endpoints. VoiceStudio is licensed under AGPL-3.0; downloaded models and tokenizers retain their own licenses. The local workflow requires no account, API key, subscription, or usage meter, although remote workers, configured external ASR endpoints, analytics, and other network-backed functions are opt-in. The repository describes the software as an active beta and distributes packaged desktop releases as well as source code.

Voicebox is a local-first, open-source AI voice studio developed in the jamiepine/voicebox repository. It combines voice cloning, text-to-speech, speech-to-text dictation, voice profiles, audio effects, and agent voice output in a desktop application. It generates speech through seven switchable TTS engines, including Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox, HumeAI TADA, and Kokoro, and supports voice cloning from reference audio, preset voices, multilingual generation, automatic text chunking, crossfading, and multi-track story editing. Whisper-based transcription powers global dictation, in-app recording, and the transcription API; an optional local Qwen3 LLM can refine dictation or rewrite text according to a voice profile's persona. The application exposes REST endpoints for speech generation, agent speech, transcription, and profile management, plus a built-in MCP server with tools for speaking, transcribing, and browsing captures and profiles. It runs models and stores voice data locally, using Tauri with a React/TypeScript frontend and FastAPI backend; platform backends include MLX on Apple Silicon and PyTorch on CUDA, ROCm, XPU, DirectML, or CPU. The repository is licensed under the MIT License and provides macOS, Windows, and Docker distribution, with Linux build-from-source instructions.

LiveKit Agents is an open-source Python framework for building programmable, real-time multimodal voice agents that run as server-side participants. It combines speech-to-text, large language models, text-to-speech, and realtime APIs with LiveKit's WebRTC clients, telephony stack, RPC and data APIs, and MCP tool support. The framework provides agent sessions, server-side job scheduling and dispatch, semantic turn detection based on a transformer model, multi-agent handoffs, and tools for voice, text-only, transcription, vision, and video-avatar applications. Agents can be tested with native test integration, including event assertions and LLM-based judges, and can run locally in console mode, in development mode with hot reloading, or in production mode. The framework can use LiveKit Cloud or a self-hosted LiveKit server and is distributed as a Python package with plugins for model providers. The Agents framework is licensed under Apache-2.0; LiveKit turn-detection models use the LiveKit Model License.

LiveKit is an open-source framework and developer platform for building, testing, deploying, scaling, and observing real-time voice, video, and physical AI agents. Its agent pipeline streams user speech from an app, browser, or phone call to an agent, which applies custom business logic and returns a response; the platform supports automatic turn detection and interruption handling, speech-to-text, language-model, and text-to-speech providers, web and mobile applications, and telephony through phone numbers and SIP integrations. LiveKit Cloud provides deployment and scaling on LiveKit's real-time infrastructure, alongside an inference gateway and full-stack observability for agent sessions.

live-dj is an open-source voice-agent demo in which users talk to Mira, a late-night radio DJ, ask her to play music, and interrupt her while she speaks. It uses the Gemini Live API through the raw `google-genai` SDK rather than an agent framework. The browser handles microphone capture, 16 kHz audio input, 24 kHz playback, client-side barge-in, and music ducking. The server maintains one asynchronous Live API session per browser and runs the core loop of opening a session, sending microphone audio, receiving streamed voice responses, and playing them. The full application adds Mira's persona, transcripts, music-tool dispatch, and controls for playing playlists or tracks, skipping, and pausing; the tools return immediately so the voice response does not stall. A minimal backend exposes the 39-line voice-only primitive, while the full server demonstrates the complete DJ application. The repository also documents a per-turn `session.receive()` behavior that requires an outer loop for continuing conversation, and shows that microphone audio must be sent through `send_realtime_input` rather than `send_client_content`. It runs locally with `uv`, Uvicorn, and a Gemini Developer API key. The repository includes a browser client, four dream-pop tracks, persona assets, and examples of the relevant implementation pitfalls.