live-dj

Gemini Live API is a Google API for building low-latency, real-time voice and vision applications with Gemini. It uses a stateful WebSocket connection to accept continuous audio, image, and text streams and return spoken audio, transcripts, and other model responses. The API supports barge-in interruption, function calling, Google Search, proactive audio, affective dialog, live transcription, and live voice-to-voice translation. Inputs can include raw 16-bit PCM audio, JPEG images, and text; audio responses are streamed as raw 16-bit PCM audio. Applications can connect server-to-server or directly from a client using WebSockets, with ephemeral tokens recommended for production client connections.

expo-gpt-live is an Expo SDK 57 voice-app template for iPhone that connects GPT-Live 1 with web search, a weather tool, selectable voices, and six AI Elements Persona variants. Users can speak during an AI reply, change the animated persona during a call, and keep a conversation running in the background on iOS. The project includes a local server that generates an app access token and relays requests using an OpenAI API key kept server-side. It uses native WebRTC and Rive components, so it requires a native build rather than Expo Go; the repository documents development on macOS with Xcode and deployment to a connected iPhone, as well as web and Android commands. Background calls are implemented on iOS only, and calls end after ten minutes. The repository is MIT-licensed. Its setup requires Node.js, macOS with Xcode, and an OpenAI API key with access to GPT-Live 1; the README advises adding authentication before exposing the backend publicly.

Voicebox is a local-first, open-source AI voice studio developed in the jamiepine/voicebox repository. It combines voice cloning, text-to-speech, speech-to-text dictation, voice profiles, audio effects, and agent voice output in a desktop application. It generates speech through seven switchable TTS engines, including Qwen3-TTS, Qwen CustomVoice, LuxTTS, Chatterbox, HumeAI TADA, and Kokoro, and supports voice cloning from reference audio, preset voices, multilingual generation, automatic text chunking, crossfading, and multi-track story editing. Whisper-based transcription powers global dictation, in-app recording, and the transcription API; an optional local Qwen3 LLM can refine dictation or rewrite text according to a voice profile's persona. The application exposes REST endpoints for speech generation, agent speech, transcription, and profile management, plus a built-in MCP server with tools for speaking, transcribing, and browsing captures and profiles. It runs models and stores voice data locally, using Tauri with a React/TypeScript frontend and FastAPI backend; platform backends include MLX on Apple Silicon and PyTorch on CUDA, ROCm, XPU, DirectML, or CPU. The repository is licensed under the MIT License and provides macOS, Windows, and Docker distribution, with Linux build-from-source instructions.

Moonshine Voice is an open-source AI toolkit for developers building real-time voice agents and applications. It provides on-device speech-to-text, intent recognition, and text-to-speech, including streaming transcription that processes audio while the user is still speaking. The project offers speech-to-text models ranging from higher-accuracy models to approximately 1 MB models and provides one library for Python, JavaScript/WASM, iOS, Android, macOS, Linux, Windows, and Raspberry Pi. It is used by Gemma Translator for speech recognition and speech output, and can run without an account or API keys. The project is distributed under the MIT License, including its models by default, with legacy non-streaming models for non-English languages covered by a non-commercial Moonshine Community License.