LiveKit Agents documentation

LiveKit Agents is an open-source Python framework for building programmable, real-time multimodal voice agents that run as server-side participants. It combines speech-to-text, large language models, text-to-speech, and realtime APIs with LiveKit's WebRTC clients, telephony stack, RPC and data APIs, and MCP tool support. The framework provides agent sessions, server-side job scheduling and dispatch, semantic turn detection based on a transformer model, multi-agent handoffs, and tools for voice, text-only, transcription, vision, and video-avatar applications. Agents can be tested with native test integration, including event assertions and LLM-based judges, and can run locally in console mode, in development mode with hot reloading, or in production mode. The framework can use LiveKit Cloud or a self-hosted LiveKit server and is distributed as a Python package with plugins for model providers. The Agents framework is licensed under Apache-2.0; LiveKit turn-detection models use the LiveKit Model License.

LiveKit is an open-source framework and developer platform for building, testing, deploying, scaling, and observing real-time voice, video, and physical AI agents. Its agent pipeline streams user speech from an app, browser, or phone call to an agent, which applies custom business logic and returns a response; the platform supports automatic turn detection and interruption handling, speech-to-text, language-model, and text-to-speech providers, web and mobile applications, and telephony through phone numbers and SIP integrations. LiveKit Cloud provides deployment and scaling on LiveKit's real-time infrastructure, alongside an inference gateway and full-stack observability for agent sessions.

An open-source benchmark and evaluation harness for voice agents. It runs hundreds of simulated callers against a complete agent and scores outcomes such as successful bookings, caller cutoffs, invented tool calls, and data leaks. Its methodology and evaluation sets are open, allowing teams to run the benchmark against their own data.

Agency Agents is a collection of specialized AI-agent instruction files and a native desktop app for macOS, Linux, and Windows. Its agents define domain-specific identities, workflows, rules, deliverables, code examples, and success metrics across engineering, design, marketing, sales, testing, security, finance, game development, GIS, healthcare, and other divisions. The repository provides scripts that convert and install the agents into tools including Claude Code, Cursor, GitHub Copilot, Gemini CLI, OpenCode, Aider, Windsurf, Qwen Code, Kimi Code, Codex, Osaurus, and others; the app browses the roster, installs selected agents, and keeps them updated. The repository is distributed under the MIT License.

Kit for AI is a service that provides a persistent memory and grounded-knowledge layer for AI agents. It exposes APIs and native memory tools that let agents call stored knowledge directly, supports ingesting files and URLs, and is intended to avoid building a separate retrieval-augmented generation stack. The site states the product works with any model and offers a free-to-start tier.