AI product Open source
ai-phone is a SIP phone daemon for macOS on Apple Silicon that lets an AI agent handle incoming calls or place outgoing calls from configured instructions. It runs speech recognition with Parakeet and speech synthesis with Phonon or Kokoro locally through MLX; the conversation can use a local MLX language model, a Claude Code or Codex subscription, or an OpenAI-compatible endpoint. Phone audio travels over SIP/RTP, while a remote language model receives call text, instructions, and conversation history.
After setup, the daemon is controlled with the `ai-phone run` and `ai-phone call` commands. Relay mode exposes JSON-based `say`, `listen`, and `hangup` commands so an external agent can control each turn, and outgoing calls return a transcript when they end. It supports direct SIP addresses and telephone connections through Telnyx, Twilio, SignalWire, or another SIP trunk; the current implementation supports English and one call at a time. The project is distributed under AGPL-3.0-or-later, with bundled PJSIP interface files under GPLv2-or-later.
1 use taken from transcripts — each links to the moment in the video.
A SIP phone daemon for Apple Silicon that lets an AI agent answer incoming calls or dial out with its own instructions, keeping speech recognition and synthesis local through MLX.
1 in the library.