AI product Open source

earshot

earshot is an open-source audio analysis and sound-generation tool for coding agents. It runs locally on CPU through a CLI, Python API, or MCP server and turns audio into evidence an agent can interpret, including calibrated sound descriptions, vocabulary matches, candidate rankings, moments found inside long recordings, real-versus-code-synthesized assessments, listening timelines, measurements, annotated images, and video sound-sync critiques.

View repository Mentioned in 2 videos ↓

Overview

Its forge component generates effects from physical-synthesis recipes such as modal resonators, filtered noise, room and microphone models, and layered DSP, then searches and refines variants using audio descriptions, reference recordings, spectrograms, model-free measurements, and artifact checks. The fit component analyzes a recording by synthesis and writes a parameterized recipe that can render variations or morphs. A bundled sound-effect bank can render coded effects by identifier, while kit commands assemble deterministic film sound kits with measured onset, peak, and end points.

The project includes an MCP server for Claude Code and other agents, static HTML galleries for generated sounds, and optional audio-LLM critique with explicit consent and a user-supplied key. Its code is MIT-licensed; the two open models it uses have separate licenses. Installation requires Python 3.10+ and ffmpeg, and the first model use downloads approximately 1 GB of model files for local caching.

What earshot is used for

2 uses taken from transcripts — each links to the moment in the video.

  • Gives coding agents audio feedback they can reason about: it describes sound files, finds moments matching a description, checks how effects line up with video cuts, and lets an agent synthesize and refine effects using measurements. Core tools run locally on CPU through a CLI or MCP server.

  • Open-source CPU-only toolkit that lets AI coding agents listen to and judge audio, describe sounds, score sound design, synthesize sounds in code, and convert recordings into code recipes; runs as a CLI, Python API, or MCP server.

Videos mentioning earshot

2 in the library.