AI product Open source
Gauge CLI is an open-source command-line tool for evaluating and improving how coding agents discover and use Skills, CLIs, SDKs, MCPs, APIs, and documentation. It runs real agent sessions, captures normalized transcripts and outcomes, identifies friction such as blocked interactive commands, deprecated usage, unused Skills, incorrect limitation claims, or unclear multi-command workflows, and supports comparing proposed fixes with a baseline.
The local workflow runs in Docker using configured agent credentials or subscriptions. Users initialize a project, define evaluations or preference prompts with tasks and criteria, execute agents such as Claude Code, Codex, Pi, or OpenCode against working-tree inputs, and have an agent analyze the evidence into structured findings and judgments. The CLI supports rerunning evaluations against changed Skills, documentation, code, CLIs, or SDK artifacts and comparing batches; hosted Gauge adds managed execution, shared measurements, authenticated inputs, and automation.
The package is distributed through npm as @withgauge/cli and requires Node.js 22.13 or later and Docker for local execution. The repository is licensed under MIT. Local measurements and analysis are stored in a private .gauge workspace backed by SQLite.
1 use taken from transcripts — each links to the moment in the video.
An open-source command line tool that tests how well coding agents can use your skills, CLIs, and SDKs. It spins up real sessions with Claude Code inside Docker, flags where the agent gets stuck, and compares fixes against a baseline.
1 in the library.