AI product Open source
billion-context is an open-source context-compression proxy and plugin for coding agents. It sits between an agent and an Anthropic-, OpenAI-, or compatible model API, parses and rewrites requests and streaming responses, and uses acp-kernel to manage conversation context. The proxy injects model-callable tools for compressing message ranges into layered summaries, restoring compressed ranges, searching compressed context, and viewing context status; compression is incremental, reversible, and designed to preserve prefix-cache reuse rather than applying a hard truncation limit. It can run as a standalone proxy, a launcher around supported clients, a native client plugin, or through a /bili/ base-URL prefix. The repository documents integrations for clients including Claude Code, pi, OpenCode, Codex, Aider, Gemini CLI, and others, with installation through the `bili` command from npm. The project is described as early, with real-model integration testing still a milestone. Its code and paper are MIT-licensed, with an additional attribution requirement for products or services whose users interact with the software.
1 use taken from transcripts — each links to the moment in the video.
An open-source context compression plugin that sits between any coding agent and its model API, rewriting Anthropic and OpenAI streams. It compresses consumed conversation into layered summaries so a small context window keeps up and a single session can run for days. Works with Claude Code, pi, opencode and more.
1 in the library.