AI product Open source
EAGLE-4 is source-available inference software that accelerates large language model generation through speculative decoding. Its eagle-harness package uses measured costs on the target hardware, batch size, and workload to determine how far to speculate, with draft trees sized for the serving conditions; the target model's output is intended to remain unchanged. The repository integrates EAGLE-4 draft models with SGLang, vLLM, and TokenSpeed, and provides Docker and Python installation paths plus engine guides and configuration documentation. It requires compatible GPU software and hardware, and is distributed under the Eagle 4 Source-Available License rather than an OSI-approved open-source license.
1 use taken from transcripts — each links to the moment in the video.
Source-available inference code that speeds up LLMs through speculative decoding, measuring costs on your setup and adapting how far to speculate per batch size and workload; plugs into SGLang, vLLM, and TokenSpeed.
1 in the library.