AI product Open source
Strands Decider is a small decision model for agentic AI workflows, developed for use with the Strands Agents SDK. It selects among options, answers yes/no questions, or scores inputs against an ordered rubric, returning a calibrated confidence value for each decision. These capabilities support tasks such as model routing, tool selection, argument checking, triage, guardrail checks, and evaluation.
The model uses a pretrained decoder LLM torso with its language-modeling head replaced by a pointer head. The head compares hidden states at the answer position and at each option's final token, scoring all options in one forward pass without text generation or a decoding loop. The same masked-softmax design supports its choice, noul, and score question types. The repository includes a command-line interface, a local HTTP server, an example that gates a Strands agent's tool call, and optional image inputs through a vision mode.
It can run on CUDA, Apple silicon through MLX or MPS, and CPU. The project is distributed under the Apache License 2.0 and can be installed with pip.
1 use taken from transcripts — each links to the moment in the video.
Handles small decisions made by AI agents, such as tool selection, request routing, and whether an answer needs another check. It returns a choice and confidence score and can run locally with examples for integration into an agent.
1 in the library.