AI product Open source

decider

decider is an open-source AI model family and Python package for one-pass typed decisions with calibrated probabilities. Instead of generating text, it reads a text or JSON state and a set of typed questions—Choice, Score, or Noul yes/no questions—and returns a probability distribution over each question's allowed answers from one forward pass. It renders each question as an answer slot, reads the model's hidden state at that slot, projects it onto the valid option-label tokens, and applies a fitted temperature; there is no decoding or output parsing.

View repository Mentioned in 1 video ↓

Overview

The package provides `decide()` and `system_one()` interfaces, an HTTP server with `/decide` and `/v1/systemone` endpoints, and GGUF loading through llama.cpp. Models are available in sizes intended for CPUs and laptops as well as CUDA and Apple Silicon GPUs, and the repository includes training, calibration, serving, evaluation, and schema-caching components. The project is an independent reproduction of the System One model class, is not affiliated with TypeSafe AI, and is released under the Apache 2.0 license.

What decider is used for

1 use taken from transcripts — each links to the moment in the video.

  • Provides AI agents with structured decision-making, returning probabilities for allowed answers in one model pass. It offers laptop and GPU models plus an API for integrating decisions into applications.

Videos mentioning decider

1 in the library.