AI product Open source

Ollaya

Ollaya is an open-source system for running decision models locally. It accepts a message, email, ticket, or other JSON state together with typed questions and returns calibrated probabilities for choices, scores, or binary decisions rather than generated text.

View repository Visit site Mentioned in 2 videos ↓

Overview

The Ollaya daemon pulls models by name and serves them through a CLI and HTTP APIs, including TypeSafe-compatible `/v1/systemone`, `/v1/decisions`, and `/v1/models` endpoints. Its native API adds routing information and timings, while model definitions can embed reusable question sets. It supports ONNX Runtime on CPU and NVIDIA GPUs, and llama.cpp for GGUF models on CPU, CUDA, and Apple silicon.

Ollaya also provides an MCP server for clients such as Claude Code, Claude Desktop, and Cursor. It publishes small ONNX graphs while obtaining the original model weights from their authors' Hugging Face repositories, pinned and verified by commit and SHA-256; it does not re-host those weights. The project is distributed under Apache-2.0, while individual models retain their own licenses, and it is available as a CLI, daemon, desktop application, and Docker image.

What Ollaya is used for

2 uses taken from transcripts — each links to the moment in the video.

  • A system for running decision models locally. It accepts messages, emails, or tickets and returns scores and probabilities for questions such as whether something is urgent, with models available through an API and MCP connections to coding agents.

  • An open-source tool for running open decision models locally. It accepts state and typed questions and returns calibrated probabilities through a type-safe API, with an MCP server for exposing models to agents.

Videos mentioning Ollaya

2 in the library.