Ollama

Ollaya is an open-source system for running decision models locally. It accepts a message, email, ticket, or other JSON state together with typed questions and returns calibrated probabilities for choices, scores, or binary decisions rather than generated text. The Ollaya daemon pulls models by name and serves them through a CLI and HTTP APIs, including TypeSafe-compatible `/v1/systemone`, `/v1/decisions`, and `/v1/models` endpoints. Its native API adds routing information and timings, while model definitions can embed reusable question sets. It supports ONNX Runtime on CPU and NVIDIA GPUs, and llama.cpp for GGUF models on CPU, CUDA, and Apple silicon. Ollaya also provides an MCP server for clients such as Claude Code, Claude Desktop, and Cursor. It publishes small ONNX graphs while obtaining the original model weights from their authors' Hugging Face repositories, pinned and verified by commit and SHA-256; it does not re-host those weights. The project is distributed under Apache-2.0, while individual models retain their own licenses, and it is available as a CLI, daemon, desktop application, and Docker image.

OpenHuman is a local-first personal AI system from tinyhumansai that combines persistent memory, agent orchestration, and research tools. It stores a user's data as scored Markdown trees in SQLite on the local machine and mirrors the result to an editable Obsidian vault; its TokenJuice component compresses tool output before it reaches the language model. Its orchestration layer runs checkpointed, durable agent workflows and worker fleets on graphs, with triggers, approvals, steering, halting, and replay support. The system also provides web search, scraping, coding tools, a browser, native voice through in-process Whisper, model routing, messaging integrations, and support for provider keys or fully local Ollama models. The repository describes it as an early beta under active development.

OpenHands is a self-hosted platform for running autonomous coding agents that work on GitHub issues. It can use either remote model providers or language models installed locally.

OpenClaude is an open-source, terminal-first coding-agent CLI for cloud and local model providers. It connects to OpenAI-compatible APIs, Gemini, GitHub Models, Codex, Ollama, Atomic Chat, and other supported backends, providing prompts, streaming output, Bash and file tools, grep, glob, agents, tasks, MCP, slash commands, web search and fetch, and image inputs for compatible providers. The CLI supports guided provider setup with saved profiles, conversation continuation and forking, detached local background sessions, model-specific agent routing, repository maps based on PageRank-ranked code structure, and a headless bidirectional-streaming gRPC server for integrations, CI/CD pipelines, and custom interfaces. A bundled VS Code extension provides launch integration, in-editor chat, provider-aware controls, and theme support. OpenClaude runs on Node.js 22 or newer, is distributed through npm and an Arch Linux AUR package, and can use local inference or remote APIs. Its repository is licensed MIT for the project's modifications and states that it is an independent community project derived from and substantially modified from the Claude Code codebase, without Anthropic affiliation.

llama.cpp is a C/C++ implementation for running large language and vision-language model inference locally or in the cloud, including on CPUs, GPUs, laptops, Apple silicon devices, and small computers such as Raspberry Pis. The project is built on the ggml library and uses integer quantization from 1.5-bit through 8-bit to reduce memory use and accelerate inference, with CPU, CUDA, HIP, Metal, Vulkan, SYCL, OpenCL, and other hardware backends. It supports hybrid CPU-GPU inference for models larger than available VRAM and includes command-line tools, a built-in web interface, and an OpenAI-compatible REST API server. The project is distributed as source code, Docker images, and pre-built binaries, with installation instructions at llama.app.