AI Tools / AI products & services
ODS is a self-hosted local AI server stack developed by Osmantic for Linux, Windows with WSL2 and Docker Desktop, and Apple Silicon macOS. Its installers detect the host hardware, select an installable model, generate credentials, and launch a preconfigured stack containing local LLM inference, Open WebUI, a management dashboard, LiteLLM, embeddings, speech-to-text, text-to-speech, agents, n8n workflows, Qdrant-based RAG, search, ComfyUI image generation, and operational and privacy tools. Local mode is the default; cloud and hybrid modes can route through OpenAI, Anthropic, or Together APIs.
The stack uses a bootstrap model so chat can begin while the hardware-selected full model downloads in the background. A manifest-based extension system discovers service folders and merges their Docker Compose definitions into the stack, while the `ods` CLI manages services, models, modes, configuration, presets, and lifecycle operations. The repository documents GPU and unified-memory paths for NVIDIA, AMD, Intel Arc, and Apple Silicon hardware, along with model selection, recovery, validation, and operator workflows.
ODS is distributed as an Apache-2.0-licensed open-source repository and can be installed with shell or PowerShell installers. The repository identifies version 2.6.0 as its stable release and states that no cloud account or subscription is required for local operation.