AI product
Experiential Labs is an open-source AI gateway that provides an OpenAI-compatible endpoint for hosted model providers, customer-owned provider keys, private GPUs, and self-hosted models. It routes requests through a single API and key while handling provider access, model selection, failover, and streaming responses.
Its optional intelligence layer monitors traffic to identify model switches, improve cache hit rates, and route requests to customer-owned fine-tuned models. The service also provides organization-wide usage attribution, request logs, spend reporting, access controls, model allowlists, and per-key spending caps scoped by team, person, agent, or tool. It can be used as a hosted gateway or self-hosted, with hosted inference and Pro offered alongside the open-source gateway.
1 use taken from transcripts — each links to the moment in the video.
An open-source AI gateway that routes models through one OpenAI-compatible endpoint and one key at provider pricing. It supports hosted providers, customer keys, and private GPUs, while providing model-routing intelligence, usage visibility, spending controls, and self-hosting.
1 in the library.