Envoy Gateway

Envoy is a cloud-native, high-performance edge, middle, and service proxy hosted by the Cloud Native Computing Foundation (CNCF). In the cited AI-agent security setup, it validates inbound tokens before requests reach agent code.

Flux is an open-source continuous delivery and GitOps solution for keeping Kubernetes clusters synchronized with configuration sources such as Git repositories and OCI artifacts. It is built on the GitOps Toolkit, a set of Kubernetes APIs and controllers for source management, Kustomize and Helm deployments, notifications, and image automation; its controllers reconcile custom resources to apply and update cluster state. Flux supports multiple Git repositories and multi-tenancy, and can deliver Helm releases and charts. The project is a graduated Cloud Native Computing Foundation project.

Higress is a cloud-native API gateway and AI gateway developed as a vendor-neutral CNCF project. Based on Istio and Envoy, it supports Kubernetes Ingress and Gateway APIs, microservice discovery, security controls, unified LLM API management, and hosting MCP (Model Context Protocol) servers through plugins. The gateway is extended with WebAssembly plugins written in Go, Rust, or JavaScript. Its plugin mechanism supports streaming request and response processing, authentication and authorization, rate limiting, audit logging, observability, WAF features, AI model routing, token rate limiting, caching, and conversion of OpenAPI specifications into remote MCP servers. Higress provides an out-of-the-box console and can run with Docker or be deployed on Kubernetes using Helm.

Composio MCP Gateway is a governed MCP gateway for connecting AI agents to Composio's managed tools and customer-provided MCP servers. It provides a centralized endpoint through which agents discover and call tools across services such as Slack, Sentry, Datadog, PostHog, and Metabase, instead of connecting separately to each application. The gateway applies organization, team, user, and action-level access policies; keeps credentials out of agent configuration; manages authentication and token refresh; and records tool calls in a shared audit trail. Composio describes it as supporting more than 1,500 managed integrations and production use by enterprise teams.

Experiential is an open-source gateway and router for agent workflows from Experiential Labs. Its `exp` CLI provides hosted, bring-your-own-key, local, and custom models through OpenAI-compatible and Anthropic Messages APIs, with model aliases, access controls, use-case restrictions, and spending limits for users and agents. It can persist provider connections and configuration locally, expose API routes on loopback, and load a fitted project router as an OpenAI client through its Python interface. It collects OpenTelemetry traces from agent traffic to build simulations and optimize routing for quality, speed, and cost, and supports harness optimization, endpoint serving, model distillation, and fine-tuning an owned open-source model through Tinker. The hosted gateway is available at `api.experientiallabs.ai`; anonymous aggregate PostHog telemetry is enabled by default locally and can be disabled.