AI product Open source · Apache-2.0

Higress

Higress is a cloud-native API gateway and AI gateway developed as a vendor-neutral CNCF project. Based on Istio and Envoy, it supports Kubernetes Ingress and Gateway APIs, microservice discovery, security controls, unified LLM API management, and hosting MCP (Model Context Protocol) servers through plugins.

View repository Visit site

Overview

The gateway is extended with WebAssembly plugins written in Go, Rust, or JavaScript. Its plugin mechanism supports streaming request and response processing, authentication and authorization, rate limiting, audit logging, observability, WAF features, AI model routing, token rate limiting, caching, and conversion of OpenAPI specifications into remote MCP servers. Higress provides an out-of-the-box console and can run with Docker or be deployed on Kubernetes using Helm.