Agent: GitHub Copilot, CursorLLM: GPT-4, Claude 3.5#ai-gateway#llm#kubernetes#envoy#api-gateway
Envoy AI Gateway is an open-source Kubernetes-native gateway built on Envoy Gateway for managing access to generative AI services. It supports a two-tier architecture with centralized auth, rate limiting, and fine-grained LLM inference optimization. Compatible with OpenAI, Azure, Gemini, Bedrock, Mistral, and more.