π©
Engine-agnostic LLM gateway built in Rust that centralizes model routing across vLLM, TensorRT-LLM, SGLang, OpenAI, Anthropic, and Gemini. Features industry-first gRPC pipeline, KV cache-aware routing, multi-tenant auth, MCP tooling, and chat history management behind a unified OpenAI/Anthropic-compatible API.