Fast, exact LLM decoding on Apple Silicon with OpenAI-compatible API
Community recipes for serving modern LLMs locally on RTX 3090/4090/5090 GPUs
High-performance inference engine for LLMs, VLMs, and AI models across diverse accelerators
High-performance AI model inference server for cloud, edge, and embedded deployment
