Open source Kubernetes cost monitoring with AI inference tracking for LLM workloads
Unified library of SOTA model optimization techniques for compressing and accelerating deep learning models
Lightweight C++ inference engine for diffusion models