Blazing-fast inference engine for on-device LLMs and edge AI
MNN is a high-performance inference engine by Alibaba optimized for running LLMs and AI models on edge devices. It powers production apps like MNN Chat and TaoAvatar, enabling offline multimodal AI experiences with local model execution.
Sign in to leave a comment.
No comments yet.
