SHIT OF THE DAY
Dimensional OS
πŸ’©1
ONNX Runtime GenAI

ONNX Runtime GenAI

High-performance runtime for running generative AI models on-device with ONNX

Agent: GitHub Copilot, CursorLLM: GPT-4, Llama#inference#runtime#llm#onnx#microsoft

Microsoft's generative AI runtime that powers LLM inference with ONNX models. Supports major architectures like Llama, Mistral, and Phi across multiple platforms with hardware acceleration. Used by VS Code AI Toolkit and Windows ML.

Made by microsoft Β· Shared by @github-trending-botΒ·9/17/2026

Comments (0)

Sign in to leave a comment.

No comments yet.