Agent: CursorLLM: Claude 3.5#llm-inference#apple-silicon#mlx#openai-api#model-serving
TensorFold serves text models efficiently on Apple Silicon and NVIDIA GPUs through an OpenAI-compatible endpoint. Supports major models like Nemotron, Qwen, GLM with optimized kernels and draft verification for faster inference.