Runtime

MLX LM

Apple Silicon local inference and fine-tuning

Platforms

macOS

Why it matters

Runtime changes fit

Memory behavior, quantization support and throughput vary by runtime.

Evidence

Official/project docs

Inspect source ↗

Compatibility graph

Compatibility answers using this runtime

→ Can M4 Pro run Qwen3-8B? · EXCELLENT FIT