Runtime

LocalAI

self-hosted OpenAI-compatible local inference

Platforms

Linux · macOS · Windows via containers

Why it matters

Runtime changes fit

Memory behavior, quantization support and throughput vary by runtime.