STACKELIERFind my stack
Runtime

KoboldCpp

portable GGUF local inference server

Platforms

Windows · Linux · macOS

Why it matters

Runtime changes fit

Memory behavior, quantization support and throughput vary by runtime.