Verified reference stack

Finance — Private RAG Server — L40S

Retained from previous verified set.

Application

Onyx

Runtime

vLLM

Model

Mistral Small 3.1 24B

Hardware

NVIDIA L40S 48 GB / 128 GB RAM

EXCELLENT

Privacy

Self-hosted local inference

License / terms

Apache-2.0

Evidence

Freshness rule: Material changes set this stack to REVALIDATION_REQUIRED.