Revalidation required
Finance — Private RAG Server — L40S
Revalidation required: a single L40S 48 GB is below the model card's ~55 GB bf16/fp16 requirement. Preserve this stack only as a conditional reference until a quantized or multi-GPU deployment is validated.
Recommendation status: REVALIDATION_REQUIRED. This configuration is excluded from verified Finder results until its deployment profile passes revalidation.
Onyx
Open tool profile →vLLM
Open runtime profile →NVIDIA L40S 48 GB / 128 GB RAM
CONDITIONALSelf-hosted local inference
Apache-2.0
Evidence
Continue the decision
Put this reference stack in context
A reference configuration is most useful when you compare it with alternatives and then apply your own hard constraints.
Private AI for Finance & Accounting
See the professional workflows and verified baselines connected to this stack.
Self-hosted RAG
Understand the architecture and privacy assumptions behind this use case.
Compare related stacks
Review this configuration beside related verified references.
Run the Stack Finder
Apply your exact profession, task, privacy requirement and hardware.
Freshness rule: Material changes set this stack to REVALIDATION_REQUIRED.