128 GB RAM
48 GB VRAM / unified GPU memory.
server
NVIDIA L40S 48 GB / 128 GB RAM
Linux
1
Launch stacks currently tied to this exact reference profile.
Context matters
KV cache, context, modality, quantization and runtime overhead affect real hardware compatibility.