server

NVIDIA H100 80 GB

Linux

Memory

256 GB RAM

80 GB VRAM / unified GPU memory.

Reference stacks

0

Launch stacks currently tied to this exact reference profile.

Important

Context matters

KV cache, context, modality, quantization and runtime overhead affect real hardware compatibility.