256 GB RAM
192 GB VRAM / unified GPU memory.
server
AMD Instinct MI300X 192 GB
Linux
0
Launch stacks currently tied to this exact reference profile.
Context matters
KV cache, context, modality, quantization and runtime overhead affect real hardware compatibility.