Runtime
TensorRT-LLM
NVIDIA optimized inference
Privacy status: REVALIDATION REQUIRED. Default anonymous telemetry means TensorRT-LLM must be scored by actual deployment configuration. Stackelier should not classify the default configuration as fully offline/no-egress.
Runtime changes fit
Memory behavior, quantization support and throughput vary by runtime.