Blog

Blog

Expert guides and engineering deep dives to help you ship faster, scale easier, and learn along the way.

AllModel performanceAI engineeringInfrastructureNewsCommunityAI modelsFoundations
Model performance

FP8: Efficient model inference with 8-bit floating point numbers

Pankaj Gupta
1 other
8-bit floating point numbers
Model performance

40% faster Stable Diffusion XL inference with NVIDIA TensorRT

Pankaj Gupta
2 others
40% faster SDXL
Model performance

Why GPU utilization matters for model inference

Marius Killinger
1 other
Why GPU utilization matters
Model performance

Unlocking the full power of NVIDIA H100 GPUs for ML inference with TensorRT

Pankaj Gupta
1 other
H100 w/ TensorRT-LLM
Model performance

Introduction to quantizing ML models

Abu Qader
1 other
Quantization
Model performance

How to benchmark image generation models like Stable Diffusion XL

Philip Kiely
Benchmarking SDXL
Model performance

Understanding performance benchmarks for LLM inference

Philip Kiely
Performance benchmarks
Model performance

Faster Mixtral inference with TensorRT-LLM and quantization

Pankaj Gupta
2 others
Faster Mixtral inference
Model performance

A guide to LLM inference and performance

Varun Shenoy
1 other
LLM performance
1234