Blog

Blog

Expert guides and engineering deep dives to help you ship faster, scale easier, and learn along the way.

AllModel performanceAI engineeringInfrastructureNewsCommunityAI modelsFoundations
Infrastructure

How we built Multi-cloud Capacity Management (MCM)

William Lau
3 others
Building multi-cloud capacity management at Baseten
Infrastructure

How Baseten multi-cloud capacity management (MCM) unifies deployments

Rachel Rapp
1 other
Baseten multi-cloud capacity management
Infrastructure

Accelerating inference with NVIDIA B200 GPUs

Philip Kiely
B200 GPUs
Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Testing GH200 GPUs
Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta
1 other
NVIDIA H200
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs
Infrastructure

The benefits of globally distributed infrastructure for model serving

Phil Howes
1 other
Benefits of global infra
Infrastructure

NVIDIA A10 vs A10G for ML model inference

Philip Kiely
A10 vs A10G
12