"Inference Engineering" is now available. Get your copy here

Matt Howard

Software Engineer

Matt Howard

Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath

Matt Howard

Philip Kiely

Colin McGrath

2 others

Control plane vs workload plane

Model performance

Continuous vs dynamic batching for AI inference

Matt Howard

Philip Kiely

Matt Howard

1 other

Continuous vs Dynamic batching

Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard

Vlad Shulman

Pankaj Gupta

Philip Kiely

Matt Howard

3 others

H100 MIGs

Explore Baseten today

Start deploying Talk to an engineer

Matt Howard - Software Engineer