Baseten acquires Parsed: Own your intelligence by unifying training and inference. READ

Philip Kiely

Lead Developer Advocate

Model performance

How to serve 10,000 fine-tuned LLMs from a single GPU

Pankaj Gupta
1 other
10,000 LoRAs 1 GPU
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Model performance

Comparing tokens per second across LLMs

Philip Kiely
Comparing TPS across LLMs
AI engineering

CI/CD for AI model deployments

Vlad Shulman
3 others
CI/CD for AI models
AI engineering

Streaming real-time text to speech with XTTS V2

Het Trivedi
1 other
Streaming TTS
Model performance

Continuous vs dynamic batching for AI inference

Matt Howard
1 other
Continuous vs Dynamic batching
Infrastructure

Using fractional H100 GPUs for efficient model serving

Matt Howard
3 others
H100 MIGs
Model performance

Benchmarking fast Mistral 7B inference

Abu Qader
3 others
Mistral 7B
Model performance

33% faster LLM inference with FP8 quantization

Pankaj Gupta
1 other
Faster inference with FP8
12345...8

Explore Baseten today

Start deploying
Talk to an engineer