Philip Kiely

Lead Developer Advocate

Model performance

How to double tokens per second for Llama 3 with Medusa

Abu Qader
1 other
Double Llama TPS with Medusa
Community

SPC hackathon winners build with Llama 3.1 on Baseten

Philip Kiely
SPC Hackathon winners
News

Introducing automatic LLM optimization with TensorRT-LLM Engine Builder

Abu Qader
1 other
TensorRT-LLM Engine Creation
Community

Ten reasons to join Baseten

Dustin Michaels
1 other
Join Baseten
Model performance

How to serve 10,000 fine-tuned LLMs from a single GPU

Pankaj Gupta
1 other
10,000 LoRAs 1 GPU
Infrastructure

Control plane vs workload plane in model serving infrastructure

Colin McGrath
2 others
Control plane vs workload plane
Model performance

Comparing tokens per second across LLMs

Philip Kiely
Comparing TPS across LLMs
AI engineering

CI/CD for AI model deployments

Vlad Shulman
3 others
CI/CD for AI models
AI engineering

Streaming real-time text to speech with XTTS V2

Het Trivedi
1 other
Streaming TTS
1234...7

Explore Baseten today

Start deploying
Talk to an engineer