Philip Kiely

Lead Developer Advocate

Community

Building performant embedding workflows with Chroma and Baseten

Philip Kiely
Chroma Baseten
AI engineering

The best open-source embedding models

Philip Kiely
Best embedding models
Model performance

How we built BEI: high-throughput embedding, reranker, and classifier inference

Michael Feil
1 other
TensorRT-LLM for embeddings
Model performance

How multi-node inference works for massive LLMs like DeepSeek-R1

Phil Howes
1 other
Multi-node inference
Infrastructure

Testing Llama 3.3 70B inference performance on NVIDIA GH200 in Lambda Cloud

Pankaj Gupta
1 other
Testing GH200 GPUs
AI engineering

Private, secure DeepSeek-R1 in production in US & EU data centers

Yineng Zhang
2 others
DeepSeek R1
Model performance

How we built production-ready speculative decoding with TensorRT-LLM

Pankaj Gupta
2 others
Speculative Decoding with TensorRT-LLM
Model performance

A quick introduction to speculative decoding

Pankaj Gupta
2 others
Intro to Speculative Decoding
Infrastructure

Evaluating NVIDIA H200 Tensor Core GPUs for LLM inference

Pankaj Gupta
1 other
NVIDIA H200
123...8

Explore Baseten today

Start deploying
Talk to an engineer