Our Series E: we raised $300M at a $5B Valuation to power a multi-model future. READ

Model Performance Team

Model performance

Boosting MTP acceptance in TensorRT-LLM: +40% throughput

Mahmoud Hassan
1 other
Boosting MTP acceptance in TensorRT-LLM: +40% throughput

Explore Baseten today

Start deploying
Talk to an engineer