‌

Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

Deploy your own model

All LLM Transcription Text to speech Image generation Embedding

24 TRT-LLM models

LLM

Qwen 3 32B

V3 - TRT-LLM - H100

Text to speech

Orpheus 3B Websockets

TRT-LLM - H100 MIG 40GB

Text to speech

Orpheus TTS

TRT-LLM - H100 MIG 40GB

LLM

Qwen 3 4B

V3 - TRT-LLM - H100

LLM

DeepSeek-R1 Llama 70B

R1 - Llama - TRT-LLM - H100

LLM

Llama 3.3 70B Instruct

3.3 - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 32B

R1 - Qwen - TRT-LLM - H100

LLM

Qwen 2.5 14B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 32B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 7B Math Instruct

2.5 - Math - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 8B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 32B QwQ

2.5 - QwQ - TRT-LLM - H100

LLM

DeepSeek-R1 Qwen 7B

R1 - Qwen - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 Nemotron Ultra 253B

3.1 - Nemotron - TRT-LLM - H100

LLM

Qwen 2.5 72B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 72B Math Instruct

2.5 - Math - TRT-LLM - H100

LLM

Qwen 2.5 14B Coder Instruct

2.5 - Coder - TRT-LLM - H100

LLM

Qwen 2.5 32B Instruct

2.5 - TRT-LLM - H100

LLM

Qwen 2.5 7B Coder Instruct

2.5 - Coder - TRT-LLM - H100 MIG 40GB

LLM

Qwen 2.5 7B Instruct

2.5 - TRT-LLM - H100 MIG 40GB

LLM

Mistral 7B Instruct

v3 - TRT-LLM - H100 MIG 40GB

LLM

Llama 3.1 70B Instruct

3.1 - Instruct - TRT-LLM - H100

LLM

Qwen 2.5 3B Instruct

2.5 - TRT-LLM - A10G

LLM

Mixtral 8x7B Instruct

v1 - TRT-LLM - H100

🔥 Trending models

Model API

LLM

DeepSeek V3.2

V3.2 - B200

Model API

LLM

GPT OSS 120B

MoE

Model API

LLM

Kimi K2 Thinking

Thinking - K2

Image generation

Qwen Image

Text-to-Image

Explore Baseten today

Start deploying

Talk to an engineer