Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

large language models

Meta logoLlama 3.3 70B Instruct

LLM
3.3TRT-LLMH100

Meta logoLlama 3.1 70B Instruct

LLM
3.1InstructTRT-LLMH100

Qwen LogoQwen 2.5 7B Math Instruct

LLM
2.5MathTRT-LLMH100 MIG 40GB

Qwen LogoQwen 2.5 14B Instruct

LLM
2.5TRT-LLMH100

Qwen LogoQwen 2.5 32B Coder Instruct

LLM
2.5CoderTRT-LLMH100

Meta logoLlama 3.1 8B Instruct

LLM
3.1InstructTRT-LLMH100

audio transcription models

OpenAI logoWhisper (best performance)

Audio transcription
V3H100 MIG 40GB

OpenAI logoWhisper V3

Audio transcription
V3H100 MIG 40GB

OpenAI logoWhisper V3 Turbo

Audio transcription
V3TurboH100 MIG 40GB

image generation models

ByteDance logoSDXL Lightning

Image generation
1.0LightningA100

Stability AI logoStable Diffusion 3 Medium

Image generation
3A100

Stability AI logoStable Diffusion XL

Image generation
XL 1.0A10G

black forest labs logoflux-dev

Image generation
devbloat16H100 MIG 40GB

black forest labs logoflux-schnell

Image generation
schnellbfloat16H100 MIG 40GB

Stability AI logoComfy UI

Image generation
A10G

text embeddings models

Nomic AI logoNomic Embed v1.5

Text embeddings
v1.5T4

Microsoft LogoAll MPNet Base V2

Text embeddings
v2CPU

Microsoft LogoAll MiniLM L6 v2

Text embeddings
v2CPU

Jina AI logoJina Embeddings V2 Base EN

Text embeddings
V2ENCPU

audio generation models

Meta logoAudioGen Medium

Audio generation
A10G

Meta logoMusicGen Melody

Audio generation
MelodyA10G

Meta logoMusicGen Large

Audio generation
MusicA10G

Meta models

Meta logoLlama 3.3 70B Instruct

LLM
3.3TRT-LLMH100

Meta logoLlama 3.1 70B Instruct

LLM
3.1InstructTRT-LLMH100

Meta logoLlama 3.1 8B Instruct

LLM
3.1InstructTRT-LLMH100

Meta logoLlama 3.1 405B Instruct

LLM
3.1InstructH100

Stability AI models

Stability AI logoStable Diffusion 3 Medium

Image generation
3A100

Stability AI logoStable Diffusion XL

Image generation
XL 1.0A10G

Stability AI logoStable Video Diffusion

Image to video
Video 1.0A100

Stability AI logoComfy UI

Image generation
A10G

Stability AI logoSDXL ControlNet Canny

Image generation
XL 1.0ControlNet - CannyA10G

Stability AI logoSDXL ControlNet Depth

Image generation
XL 1.0ControlNet - DepthA10G

Mistral AI models

Mistral AI logoMistral 7B Instruct

LLM
v3TRT-LLMH100 MIG 40GB

Mistral AI logoPixtral 12B

LLM
PixtralvLLMA100

Mistral AI logoMixtral 8x7B Instruct

LLM
v1TRT-LLMH100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G