10 vLLM models

Meta logoLlama 4 Scout

LLM
V4.0InstructvLLMH100

Meta logoLlama 4 Maverick

LLM
V4.0InstructvLLMB200

Canopy Labs LogoOrpheus TTS

Text to speech
vLLMH100 MIG 40GB

Mistral AI logoMistral Small 3.1

LLM
3.1vLLMH100

google logoGemma 3 27B IT

LLM
3InstructvLLMH100

Fixie LogoUltravox v0.4

LLM
0.4vLLMH100 MIG 40GB

Mistral AI logoPixtral 12B

LLM
PixtralvLLMH100

Microsoft LogoPhi 3.5 Mini Instruct

LLM
3.5128kvLLMA10G

google logoGemma 2 9B

LLM
vLLMA100

google logoGemma 2 27B

LLM
vLLMA100

Deploy any model in just a few commands

Avoid getting tangled in complex deployment processes. Deploy best-in-class open-source models and take advantage of optimized serving for your own models.

$

truss init -- example stable-diffusion-2-1-base ./my-sd-truss

$

cd ./my-sd-truss

$

export BASETEN_API_KEY=MdNmOCXc.YBtEZD0WFOYKso2A6NEQkRqTe

$

truss push

INFO

Serializing Stable Diffusion 2.1 truss.

INFO

Making contact with Baseten 👋 👽

INFO

🚀 Uploading model to Baseten 🚀

Upload progress: 0% | | 0.00G/2.39G