Model library

Browse our library of open source models that are ready to deploy behind an API endpoint in seconds.

42 large language models

DeepSeek Logo
Model API
LLM

DeepSeek V3 0324

V3 - 0324
DeepSeek Logo
Model API
LLM

DeepSeek R1 0528

R1 - 0528
Meta logo
Model API
LLM

Llama 4 Maverick

V4.0 - Instruct - vLLM - B200
Meta logo
Model API
LLM

Llama 4 Scout

V4.0 - Instruct - vLLM - H100
Qwen Logo
LLM

Qwen 3 235B

V3 - SGLang - H100
Qwen Logo
LLM

Qwen 3 4B

V3 - TRT-LLM - H100
Qwen Logo
LLM

Qwen 3 32B

V3 - TRT-LLM - H100
Mistral AI logo
LLM

Mistral Small 3.1

3.1 - vLLM - H100
google logo
LLM

Gemma 3 27B IT

3 - Instruct - vLLM - H100
DeepSeek Logo
LLM

DeepSeek-R1 Llama 70B

R1 - Llama - TRT-LLM - H100
Meta logo
LLM

Llama 3.3 70B Instruct

3.3 - TRT-LLM - H100
DeepSeek Logo
LLM

DeepSeek-R1 Qwen 32B

R1 - Qwen - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 14B Instruct

2.5 - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 32B Coder Instruct

2.5 - Coder - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 7B Math Instruct

2.5 - Math - TRT-LLM - H100 MIG 40GB
Meta logo
LLM

Llama 3.1 8B Instruct

3.1 - Instruct - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 32B QwQ

2.5 - QwQ - TRT-LLM - H100
DeepSeek Logo
LLM

DeepSeek-R1 Qwen 7B

R1 - Qwen - TRT-LLM - H100 MIG 40GB
NVIDIA logo
LLM

Llama 3.1 Nemotron 70B

3.1 - Nemotron - A100
Meta logo
LLM

Llama 3.1 405B Instruct

3.1 - Instruct - H100
Fixie Logo
LLM

Ultravox v0.4

0.4 - vLLM - H100 MIG 40GB
Meta logo
LLM

Llama 3.2 11B Vision Instruct

3.2 - Vision - A100
NVIDIA logo
LLM

Llama 3.1 Nemotron Ultra 253B

3.1 - Nemotron - TRT-LLM - H100
Mistral AI logo
LLM

Pixtral 12B

Pixtral - vLLM - H100
Qwen Logo
LLM

Qwen 2.5 72B Instruct

2.5 - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 72B Math Instruct

2.5 - Math - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 14B Coder Instruct

2.5 - Coder - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 32B Instruct

2.5 - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 7B Coder Instruct

2.5 - Coder - TRT-LLM - H100 MIG 40GB
Qwen Logo
LLM

Qwen 2.5 7B Instruct

2.5 - TRT-LLM - H100 MIG 40GB
Mistral AI logo
LLM

Mistral 7B Instruct

v3 - TRT-LLM - H100 MIG 40GB
Meta logo
LLM

Llama 3.1 70B Instruct

3.1 - Instruct - TRT-LLM - H100
Qwen Logo
LLM

Qwen 2.5 3B Instruct

2.5 - TRT-LLM - A10G
DeepSeek Logo
LLM

DeepSeek-R1 Zero

R1 - Zero - SGLang - H200
Meta logo
LLM

Llama 3.2 90B Vision Instruct

3.2 - Vision - H100
Microsoft Logo
LLM

Phi 3.5 Mini Instruct

3.5 - 128k - vLLM - A10G
Microsoft Logo
LLM

Phi 3 Mini 128K Instruct

3 - 128k - T4
DeepSeek Logo
LLM

DeepSeek Prover V2 671B

V2 - Prover - SGLang
Mistral AI logo
LLM

Mixtral 8x7B Instruct

v1 - TRT-LLM - H100

🔥 Trending models