Baseten acquires Parsed: Own your intelligence by unifying training and inference. READ

Bryce Dubayah

Engineering

AI engineering

Tool Calling in Inference

Kenzie Amack
1 other
Tool Calling in Inference
Model performance

How we run GPT OSS 120B at 500+ tokens per second on NVIDIA GPUs

Amir Haghighat
4 others
GPT OSS 120B
News

Introducing our Speculative Decoding Engine Builder integration for ultra-low-latency LLM inference

Justin Yi
3 others
Speculative Decoding in Engine Builder
Model performance

How to build function calling and JSON mode for open-source and fine-tuned LLMs

Bryce Dubayah
1 other
JSON Mode
News

Introducing function calling and structured output for open-source and fine-tuned LLMs

Bryce Dubayah
1 other
Function calling + JSON Mode

Explore Baseten today

Start deploying
Talk to an engineer