Our Series E: we raised $300M at a $5B valuation to power a multi-model future. READ
changelog / post

Structured output and function calling support

Go back

Models deployed with the TensorRT-LLM Engine Builder now support function calling (aka tool use) and structured output (aka JSON mode). Learn more: