Changelog
See our latest feature releases, product improvements and bug fixes
Get 500 response code on model invocation error
Models deployed on Baseten using Truss 0.7.1 or later can now send the 500 response code when there is an error during model invocation. This change only affects newly deployed models.
Sep 7, 2023Manage API keys with new dashboard
We’ve updated your API key management panel with four key changes:
Aug 24, 2023Download the Truss of any model in your Baseten workspace
Every model deployed on Baseten uses Truss, our open-source framework for packaging models with their dependencies, hardware requirements, and more.
Aug 22, 2023Identifiable icon for inactive models
A small but mighty change: a 🚫 icon now clearly marks inactive models in the model dropdown and model version sidebar. The green dot for active models and moon icon for scaled-to-zero models remain...
Aug 14, 2023New model metrics views
Get cleaner, more accurate insights into your model’s performance and load with the refreshed model metrics charts in each model’s overview tab..
Aug 7, 2023Stream model output
Baseten now supports streaming model output. Instead of having to wait for the entire output to be generated, you can immediately start returning results to users with a sub-one-second...
Jul 22, 2023Stop a model deployment
If you deploy a model by accident or want to shut down a failed deployment quickly, you can now stop any model deployment before it finishes on the model page.
Jul 15, 2023New global navbar for easier navigation
Baseten’s global nav has a new layout that focuses on deployed models and makes it easier to get to your workspace settings and API keys.
Jul 1, 202340% price reduction across all instance types
Base per-minute CPU and GPU pricing is now 40% lower across all instance types, with volume discounts available on our Pro plan. We started getting a better deal from compute providers and thought...
Jun 16, 2023Debug with cleaner, faster, more accurate logs
The logs tab on your model pages got a serious glow-up: ANSI formatting, line-by-line links, a copy button in each log. Oh, and logs load much, much faster.