v0.4.2

What's Changed

• Handle None string in accelerator spec and add tests by @bolasim in #251
• Add stable diffusion 2.1 example with weights packaged by @bolasim in #256
• GPU sharing truss example by @pankajroark in #255
• Ignore pycache files for live reload patching by @pankajroark in #257
• update truss init doc by @philipkiely-baseten in #253
• Drop duplicate copy of server code for tests by @bolasim in #259
• Document GPU Sharing Example by @bolasim in #261
• Install tar for the truss-context-builder by @bolasim in #264

Full Changelog: v0.4.1...v0.4.2

v0.4.1

What's Changed

• Additional context and clarity in processing doc by @philipkiely-baseten in #249
• Reverted #231 by @squidarth in #252

Full Changelog: v0.4.0...v0.4.1

v0.4.0

What's Changed

• Increment truss base image version by @pankajroark in #203
• Add truss patch flow tests for all python versions by @pankajroark in #205
• Make Docker images smaller by deleting pip cache by @bolasim in #211
• Filter out healthcheck endpoints from access logging by @zero1zero in #210
• For live reload, retry if model is not ready by @pankajroark in #213
• Increment version to pick up recent changes by @pankajroark in #215
• Automate publishing various artifacts on project version change by @pankajroark in #206
• Bring back table_logger fix by @pankajroark in #216
• Autogenerate types with pyre and check with mypy 3.8 by @bolasim in #214
• Implement Truss Accelerator Spec by @bolasim in #218
• make external packages docs live by @philipkiely-baseten in #220
• add whisper example truss by @joostinyi in #223
• add_python_req modified to handle duplicates, change the version if exists by @tugrulguner in #231
• Fix lint by @pankajroark in #232
• Add trusses for Stable Diffusion models by @spal1 in #233
• Fix python version in GPU base images by @bolasim in #235
• Drop legacy Kserve input validation by @bolasim in #219
• Remove Inputs Key from Truss Templates by @philipkiely-baseten in #244
• Fix integration tests by @philipkiely-baseten in #245
• Create RC for new changes by @philipkiely-baseten in #246
• non-rc version bump by @philipkiely-baseten in #248

New Contributors

• @tugrulguner made their first contribution in #231

Full Changelog: v0.3.2...v0.4.0

v0.3.2

Bug fix for draft models for older versions of python

v0.2.0

With this release, a minor version increment recognizes the overall progress made on Truss since its initial release in Summer 2022. And simplified naming for key functions improves Truss' developer experience, while carefully considered warnings and a long deprecation period ensure nothing breaks.

Interface changes

• In the Python client, truss.create() replaces truss.mk_truss().
• In the Python client, truss.load() replaces truss.from_directory().
• In the Truss handle, truss.predict() offers a shorter alternative to truss.server_predict(). To use in place of truss.docker_predict(), pass the optional kwarg use_docker=True.
• In the command-line interface, the behavior of truss predict has been updated to match the Python client.
  • Previously, truss predict ran on Docker by default, which could be overriden with RUN_LOCAL=true.
  • Now, truss predict runs without Docker by default, which can be overriden with USE_DOCKER=true.

These interface changes are intended to improve Truss' developer experience, not cause unnecessary trouble. As such, the old mk_truss() and from_directory() functions, while marked with a deprecation warning, will not be removed until the next major version update. And both server_predict() and docker_predict() will be supported in the Truss handle indefinitely.

v0.1.13rc2

Failed models should shut down server
Solve python requirements inference

v0.1.13rc1

Only kill process on failed load if not live_reload (#166)

don't kill the process when live reload is enabled

v0.1.12

If model load fails, bring down the tornado server.

v0.1.11

Remove automatically adding numpy dependency for files
Fix break for numpy v1.24

v0.1.7: increase wait and retries (#129)

* increase wait and retries

* add server wait retries

* bump version