v0.2.0
What's Changed
- Add warning message if
batch
andunbatch
is implemented but max_batch_size is unset. by @bhimrazy in #185 - cleanup: move middleware to utils by @aniketmaurya in #189
- Add meaningful error message if response queues are not initialized by @rasbt in #191
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #193
- add codeowners by @aniketmaurya in #194
- cleanup: fix test naming convention by @aniketmaurya in #190
- properly shutdown litserve workers by @aniketmaurya in #192
- provide uvicorn configs with kwargs by @aniketmaurya in #198
- remove uvicorn from argument names by @aniketmaurya in #199
- fix flaky batch timeout test by @aniketmaurya in #200
- moved wrap_litserve_start to utils by @ankitsharma07 in #201
- bump version by @aniketmaurya in #202
- remove dead code by @aniketmaurya in #204
- bump version v0.2.0 by @aniketmaurya in #203
- add fastapi parity test by @aniketmaurya in #183
- Feat: Add support for response_format field in OpenAI Spec by @bhimrazy in #197
- Enable parity test for GPU by @aniketmaurya in #205
- add classical ML examples by @aniketmaurya in #206
- fix Studio links by @aniketmaurya in #207
- minor cleanup by @aniketmaurya in #209
New Contributors
- @ankitsharma07 made their first contribution in #201
Full Changelog: v0.1.5...v0.2.0