Releases: Lightning-AI/LitServe
Releases · Lightning-AI/LitServe
v0.2.13rc1
What's Changed
- Add mcp support in README by @aniketmaurya in #540
- Add Dependabot for Pip & GitHub Actions by @Borda in #541
- Comprehensive docstrings by @aniketmaurya in #545
- Update numpy requirement from <2.0 to <3.0 by @dependabot in #543
- Bump mypy from 1.11.2 to 1.16.0 by @dependabot in #544
- Bump the gha-updates group with 2 updates by @dependabot in #542
- Add reasoning effort parameter to OpenAI Spec ChatCompletionRequest by @bhimrazy in #548
- Fix async streaming with OpenAISpec by @aniketmaurya in #552
- add test for async-sync function invocation handler by @aniketmaurya in #553
- add pytest marker for unit, integration and e2e tests by @aniketmaurya in #554
- Update LitServer initialization parameters for type safety by @aniketmaurya in #555
- Send blocking CPU operations to thread for async conversion. by @aniketmaurya in #556
- Release 0.2.13rc1 by @aniketmaurya in #557
Full Changelog: v0.2.12...v0.2.13rc1
v0.2.12
What's Changed
- Docs: Address text-davinci-003 deprecation and new API structure in NewsAgent example by @kumarrah2002 in #521
- Add tests for async streaming loops by @bhimrazy in #522
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #523
- ci: Increase CI test timeout to 15 minutes by @bhimrazy in #526
- Enhance process and thread naming in LitServer by @aniketmaurya in #528
- Fix health and info endpoints when multiple LitAPIs are specified by @vrdn-23 in #529
- Pre-release 0.2.12.dev0 by @aniketmaurya in #531
- created shutdown endpoint with API key security and custom passed tests by @kumarrah2002 in #525
- chore: Update CODEOWNERS by @andyland in #533
- Shutdown server when workers crash by @andyland in #532
- Improve perf test connection pool by @aniketmaurya in #537
- make dependency installation check as utility function by @aniketmaurya in #535
- input schema extraction for MCP server by @aniketmaurya in #536
- Enable MCP server by @aniketmaurya in #534
- Release 0.2.12 by @aniketmaurya in #539
Full Changelog: 0.2.11...v0.2.12
v0.2.12.dev0
What's Changed
- Docs: Address text-davinci-003 deprecation and new API structure in NewsAgent example by @kumarrah2002 in #521
- Add tests for async streaming loops by @bhimrazy in #522
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #523
- ci: Increase CI test timeout to 15 minutes by @bhimrazy in #526
- Enhance process and thread naming in LitServer by @aniketmaurya in #528
- Fix health and info endpoints when multiple LitAPIs are specified by @vrdn-23 in #529
- Pre-release 0.2.12.dev0 by @aniketmaurya in #531
- created shutdown endpoint with API key security and custom passed tests by @kumarrah2002 in #525
Full Changelog: 0.2.11...v0.2.12.dev0
v0.2.11
What's Changed
- Remove un used imports and use enum by @mo7amed-3bdalla7 in #493
- moving max_batch_size in README to inside SimpleLitAPI() by @kumarrah2002 in #495
- rename deploy command by @aniketmaurya in #497
- missing fstring typo by @mathematicalmichael in #498
- fix: OpenAI Spec validations to work with async LitAPI by @bhimrazy in #499
- chore: Update CODEOWNERS to include additional reviewers by @aniketmaurya in #503
- fix OpenAI embedding spec for batching by @aniketmaurya in #500
- Release 0.2.11a0 by @aniketmaurya in #504
- add shutdown endpoint w/ test by @kumarrah2002 in #507
- Revert "add shutdown endpoint w/ test" by @aniketmaurya in #509
- add fpdb for multiprocess debugging using pdb by @aniketmaurya in #508
- Enhance logging configuration to support optional Rich logging by @aniketmaurya in #510
- Release 0.2.11a1 by @aniketmaurya in #511
- move stream, endpoint path, loop to LitAPI initialization by @aniketmaurya in #512
- Support multiple LitAPIs for inference process and endpoints by @aniketmaurya in #513
- Release 0.2.11a2 by @aniketmaurya in #516
- remove decode and encode methods from README by @aniketmaurya in #515
- decouple request handler and add test by @aniketmaurya in #517
- Support stream with non-stream LitAPIs by @aniketmaurya in #518
- Improve developer experience by @aniketmaurya in #519
New Contributors
- @mo7amed-3bdalla7 made their first contribution in #493
- @kumarrah2002 made their first contribution in #495
- @mathematicalmichael made their first contribution in #498
Full Changelog: v0.2.10...0.2.11
v0.2.11.a2
What's Changed
- move stream, endpoint path, loop to LitAPI initialization by @aniketmaurya in #512
- Support multiple LitAPIs for inference process and endpoints by @aniketmaurya in #513
- Release 0.2.11a2 by @aniketmaurya in #516
- remove decode and encode methods from README by @aniketmaurya in #515
Full Changelog: v0.2.11a1...v0.2.11.a2
v0.2.11a1
What's Changed
- add shutdown endpoint w/ test by @kumarrah2002 in #507
- Revert "add shutdown endpoint w/ test" by @aniketmaurya in #509
- add fpdb for multiprocess debugging using pdb by @aniketmaurya in #508
- Enhance logging configuration to support optional Rich logging by @aniketmaurya in #510
- Release 0.2.11a1 by @aniketmaurya in #511
Full Changelog: 0.2.11a0...v0.2.11a1
v0.2.11a0
What's Changed
- Remove un used imports and use enum by @mo7amed-3bdalla7 in #493
- moving max_batch_size in README to inside SimpleLitAPI() by @kumarrah2002 in #495
- rename deploy command by @aniketmaurya in #497
- missing fstring typo by @mathematicalmichael in #498
- fix: OpenAI Spec validations to work with async LitAPI by @bhimrazy in #499
- chore: Update CODEOWNERS to include additional reviewers by @aniketmaurya in #503
- fix OpenAI embedding spec for batching by @aniketmaurya in #500
- Release 0.2.11a0 by @aniketmaurya in #504
New Contributors
- @mo7amed-3bdalla7 made their first contribution in #493
- @kumarrah2002 made their first contribution in #495
- @mathematicalmichael made their first contribution in #498
Full Changelog: v0.2.10...0.2.11a0
v0.2.10
What's Changed
- Add Exception handling test for Async LitAPI Loops by @bhimrazy in #483
- Save references for async tasks to prevent tasks disappearing mid execution by @bhimrazy in #482
- Add tests for async loop processing by @bhimrazy in #485
- fix inference process termination by @aniketmaurya in #486
- Fix: CLI entry point to use lightning_sdk directly by @aniketmaurya in #487
- Remove asyncio.sleep and run in threadpool by @aniketmaurya in #489
- Enable true concurrency in async streaming loop and add tests by @bhimrazy in #488
Full Changelog: v0.2.9...v0.2.10
v0.2.9
What's Changed
- ci: take back testing with minimal package versions by @Borda in #472
- Move batch size to LitAPI by @aniketmaurya in #468
- feat: add metadata to the ChatCompletionRequest by @Danidapena in #473
- chore: fix link by @lianakoleva in #474
- remove request_timeout from LitAPI.pre_setup(...) by @aniketmaurya in #475
- Fix Windows Threading Issues by @FrsECM in #385
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #476
- enable asynchronous processing in LitAPI by @aniketmaurya in #477
- async support for streaming loop by @aniketmaurya in #478
- Enable true concurrency in async loop by @bhimrazy in #479
- Release 0.2.9 by @aniketmaurya in #480
New Contributors
- @Danidapena made their first contribution in #473
- @lianakoleva made their first contribution in #474
- @FrsECM made their first contribution in #385
Full Changelog: v0.2.8...v0.2.9
v0.2.9.dev0
What's Changed
- ci: take back testing with minimal package versions by @Borda in #472
- Move batch size to LitAPI by @aniketmaurya in #468
- feat: add metadata to the ChatCompletionRequest by @Danidapena in #473
- chore: fix link by @lianakoleva in #474
- remove request_timeout from LitAPI.pre_setup(...) by @aniketmaurya in #475
- Fix Windows Threading Issues by @FrsECM in #385
- [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in #476
- enable asynchronous processing in LitAPI by @aniketmaurya in #477
New Contributors
- @Danidapena made their first contribution in #473
- @lianakoleva made their first contribution in #474
- @FrsECM made their first contribution in #385
Full Changelog: v0.2.8...v0.2.9.dev0