Skip to content

1.2410.1

Latest
Latest
Compare
Choose a tag to compare
@brunneis brunneis released this 08 Oct 23:22
· 3 commits to master since this release
1.2410.1
05380d2
This commit was signed with the committer’s verified signature.
brunneis Rodrigo Martínez
SSH Key Fingerprint: wlf0J/1Si9VZOCkRpOEkokmdks3UKaYvMhEjcbMaceQ Learn about vigilant mode.
  • Moved common generate() logic to LlmInterface base class for improved code reuse
  • Introduced _execute_request() method to be implemented by subclasses, enhancing extensibility
  • Removed duplicate code from provider-specific classes, reducing maintenance overhead
  • Made model_name optional in LlmInterface for more flexible initialization
  • Transitioned from setup.py to pyproject.toml for modern Python packaging
  • Updated version import in __init__.py for consistent versioning
  • Implemented streaming functionality across all supported providers
  • Updated README with streaming examples and improved usage instructions for better developer experience
  • Refactored LlmInterface to support both generate and stream methods, providing a unified API
  • Removed vLLM provider since vLLM servers run preferably with the OpenAI-compatible API
  • Updated imports, improved type hints and error handling for increased robustness
Assets 2
Loading