Skip to content

Releases: EveripediaNetwork/llmdk

1.2410.1

08 Oct 23:22
05380d2
Compare
Choose a tag to compare
  • Moved common generate() logic to LlmInterface base class for improved code reuse
  • Introduced _execute_request() method to be implemented by subclasses, enhancing extensibility
  • Removed duplicate code from provider-specific classes, reducing maintenance overhead
  • Made model_name optional in LlmInterface for more flexible initialization
  • Transitioned from setup.py to pyproject.toml for modern Python packaging
  • Updated version import in __init__.py for consistent versioning
  • Implemented streaming functionality across all supported providers
  • Updated README with streaming examples and improved usage instructions for better developer experience
  • Refactored LlmInterface to support both generate and stream methods, providing a unified API
  • Removed vLLM provider since vLLM servers run preferably with the OpenAI-compatible API
  • Updated imports, improved type hints and error handling for increased robustness

1.2410.0

03 Oct 14:33
9f1da72
Compare
Choose a tag to compare
  • Update all provider classes to use a unified generate method signature
  • Add support for system prompts and pre-defined message lists
  • Implement flexible kwargs handling for provider-specific options
  • Replace max_tokens and temperature params with more generic approach
  • Update type hints and imports across all provider files
  • Improve error handling and default values in provider initializations
  • Standardize payload construction and API call patterns
  • Remove unused parameters and simplify client instantiations